SlideShare a Scribd company logo
1 of 19
Download to read offline
Building the NINAPRO Database:
A Resource for the Biorobotics Community
           1Manfredo Atzori, 2Arjan Gijsberts, 3Simone Heynen,
 3Anne-Gabrielle Mittaz Hager, 4Olivier Deriaz, 5Patrick van der Smagt,
      5Claudio Castellini, 2Barbara Caputo, and 1Henning Müller




            1Dept.     Business Information Systems, HES-SO Valais, Switzerland
                              2 Institute de Recherche Idiap, Switzerland
                 3 Department of Physical Therapy, HES-SO Valais, Switzerland
                  4 Institut de recherche en réadaptation, Suvacare, Switzerland
    5 Institute of Robotics and Mechatronics, DLR (German Aerospace Centre), Germany
1. Introduction: what is electromyography
Electromyography (EMG) is the measurement of electrical activity
that creates muscle contractions


The signal path:

•  Originates in a motor neuron

•  Travels to the target muscle(s)

•  Starts a series of electrochemical changes that leads to an
   action potential

•  Is detected by one or more electrodes


(Jessica Zarndt, The Muscle Physiology of Electromyography, UNLV)   2
1. Introduction: electromyography controlled prosthetics
•    2-3 degrees of freedom
•    Few programmed movements
•    Very coarse force control
•    No dexterous control
•    No natural Control
•    Long training times



In contrast to recent advances in
mechatronics



                                                       3
1. Introduction: sEMG Data Bases



•  NO large scale public sEMG databases, only private ones
  (Fukuda, 2003; Tsuji 1993; Ferguson, 2002; Zecca, 2002; Chan, 2005; Sebelius, 2005;
  Castellini, 2008; Jiang, 2009; Tenore, 2009; Castellini, 2009)


•  NO common sEMG acquisition protocol

•  NO common sEMG storage protocol




                                                                                   4
1. Introduction: project motivations & goals
•  Creation and refinement of the acquisition protocol

•  Acquisition of the database

•  Public release of the database

•  Worldwide test of classification algorithms




  •  Augment dexterity of sEMG prostheses

  •  Reduce training time
                                                         5
2. Database: acquisition setup (1)

         Laptop: Dell Latitude E5520
    !




         Digital Acquisition Card: National Instruments 6023E

         sEMG Electrodes: 10 double-differential Otto Bock 13E200
     !




         Printed Circuit Board, Cables & Connectors
     !




         Data Glove 22 sensors Cyberglove II (Cyberglove Systems)

         Inclinometer: Kübler 8.IS40.2341
                                                                6
2. Database: acquisition setup (2)
1.  8 equally spaced electrodes
2.  2 electrodes on finger flexor and extensor muscles
3.  Two axes inclinometer

4.  Data glove




                                                         7
3. Methods: acquisition procedure
Intact subjects:
•  The subject is asked to repeat what is shown on the screen
   with the right hand.

Amputated subjects:
•  The subject is asked to think to repeat what is shown on the
   screen with both hands.
•  In the meanwhile the subject needs to do the same movement
   with remaining hand.




                                                             8
2. Database: movements
Exercise 1                                                                                                                     Hato, 2004
12 movements       !               !                   !               !                   !               !                   Sebelius, 2005
                                                                                                                               Farrel, 2008
                   !               !                   !               !                   !               !
                                                                                                                               Crawford, 2005
                                                                                                                               Feix, 2008
Exercise 2
17 movements   !               !           !               !               !           !       !               !
                                                                                                                               DASH Score



                   !               !               !                   !




                   !               !               !                   !                   !



Exercise 3
23 movements
                           !                   !                   !               !                   !           !       !                    !




                       !               !                           !           !                       !               !
                                                                                                                                                !



                       !               !                       !               !                   !               !       !
                                                                                                                                            !       9
2. Database: data
Data stored for each subject:
•  One XML file with clinical and experimental information
•  Unprocessed data (sEMG, Cyberglove, Inclinometer, Movie)
•  One preview picture for each exercise
•  One picture of the arm without the acquisition setup
•  One picture of the arm with the acquisition setup on

Subjects:
•  Currently stored: 27 intact subjects
•  To be acquired: ~100 intact subjects
                   ~40 amputated subjects

                                                              10
2. Database: public, with web interface
url: http://ninapro.hevs.ch




                                          11
3. Analysis: evaluation of the acquisition protocol
•  Principal Component Analysis
   data that is easily separable visually will often also be easy to
   classify

•  Classification
   idea of how discriminative the sEMG signals are for
   movements and subjects


•  Groups of subjects: 1, 8, 27 subject


•  Sets of movements: 3, 11, 52 movements


                                                                 12
3. Analysis: preprocessing
1.  Synchronization: linear interpolation of all data at 100Hz
2.  Filtering of sEMG signals: Butterworth, zero-phase, 1Hz,
    second order
3.  Segmenting: each movement (including rest) is divided into
    three equal parts
4.  The data contained in the central segment is averaged for
    each electrode




    1        2                3                 4
                                                                 13
3. Analysis: Principal Component Analysis
Two principal components for each of the nine cases considered

•  Movements are easy to distinguish in cases with few subjects
   and few movements.
•  Overlap increases combining data from multiple subjects
•  Overlap increases increasing the number of movements.




                                                             14
3. Analysis: Quantitative classification performance
Intra-subject classification:
•  Multi-class LS-SVM with RBF kernel is trained for each subject
•  Training: 5 movement repetitions
•  Test: 5 movement repetitions
•  Experiment repeated 25 times with different random splits

Inter-subject classification:
•  Multi-class LS-SVM with RBF kernel is trained for each subject
•  Training: 5 movement repetitions of one subject
•  Test: 5 movement repetitions of each of all the other subjects
•  Experiment repeated 25 times with different random splits

                                                               15
3. Analysis: LS-SVM Results
Intra-subject classification:
•  Errors from 7.5% to 20%
•  High standard deviation (performance variability among
   different subjects)
Inter-subject classification:
•  Only marginally above chance level




                                                            16
5. Conclusions:
Database
•  Acquisition setup: portable, based on scientific research and
   industrial application needs
•  Acquisition protocol: complete and easy to be reproduced
•  Movements: 52, selected from the scientific literature
•  Data: currently 27 intact subjects are stored

Data Analysis & Evaluation
•  PCA: movements are easy to distinguish in cases with few
   movements and few subjects
•  Intra-subject classification: results comparable to those found
   in the literature with the same number of movements
•  Inter-subject classification: classification slightly above chance
   level
                                                                  17
5. Future Work:
•  Establishing a standard benchmark

•  Collecting data from a large number of movements

Add a custom-built force-sensing device to acquire dynamic
finger/hand/wrist data.


•  Collecting data from a large number subjects

Further releases of the database will contain data recorded from a
larger number of subjects.


                                                               18
THANKS FOR THE ATTENTION
Please, cite:
Manfredo Atzori, Arjan Gijsberts, Simone Heynen, Anne-Gabrielle Mittaz
Hager, Olivier Deriaz, Patrick Vand der Smagt, Claudio Castellini, Barbara
Caputo and Henning Müller, Building the NINAPRO Database: A Resource
for the Biorobotics Community, in: Proceedings of the IEEE International
Conference on Biomedical Robotics and Biomechatronics, Rome, 2012

Full publication:
http://publications.hevs.ch/index.php/publications/show/1172


                            For more information:
                    http://www.idiap.ch/project/ninapro/
                            http://ninapro.hevs.ch

                                Contacts:
                         manfredo.atzori@hevs.ch

More Related Content

Similar to Building the NINAPRO Database: A Resource for the Biorobotics Community

Hyperspectral face recognition by texture feature extraction using hybrid wav...
Hyperspectral face recognition by texture feature extraction using hybrid wav...Hyperspectral face recognition by texture feature extraction using hybrid wav...
Hyperspectral face recognition by texture feature extraction using hybrid wav...Dr. Vinayak Bharadi
 
EVOLUTION OF ONTOLOGY-BASED MAPPINGS
EVOLUTION OF ONTOLOGY-BASED MAPPINGSEVOLUTION OF ONTOLOGY-BASED MAPPINGS
EVOLUTION OF ONTOLOGY-BASED MAPPINGSAksw Group
 
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...InsideScientific
 
Too good to be true? How validate your data
Too good to be true? How validate your dataToo good to be true? How validate your data
Too good to be true? How validate your dataAlex Henderson
 
Brain Control Club progress meeting Project: Introduction and Projects
Brain Control Club progress meeting Project: Introduction and ProjectsBrain Control Club progress meeting Project: Introduction and Projects
Brain Control Club progress meeting Project: Introduction and Projectsstephen whitmarsh
 
Clustering Methods with R
Clustering Methods with RClustering Methods with R
Clustering Methods with RAkira Murakami
 
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...huguk
 
Human action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptorHuman action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptorSoma Boubou
 
Neuron Reconstruction and Analysis Workshop
Neuron Reconstruction and Analysis WorkshopNeuron Reconstruction and Analysis Workshop
Neuron Reconstruction and Analysis WorkshopMBF Bioscience
 
กระบวนการเทคโนโลยีสารสนเทศ
กระบวนการเทคโนโลยีสารสนเทศกระบวนการเทคโนโลยีสารสนเทศ
กระบวนการเทคโนโลยีสารสนเทศABELE Snvip
 
OpenRepGrid and Friends
OpenRepGrid and FriendsOpenRepGrid and Friends
OpenRepGrid and FriendsMark Heckmann
 
Clustering Methods with R
Clustering Methods with RClustering Methods with R
Clustering Methods with RAkira Murakami
 
Wits presentation 6_28072015
Wits presentation 6_28072015Wits presentation 6_28072015
Wits presentation 6_28072015Beatrice van Eden
 

Similar to Building the NINAPRO Database: A Resource for the Biorobotics Community (20)

Classification of indoor actions through deep neural networks
Classification of indoor actions through deep neural networksClassification of indoor actions through deep neural networks
Classification of indoor actions through deep neural networks
 
Hyperspectral face recognition by texture feature extraction using hybrid wav...
Hyperspectral face recognition by texture feature extraction using hybrid wav...Hyperspectral face recognition by texture feature extraction using hybrid wav...
Hyperspectral face recognition by texture feature extraction using hybrid wav...
 
PiP Poster PDF
PiP Poster PDFPiP Poster PDF
PiP Poster PDF
 
Bci
BciBci
Bci
 
Bci
BciBci
Bci
 
EVOLUTION OF ONTOLOGY-BASED MAPPINGS
EVOLUTION OF ONTOLOGY-BASED MAPPINGSEVOLUTION OF ONTOLOGY-BASED MAPPINGS
EVOLUTION OF ONTOLOGY-BASED MAPPINGS
 
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
Wireless Recording Technologies for in vivo Electrophysiology in Conscious, F...
 
Too good to be true? How validate your data
Too good to be true? How validate your dataToo good to be true? How validate your data
Too good to be true? How validate your data
 
Brain Control Club progress meeting Project: Introduction and Projects
Brain Control Club progress meeting Project: Introduction and ProjectsBrain Control Club progress meeting Project: Introduction and Projects
Brain Control Club progress meeting Project: Introduction and Projects
 
Smart Room Gesture Control
Smart Room Gesture ControlSmart Room Gesture Control
Smart Room Gesture Control
 
Clustering Methods with R
Clustering Methods with RClustering Methods with R
Clustering Methods with R
 
Cshl minseqe 2013_ouellette
Cshl minseqe 2013_ouelletteCshl minseqe 2013_ouellette
Cshl minseqe 2013_ouellette
 
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
Sean Kandel - Data profiling: Assessing the overall content and quality of a ...
 
Human action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptorHuman action recognition with kinect using a joint motion descriptor
Human action recognition with kinect using a joint motion descriptor
 
Digitizing documents to provide a public spectroscopy database
Digitizing documents to provide a public spectroscopy databaseDigitizing documents to provide a public spectroscopy database
Digitizing documents to provide a public spectroscopy database
 
Neuron Reconstruction and Analysis Workshop
Neuron Reconstruction and Analysis WorkshopNeuron Reconstruction and Analysis Workshop
Neuron Reconstruction and Analysis Workshop
 
กระบวนการเทคโนโลยีสารสนเทศ
กระบวนการเทคโนโลยีสารสนเทศกระบวนการเทคโนโลยีสารสนเทศ
กระบวนการเทคโนโลยีสารสนเทศ
 
OpenRepGrid and Friends
OpenRepGrid and FriendsOpenRepGrid and Friends
OpenRepGrid and Friends
 
Clustering Methods with R
Clustering Methods with RClustering Methods with R
Clustering Methods with R
 
Wits presentation 6_28072015
Wits presentation 6_28072015Wits presentation 6_28072015
Wits presentation 6_28072015
 

More from Institute of Information Systems (HES-SO)

Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...Institute of Information Systems (HES-SO)
 
Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...Institute of Information Systems (HES-SO)
 
Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...Institute of Information Systems (HES-SO)
 
Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...Institute of Information Systems (HES-SO)
 
Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...Institute of Information Systems (HES-SO)
 
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...Institute of Information Systems (HES-SO)
 
Le système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodesLe système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodesInstitute of Information Systems (HES-SO)
 
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...Institute of Information Systems (HES-SO)
 
NOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbainesNOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbainesInstitute of Information Systems (HES-SO)
 

More from Institute of Information Systems (HES-SO) (20)

MIE20232.pptx
MIE20232.pptxMIE20232.pptx
MIE20232.pptx
 
Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...Classification of noisy free-text prostate cancer pathology reports using nat...
Classification of noisy free-text prostate cancer pathology reports using nat...
 
Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...Machine learning assisted citation screening for Systematic Reviews - Anjani ...
Machine learning assisted citation screening for Systematic Reviews - Anjani ...
 
Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...Exploiting biomedical literature to mine out a large multimodal dataset of ra...
Exploiting biomedical literature to mine out a large multimodal dataset of ra...
 
L'IoT dans les usines. Quels avantages ?
L'IoT dans les usines. Quels avantages ?L'IoT dans les usines. Quels avantages ?
L'IoT dans les usines. Quels avantages ?
 
Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...Studying Public Medical Images from Open Access Literature and Social Network...
Studying Public Medical Images from Open Access Literature and Social Network...
 
Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...Risques opérationnels et le système de contrôle interne : les limites d’un te...
Risques opérationnels et le système de contrôle interne : les limites d’un te...
 
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
Le contrôle interne dans les administrations publiques tient-il toutes ses pr...
 
Le système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodesLe système de contrôle interne : Présentation générale, enjeux et méthodes
Le système de contrôle interne : Présentation générale, enjeux et méthodes
 
Crowdsourcing-based Mobile Application for Wheelchair Accessibility
Crowdsourcing-based Mobile Application for Wheelchair AccessibilityCrowdsourcing-based Mobile Application for Wheelchair Accessibility
Crowdsourcing-based Mobile Application for Wheelchair Accessibility
 
Quelle(s) valeur(s) pour le leadership stratégique ?
Quelle(s) valeur(s) pour le leadership stratégique ?Quelle(s) valeur(s) pour le leadership stratégique ?
Quelle(s) valeur(s) pour le leadership stratégique ?
 
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
A 3-D Riesz-Covariance Texture Model for the Prediction of Nodule Recurrence ...
 
Challenges in medical imaging and the VISCERAL model
Challenges in medical imaging and the VISCERAL modelChallenges in medical imaging and the VISCERAL model
Challenges in medical imaging and the VISCERAL model
 
NOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbainesNOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
NOSE: une approche Smart-City pour les zones périphériques et extra-urbaines
 
Medical image analysis and big data evaluation infrastructures
Medical image analysis and big data evaluation infrastructuresMedical image analysis and big data evaluation infrastructures
Medical image analysis and big data evaluation infrastructures
 
Medical image analysis, retrieval and evaluation infrastructures
Medical image analysis, retrieval and evaluation infrastructuresMedical image analysis, retrieval and evaluation infrastructures
Medical image analysis, retrieval and evaluation infrastructures
 
How to detect soft falls on devices
How to detect soft falls on devicesHow to detect soft falls on devices
How to detect soft falls on devices
 
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSISFUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
FUNDAMENTALS OF TEXTURE PROCESSING FOR BIOMEDICAL IMAGE ANALYSIS
 
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLSMOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
MOBILE COLLECTION AND DISSEMINATION OF SENIORS’ SKILLS
 
Enhanced Students Laboratory The GET project
Enhanced Students Laboratory The GET projectEnhanced Students Laboratory The GET project
Enhanced Students Laboratory The GET project
 

Recently uploaded

How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 

Recently uploaded (20)

How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 

Building the NINAPRO Database: A Resource for the Biorobotics Community

  • 1. Building the NINAPRO Database: A Resource for the Biorobotics Community 1Manfredo Atzori, 2Arjan Gijsberts, 3Simone Heynen, 3Anne-Gabrielle Mittaz Hager, 4Olivier Deriaz, 5Patrick van der Smagt, 5Claudio Castellini, 2Barbara Caputo, and 1Henning Müller 1Dept. Business Information Systems, HES-SO Valais, Switzerland 2 Institute de Recherche Idiap, Switzerland 3 Department of Physical Therapy, HES-SO Valais, Switzerland 4 Institut de recherche en réadaptation, Suvacare, Switzerland 5 Institute of Robotics and Mechatronics, DLR (German Aerospace Centre), Germany
  • 2. 1. Introduction: what is electromyography Electromyography (EMG) is the measurement of electrical activity that creates muscle contractions The signal path: •  Originates in a motor neuron •  Travels to the target muscle(s) •  Starts a series of electrochemical changes that leads to an action potential •  Is detected by one or more electrodes (Jessica Zarndt, The Muscle Physiology of Electromyography, UNLV) 2
  • 3. 1. Introduction: electromyography controlled prosthetics •  2-3 degrees of freedom •  Few programmed movements •  Very coarse force control •  No dexterous control •  No natural Control •  Long training times In contrast to recent advances in mechatronics 3
  • 4. 1. Introduction: sEMG Data Bases •  NO large scale public sEMG databases, only private ones (Fukuda, 2003; Tsuji 1993; Ferguson, 2002; Zecca, 2002; Chan, 2005; Sebelius, 2005; Castellini, 2008; Jiang, 2009; Tenore, 2009; Castellini, 2009) •  NO common sEMG acquisition protocol •  NO common sEMG storage protocol 4
  • 5. 1. Introduction: project motivations & goals •  Creation and refinement of the acquisition protocol •  Acquisition of the database •  Public release of the database •  Worldwide test of classification algorithms •  Augment dexterity of sEMG prostheses •  Reduce training time 5
  • 6. 2. Database: acquisition setup (1) Laptop: Dell Latitude E5520 ! Digital Acquisition Card: National Instruments 6023E sEMG Electrodes: 10 double-differential Otto Bock 13E200 ! Printed Circuit Board, Cables & Connectors ! Data Glove 22 sensors Cyberglove II (Cyberglove Systems) Inclinometer: Kübler 8.IS40.2341 6
  • 7. 2. Database: acquisition setup (2) 1.  8 equally spaced electrodes 2.  2 electrodes on finger flexor and extensor muscles 3.  Two axes inclinometer 4.  Data glove 7
  • 8. 3. Methods: acquisition procedure Intact subjects: •  The subject is asked to repeat what is shown on the screen with the right hand. Amputated subjects: •  The subject is asked to think to repeat what is shown on the screen with both hands. •  In the meanwhile the subject needs to do the same movement with remaining hand. 8
  • 9. 2. Database: movements Exercise 1 Hato, 2004 12 movements ! ! ! ! ! ! Sebelius, 2005 Farrel, 2008 ! ! ! ! ! ! Crawford, 2005 Feix, 2008 Exercise 2 17 movements ! ! ! ! ! ! ! ! DASH Score ! ! ! ! ! ! ! ! ! Exercise 3 23 movements ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! 9
  • 10. 2. Database: data Data stored for each subject: •  One XML file with clinical and experimental information •  Unprocessed data (sEMG, Cyberglove, Inclinometer, Movie) •  One preview picture for each exercise •  One picture of the arm without the acquisition setup •  One picture of the arm with the acquisition setup on Subjects: •  Currently stored: 27 intact subjects •  To be acquired: ~100 intact subjects ~40 amputated subjects 10
  • 11. 2. Database: public, with web interface url: http://ninapro.hevs.ch 11
  • 12. 3. Analysis: evaluation of the acquisition protocol •  Principal Component Analysis data that is easily separable visually will often also be easy to classify •  Classification idea of how discriminative the sEMG signals are for movements and subjects •  Groups of subjects: 1, 8, 27 subject •  Sets of movements: 3, 11, 52 movements 12
  • 13. 3. Analysis: preprocessing 1.  Synchronization: linear interpolation of all data at 100Hz 2.  Filtering of sEMG signals: Butterworth, zero-phase, 1Hz, second order 3.  Segmenting: each movement (including rest) is divided into three equal parts 4.  The data contained in the central segment is averaged for each electrode 1 2 3 4 13
  • 14. 3. Analysis: Principal Component Analysis Two principal components for each of the nine cases considered •  Movements are easy to distinguish in cases with few subjects and few movements. •  Overlap increases combining data from multiple subjects •  Overlap increases increasing the number of movements. 14
  • 15. 3. Analysis: Quantitative classification performance Intra-subject classification: •  Multi-class LS-SVM with RBF kernel is trained for each subject •  Training: 5 movement repetitions •  Test: 5 movement repetitions •  Experiment repeated 25 times with different random splits Inter-subject classification: •  Multi-class LS-SVM with RBF kernel is trained for each subject •  Training: 5 movement repetitions of one subject •  Test: 5 movement repetitions of each of all the other subjects •  Experiment repeated 25 times with different random splits 15
  • 16. 3. Analysis: LS-SVM Results Intra-subject classification: •  Errors from 7.5% to 20% •  High standard deviation (performance variability among different subjects) Inter-subject classification: •  Only marginally above chance level 16
  • 17. 5. Conclusions: Database •  Acquisition setup: portable, based on scientific research and industrial application needs •  Acquisition protocol: complete and easy to be reproduced •  Movements: 52, selected from the scientific literature •  Data: currently 27 intact subjects are stored Data Analysis & Evaluation •  PCA: movements are easy to distinguish in cases with few movements and few subjects •  Intra-subject classification: results comparable to those found in the literature with the same number of movements •  Inter-subject classification: classification slightly above chance level 17
  • 18. 5. Future Work: •  Establishing a standard benchmark •  Collecting data from a large number of movements Add a custom-built force-sensing device to acquire dynamic finger/hand/wrist data. •  Collecting data from a large number subjects Further releases of the database will contain data recorded from a larger number of subjects. 18
  • 19. THANKS FOR THE ATTENTION Please, cite: Manfredo Atzori, Arjan Gijsberts, Simone Heynen, Anne-Gabrielle Mittaz Hager, Olivier Deriaz, Patrick Vand der Smagt, Claudio Castellini, Barbara Caputo and Henning Müller, Building the NINAPRO Database: A Resource for the Biorobotics Community, in: Proceedings of the IEEE International Conference on Biomedical Robotics and Biomechatronics, Rome, 2012 Full publication: http://publications.hevs.ch/index.php/publications/show/1172 For more information: http://www.idiap.ch/project/ninapro/ http://ninapro.hevs.ch Contacts: manfredo.atzori@hevs.ch