This paper introduces a complete work-flow for the translation of dynamic isolated signs based on data acquired from a data-glove. A sign language translation system based on a wearable device represents indeed a more efficient solution with respect to cameras or position trackers for helping speech-impaired people on a daily basis. The paper describes the different steps required for a sign language translation, namely segmentation, feature extraction and classification, together with the custom data-glove used for data-acquisition. The paper presents also experimental results, comparing different machine learning classifiers and discussing their performances both in terms of translation accuracy and computational time. The proposed work-flow has been tested both on data acquired from a custom data-glove and on a public database, and it outperforms those of other works in literature. The reported analysis suggests a multi-layer perceptron neural network as the most suitable classifier for the realization of a wearable sign language translation system.

Recognition and Classification of Dynamic Hand Gestures by a Wearable Data-Glove

Pezzuoli, Francesco;Corona, Dario
;
Corradini, Maria Letizia
2020-01-01

Abstract

This paper introduces a complete work-flow for the translation of dynamic isolated signs based on data acquired from a data-glove. A sign language translation system based on a wearable device represents indeed a more efficient solution with respect to cameras or position trackers for helping speech-impaired people on a daily basis. The paper describes the different steps required for a sign language translation, namely segmentation, feature extraction and classification, together with the custom data-glove used for data-acquisition. The paper presents also experimental results, comparing different machine learning classifiers and discussing their performances both in terms of translation accuracy and computational time. The proposed work-flow has been tested both on data acquired from a custom data-glove and on a public database, and it outperforms those of other works in literature. The reported analysis suggests a multi-layer perceptron neural network as the most suitable classifier for the realization of a wearable sign language translation system.
2020
File in questo prodotto:
File Dimensione Formato  
2021-Pezzuoli-SNComputerScience.pdf

solo gestori di archivio

Tipologia: Versione Editoriale
Licenza: Non specificato
Dimensione 1.39 MB
Formato Adobe PDF
1.39 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11581/468194
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 15
  • ???jsp.display-item.citation.isi??? ND
social impact