Zur Hauptnavigation wechseln Zur Suche wechseln Zum Hauptinhalt wechseln

Machine Learning-Based Gesture Recognition Glove: Design and Implementation

Anna Filipowska, Wojciech Filipowski, Paweł Raif, Marcin Pieniążek, Julia Bodak, Piotr Ferst, Kamil Pilarski, Szymon Sieciński*, Rafal Jan Doniec, Julia Mieszczanin, Emilia Skwarek, Katarzyna Bryzik, Maciej Henkel, Marcin Grzegorzek*

*Korrespondierende/r Autor/-in für diese Arbeit

Abstract

In the evolving field of human–computer interaction (HCI), gesture recognition has emerged as a critical focus, with smart gloves equipped with sensors playing one of the most important roles. Despite the significance of dynamic gesture recognition, most research on data gloves has concentrated on static gestures, with only a small percentage addressing dynamic gestures or both. This study explores the development of a low-cost smart glove prototype designed to capture and classify dynamic hand gestures for game control and presents a prototype of data gloves equipped with five flex sensors, five force sensors, and one inertial measurement unit (IMU) sensor. To classify dynamic gestures, we developed a neural network-based classifier, utilizing a convolutional neural network (CNN) with three two-dimensional convolutional layers and rectified linear unit (ReLU) activation where its accuracy was 90%. The developed glove effectively captures dynamic gestures for game control, achieving high classification accuracy, precision, and recall, as evidenced by the confusion matrix and training metrics. Despite limitations in the number of gestures and participants, the solution offers a cost-effective and accurate approach to gesture recognition, with potential applications in VR/AR environments.
OriginalspracheEnglisch
Aufsatznummer18
ZeitschriftSensors (Basel, Switzerland)
Jahrgang24
Ausgabenummer18
Seiten (von - bis)6157
Seitenumfang1
ISSN1424-8220
DOIs
PublikationsstatusVeröffentlicht - 23.09.2024

Fördermittel

This research was funded by the Silesian University of Technology under \u201CInvolving students in scientific research through student research clubs and project-oriented teaching\u201D, in connection with the participation of the Silesian University of Technology in the \u201CExcellence Initiative\u2014Research University\u201D program, grant number 31/010/SDU20/0006-10.

TrägerTrägernummer
Silesian University of Technology31/010/SDU20/0006-10

    UN SDGs

    Dieser Output leistet einen Beitrag zu folgendem(n) Ziel(en) für nachhaltige Entwicklung

    1. SDG 3 – Gesundheit und Wohlergehen
      SDG 3 – Gesundheit und Wohlergehen
    2. SDG 9 – Industrie, Innovation und Infrastruktur
      SDG 9 – Industrie, Innovation und Infrastruktur

    Strategische Forschungsbereiche und Zentren

    • Forschungsschwerpunkt: Biomedizintechnik
    • Zentren: Zentrum für Künstliche Intelligenz Lübeck (ZKIL)

    DFG-Fachsystematik

    • 2.22-07 Medizininformatik und medizinische Bioinformatik
    • 4.43-04 Künstliche Intelligenz und Maschinelles Lernverfahren

    Fingerprint

    Untersuchen Sie die Forschungsthemen von „Machine Learning-Based Gesture Recognition Glove: Design and Implementation“. Zusammen bilden sie einen einzigartigen Fingerprint.

    Zitieren