Empowering deaf communication: a novel LSTM model for recognizing Indonesian sign language

Caraka, Rezzy Eko and Supardi, Khairunnisa and Kurniawan, Robert and Kim, Yunho and Gio, Prana Ugiana and Yuniarto, Budi and Mubarok, Faiq Zakki and Pardamean, Bens (2025) Empowering deaf communication: a novel LSTM model for recognizing Indonesian sign language. Universal Access in the Information Society, 24 (1). pp. 771-783. ISSN 1615-5289

Full text not available from this repository. (Request a copy)

Abstract

Sign language plays a pivotal role in facilitating communication for the deaf community, bridging the gap with the broader society. Nevertheless, mastering sign language poses significant challenges due to the intricate nuances of body movements, hand gestures, and facial expressions. Sign language recognition technology is a pivotal solution aimed at enabling clear communication between deaf individuals and the wider community, thereby reducing the risk of miscommunication. This study introduces an innovative approach to address these challenges. We focus on the recognition of Indonesian Sign Language using a skeleton-based method, harnessing the capabilities of MediaPipe to extract critical hand and pose key points from sign language videos. The core of our approach involves the implementation of a long short-term memory (LSTM) model, which has showcased exceptional promise in accurately interpreting BISINDO. The proposed LSTM architecture excels with a remarkable validation accuracy of 92.857%, surpassing the accuracy and computational efficiency of previously proposed LSTM models. This significant advancement in technology propels us closer to bridging the communication gap between the deaf community and the broader population.

Item Type: Article
Uncontrolled Keywords: Long short-term memory; Sign language; BISINDO; MediaPipe; Gesture recognition
Subjects: Communication
Language
Depositing User: Saepul Mulyana
Date Deposited: 03 Sep 2026 07:43
Last Modified: 03 Sep 2026 07:43
URI: https://karya.brin.go.id/id/eprint/59894

Actions (login required)

View Item
View Item