Android-based Indonesian Sign Language Model Using Robot Hand
Taryudi(*), Pitoyo Yuliatmojo, Muhammad Angga Paripurna
Faculty of Engineering, Universitas Negeri Jakarta
Jakarta, Indonesia
Email: (*)taryudi[at]unj.ac.id
Abstract
Sign language is one of the most effective ways to communicate with deaf people. However, not everyone is able to use sign language. Therefore in this study, a sign language display system was created using a hand robot that was moved through an Android-based application on a smartphone to overcome this problem. The design and development of the system begin from the manufacture of hardware consisting of one hand robot with 11 servo motors as the actuators, the Arduino Mega 2560 microcontroller as the main controller and a Bluetooth module for wireless communication between hand robot and smartphone. Then software development is carried out on the hand robot controller and android based application on a smartphone. Furthermore, system testing is carried out by validating the results of the letters and numbers shown by hand robot with gestures in the Indonesian Language Signaling System Dictionary (SIBI). The results show that the hand robot has been able to display letters and numbers according to the instructions given by an Android-based application on a smartphone with an 80% accuracy rate.
Keywords: Robot hand, Indonesian sign language, Arduino, Android
Topic: Electronics Engineering