Communication is often difficult for hearing-impaired people because their sign language is only understood by a few ordinary people. On the contrary, the spoken language is difficult to understand due to their hearing impairment. The traditional method of converting speech into written form, similar to the online chat method, was developed to overcome this situation, but is not effective and efficient. Some researchers have long worked with experts to bridge the gap in sign language communication. However, the results are usually very expensive, ineffective and tend to communicate in one direction. The aim of this project was to help hearing impaired people communicate effectively with ordinary people simply by using their sign language. Using Microsoft Kinect technology, hearing impaired people only have to stand in front of the Kinect camera and start communicating their message in sign language. The Kinect Sign Language should translate sign language into written and spoken languages. Conversely, ordinary people can respond directly with their common spoken language, which is easily translated into a written language, along with their animated 3D sign language gestures.
Zico Pratama Putra
Zico Pratama Putra, M.Sc. is an active engineering practitioner and also an IT book writer. After graduating from Institute of Technology Bandung (ITB) in Aerospace Engineering, he spent years working as an IT consultant and telecommunications. In 2011, he continued his Master studies to Germany in the Rhein-Waal University of Applied Sciences.
Number of Pages:
LAP LAMBERT Academic Publishing
Human Computer Interaction, Natural User Interface, Speech recognition, 3D Animation, Sign Language
COMPUTERS / General