Sign Language Analysis and Recognition to Aid Specially Abled Communicators

Abstract

Most people are capable to interact with each other through verbal communication methods such as speech, with the help of different languages developed across time. But all humans are not gifted equally to communicate with the aforementioned technique. These specially abled communicators who lack the ability to hear and speak are commonly called deaf and dumb respectively by the society. These specially abled communicators interact with the help of ‘sign language’. Sign Language is defined as a manual communication method to interact, as opposed to traditional speech. This method involves simultaneous movements and orientation of hands, arms or body. In this project, a real time integrated solution of hardware and software is developed to help the specially abled people all across the globe to support the communication and interaction of such individuals, thus fostering their independence. We aim to develop a sign glove, an interdependent glove for these special communicators in the event they have to communicate with general population who might not be aware of their sign language semantics. The advantages of automaticity of this project are that it is a hand-held user interdependent device, it uses flex sensors to detect movement of figures and 3 axis accelerometer and gyroscope to decode movement of the hand. The device is programmed in such a way that it recognizes defined gestures which are pre saved in the data base in accordance to American Sign Language. In view of this, aforementioned system is a source of developing a product which is affordable and easy to be used for such people who are specially abled, which helps in lessening the communication gap between specially abled and general population. The glove can be worn on the right hand that uses a specially designed algorithm to translate sign language into spoken English.