Sign Language Augmented Reality Real-time Animation (SLARA)

Cairo University

Mahmoud Hamza, Alaa Abdelsalam, Nourhan Abdallah, Yasmin Emad

Deaf and Mute people are facing difficulties in their daily activities in different life aspects. Recent studies have shown that more than 360 million patients worldwide are deaf or dumb, In Egypt, there are more than 7.5 million people unable to have normal life, because only few people can communicate with them through sign language.
Therefore, SLARA translator mobile application offers a solution that provides them a simple way to communicate with the others. The application is acting as not only the user’s ear to hear the others but also his voice that is heard by them.
The application has 2 modes, the first one is the listening mode in which the voice of surrounding people will be detected by a microphone after then this voice will be translated into sign language expressions that are displayed on the Vufine glasses by our avatar SLARA.
the other mode is the speaking one in which the sign language movements will be detected by a camera attached to the glasses then these movements are processed to get the corresponding speech that will be heard by the mobile’s speakers. Our project has several unique features, one of them is that your mobile phone will be the user’s ear and mouth with the help of augmented reality technology to keep the communication as fast and smooth as possible. The second one is that SLARA is almost available everywhere. While the last one is that SLARA translator is the only application that supports Arabic language.

RESNA Design Brief

 

Powered by WordPress. Designed by WooThemes

Skip to toolbar