Lokesh Badisa@hsekol

TalkTriUnity is aimed at breaking down the barriers for disabled people to access virtual assistants seamlessly. We used GPT-4-Turbo, Whisper, Clarifai's Text to Speech models for our submission. Whisper for Speech to text and GPT4 Turbo to generate answers. Currently it supports only letter by letter sign language translation but our aim to support gesture based translation as well. Further, in future we also want to have the facility of Text to Sign Language translation. For the sign language translation we utilized the open source code available at https://github.com/emnikhil/Sign-Language-To-Text-Conversion/tree/main. The interface is user friendly enabling virtual assistants to be more inclusive and accessible.