SignSpeak AI Real-Time AI Sign Language Translator

SignSpeak AI is an AI-powered mobile application that helps bridge the communication gap between hearing individuals and the deaf community through real-time sign language translation. The application captures spoken Indonesian, converts it into text, and sends it to Fireworks AI (GPT-OSS-120B) for contextual understanding. Instead of translating word by word, the AI identifies the intended meaning of the sentence and extracts the most appropriate BISINDO/SIBI sign language gestures. The extracted gestures are mapped to corresponding sign language videos stored in Supabase Storage. The application retrieves the public URLs of these videos and plays them sequentially using a custom video player, creating a smooth and continuous sign language translation. This cloud-based approach keeps the application lightweight while making it easy to expand the gesture library without updating the app. Our AI Pipeline coordinates every stage of the process, from speech recognition and AI reasoning to gesture mapping and video playback, enabling fast and efficient real-time communication. By combining speech recognition, Fireworks AI, Flutter, and Supabase, SignSpeak AI provides a scalable and accessible solution that makes everyday conversations more inclusive for the deaf community.