BrailleFly VLM-Powered Navigation for the Blinds

BrailleFly revolutionizes accessibility with AI-powered smart glasses, designed for blind and visually impaired individuals. While the core product ensures safety with offline capabilities like obstacle detection and facial recognition, we are testing advanced Visual Language Model (VLM) functionalities during this hackathon. Leveraging VLM (e.g., Llama 3.2), our glasses provide real-time obstacle recognition and enhanced navigation features, transforming the way users interact with their surroundings. This testbed explores VLM’s potential to deliver scene understanding and seamless waypoint navigation via intuitive gestures and voice commands. By balancing cutting-edge offline safety functions with online features, BrailleFly creates an inclusive and adaptive experience for users worldwide.