Gemini AI Hackathon

Hackathon Kick-Off 

We'll onboard you in the Gemini AI technology, newly released by Deep Mind, with Fabian Stehle, Data Scientist at New Native.

Introduction to Gemini AI

Join for the tech session with Shayak Sen, CTO of TruEra. We'll dive deeper in integration of TruLense into Gemini AI-based application.  

Tech Workshop with TruEra

Join experts Shayak from TruEra and Jerry Liu from LlamaIndex as they delve into the world of multimodal AI applications.

Building and Evaluating Multimodal GenAI Apps: RAG Triad is All you Need

Q&A Session with lablab.ai mentors on Discord

Submissions Deadline

Utilizing Gemini AI to empower the visually impaired by means of Mobile App Accessibility

Louis Jefferson Zhang

In my country, there exists an inequality affecting visually impaired individuals who lack access to essential accessibility services. This has driven me to create a mobile app that can harness the power of AI to offer a transformative solution. By enabling the visually impaired to understand the world around them, this app directly aligns with two crucial United Nations Sustainable Development Goals (UNSDGs): Goal 3 - "Good Health and Well-being," and Goal 10 - "Reduced Inequalities."

The app is constructed using the Flutter framework for the frontend, while the backend relies on Google AI Studio's Gemini Pro-Vision Model, accompanied with continuous Trulens Evaluation of LLM performance in Gemini-Lens' Hosted Fast-API server on Google Cloud Run Service.

The app has a very simple user interface: a camera preview and a mic button for them to speak up, then the query transcribed, along with the image captured will be processed and the response will be spoken back to blind users. 

Utilizing Gemini AI to empower the visually impaired by means of Mobile App Accessibility, with continuous LLM evaluation by Trulens

"LJZ team on Gemini AI Hackathon Hackathon"

Team Idea

Submission