Gemma 2 AI Challenge

Start

AI-powered learning app to identify unknown objects and learn the names in your desired language

TransPic

Miki Suzuki

Grace C

TransPic is an application designed to help users identify objects in images and translate their names into the language of their choice. Whether you’re exploring a new country, encountering unfamiliar foods, or curious about an unknown object, TransPic provides a seamless solution.

The app combines advanced tools, including Pali Gemma for object detection, and Gemma 2 for translations. Built with an interactive frontend using Streamlit, TransPic is user-friendly and efficient.

Our inspiration stems from the need for visual-context-based language learning and a gap in tools that merge object recognition with language translation. The roadmap includes features like mobile app development and customising the model capabilities in specific use cases such as learning bird and food names. TransPic aims to revolutionise language learning and global communication!

TransPic is an app that bridges language barriers by identifying objects in images and translating their names into the desired language. Leveraging Gemma's vision and translation capabilities, TransPic makes learning languages intuitive.

"TransPic team on Gemma 2 AI Challenge Hackathon"

Team Idea

Submission