PolyGlot Gemini lens for PDFs

Created by team PolyGlot Gemini on December 27, 2023

Problem Statement: 1) Over 70% of PDFs contain critical data in images like charts and tables, especially research articles 2) Gemini is released for English only today. Can we build a solution for 1) Answering natural language questions based on images in PDFs ? 2) Making Gemini accessible for non english speakers? By leveraging Spire, Open AI GPT 3.5, Gemini Pro Vision and Trulens, I have built an application that solves both problems - Spire for Image Extraction - Open AI for Translation to English (optional) - Gemini-Pro-Vision for the answer - TruLens for Monitoring

Category tags:

Productivity, Summarization

Github Presentation Demo

Explore more applications

Lenso

Lenso is an AI-driven platform that redefines photo and video management, making it easy to search memories by keywords or visual similarity. With secure cloud storage, advanced AI analysis, and intuitive search.

Code Crusaders

Generative AI Studio

VIsionAid

VisionAid is a medical assistant app for the visually impaired uses voice commands to interpret medical images and prescriptions, offering hands-free insights and voice-guided responses for easy, accessible healthcare.

TrioVibians

VercelRhymes.ai

PrepAlly

PrepAlly, ur AI-powered coding prep platform, offering real-time feedback, voice-guided insights, and secure, interactive practice. Open-Source and innovative, it transforms stress into confidence and elevates your interview game-prep smarter, ace faster.

Open Community

GPT-4 Visiono1ElevenLabsVercelChatGPTRhymes.ai

Pulse and Prism

Pulse & Prism is an AI-powered content creation platform that transforms text into multimedia content. It can generate poetry, convert text to speech, and combine them into complete poetry videos with synchronized audio.

BTAJI Crew

streamlitOpenAIRhymes.ai

RobotSight

RobotSight is an Aria-backed visual analysis assistant that can help a cleaning robot distinguish dirty items and garbage inside a hotel room.

RobotSight

streamlit

Raghavan Muthuregunathan
Senior Engineering Manager

"Great use of Gemini to make PDFs and images more accessible + use of trulens to make sure it's safe. Areas of improvement: - A narrower use case can often be more impactful than a general one, and bring a lot of value! Focus on selling to your first customers, not the whole market. - It would have been nice to see evaluations that validated the core capabilities of the app in addition to the harmlessness evaluations you completed."