PolyGlot Gemini lens for PDFs

Created by team PolyGlot Gemini on December 27, 2023

Problem Statement: 1) Over 70% of PDFs contain critical data in images like charts and tables, especially research articles 2) Gemini is released for English only today. Can we build a solution for 1) Answering natural language questions based on images in PDFs ? 2) Making Gemini accessible for non english speakers? By leveraging Spire, Open AI GPT 3.5, Gemini Pro Vision and Trulens, I have built an application that solves both problems - Spire for Image Extraction - Open AI for Translation to English (optional) - Gemini-Pro-Vision for the answer - TruLens for Monitoring

Category tags:

Productivity, Summarization

Github Presentation Demo

Explore more applications

GovGiggler - A Smart Government Assistant

GovGiggler is an AI-powered assistant transforming interactions with government services. It simplifies processes with smart document assistance, secure authentication, dynamic updates, and humorous chat support—making bureaucracy effort.

Hacktivate

Grok

AI-Driven Autonomous Web Interaction for Citizens

We propose a Gen AI-powered platform using Grok models to simplify navigation and automate tasks on government websites. This empowers citizens to access services independently, reducing reliance on personnel and enhancing accessibility.

NavigatorX

GroqGrok

citizen-connect

The Government Efficiency Analyzer evaluates and optimizes the performance of government projects, ensuring efficient resource allocation, timely delivery, and measurable outcomes to enhance public services.

tml

Generative Agents

Healytastic One Nation One Data Platform

Healytastic is an AI-powered platform that validates and manages government data efficiently. Using Grok, Python, Streamlit, and Firebase (demo tech stack), it automates anomaly detection, deduplication, compliance checks for government systems.

Ueberanalyse

GrokstreamlitAI/ML API

GRUF

GRUF is more than an app—it’s a movement to grow communities, one garden at a time. Join us in this mission to empower urban food production

GRUF

GrokVercel

Raghavan Muthuregunathan
Senior Engineering Manager

"Great use of Gemini to make PDFs and images more accessible + use of trulens to make sure it's safe. Areas of improvement: - A narrower use case can often be more impactful than a general one, and bring a lot of value! Focus on selling to your first customers, not the whole market. - It would have been nice to see evaluations that validated the core capabilities of the app in addition to the harmlessness evaluations you completed."