Expense Bot

This project uses a fine-tuned PalliGemma based on a dataset(https://universe.roboflow.com/elh-datasets/receipt-ebx3a) labelled with Gemini-Pro-1.5 to extract receipts data as JSON. We this JSON data as input to our Twilio and WhatsApp bot that allows us to send images of receipts as messages via whatsapp, which get extracted and stored and organized as a spreadsheet leveraging the Google Drive API. The project is to automate bookkeeping. This project uses a fine-tuned PalliGemma based on a dataset(https://universe.roboflow.com/elh-datasets/receipt-ebx3a) labelled with Gemini-Pro-1.5 to extract receipts data as JSON. We this JSON data as input to our Twilio and WhatsApp bot that allows us to send images of receipts as messages via whatsapp, which get extracted and stored and organized as a spreadsheet leveraging the Google Drive API. The project is to automate bookkeeping.