Telegram Bot that use Gemini and Langchain to answer question about a Product Inventory of an E-Commerce application name Shoppu.
The Bot connects to Shoppu products API and use its information to interact with clients.
The Tech stack used to build this project was Telegram Bot API, Gemini, Langchain, Trulens (It was implemented, but didn't work because from the team location Vertex AI is not available) and Shoppu API.
Right now the this bot is the beginning to create a tool that can support and assists during the purchase process small business' clients, also it is a great solution for one person business that need to delegate client support task, but does not have the resources to hire more personnel

Gemini AI Hackathon

Creating an ECommerce Genie that will make shopping experience more human and fun.


ShoppuChat

Gemini AI

Google

TruLens

TruEra

Cricket VIDEO ANALYZER to understand a batsman using 12 labs API +llama index + GPT 4

Solution:
Choose 1 batsman (Glenn Maxwell of Australia)
(Source 1) : Use 12 labs API to understand their playing style - 
Understand the video
Generate the text
(Source 2 for additional augmentation) : Use cricinfo.com APIs to get ball by ball commentary of the batsman 
Build a vector store of the dataset built using (2) and (3)
Use GPT-4 to answer questions on this dataset (RAG application)

Global Popularity and Demand:
The immense popularity of cricket has led to a high demand for video analysis tools.
Coaches, players, and teams use these tools to analyze player performance, match strategies, and opponent weaknesses. The ability to break down every aspect of a game, from batting techniques to bowling actions, has become crucial for success.
As cricket leagues (such as the Indian Premier League) and international tournaments continue to grow, the demand for sophisticated video analysis software has skyrocketed.
Advanced Technology and Data Insights:
Cricket video analysis tools have evolved significantly over the years. High-speed cameras, ball-tracking systems, and AI algorithms allow for precise analysis of player movements, ball trajectories, and field placements.
Coaches can identify patterns, assess player fitness, and make data-driven decisions. For example, analyzing a batsman’s scoring zones or a bowler’s release point can provide valuable insights.


Developed a cricket video analyzer to understand the strengths and weakness of a batter (batsman) in the game of cricket

Cricket

Twelve Labs is a platform that harnesses the power of AI to revolutionize video understanding.

Twelve Labs

LlamaIndex connects data sources to large language models, providing tools to ingest, index, and query data for building powerful AI apps augmented by your knowledge.

LlamaIndex

Explore the groundbreaking GPT-4 Vision, empowering AI to understand and process images, revolutionizing capabilities across diverse domains.

GPT-4 Vision

OpenAI is an AI research and deployment company

OpenAI

Cricket Video Analyzer - 12 labs RAG

The education sector is ripe for innovation, with technology playing an increasingly vital role in modern teaching methods. However, many existing tools focus solely on content delivery and/or content generation, overlooking the crucial aspect of personalized feedback and improvement. TeachWise is a demo that showcases how AI can be utilized such that students and educators can receive targeted suggestions and enhancements for their teaching techniques and delivery style. By harnessing the power of Twelve Labs, TeachWise aims to open the door for more possible usage of AI in the teaching sector.

Have you ever wished for a smarter way to improve your teaching skills? Meet TeachWise, a demo designed to help you do just that.

Stroll

TeachWise

Introducing RAGfier: An AI-powered communication tool that seamlessly translates sign language gestures into spoken language and vice versa, empowering sign language users to communicate effortlessly across various platforms. With text-to-sign language translation and real-time feedback, RAGfier revolutionises inclusivity, fostering accessible communication in healthcare, education, and daily interactions.

RAGfier is an AI-powered communication tool that utilizes real-time sign language translation to bridge the gap between sign language users and the hearing world.
 - Real-time sign language translation: RAGfier converts sign language gestures into spoken language
and vice versa, facilitating seamless communication between sign language users and hearing
individuals.
 - Text-to-sign language translation: RAGfier can translate written text into sign language, making it
easier for sign language users to access information and engage with digital content.
 - Sign language recognition and feedback: RAGfier provides feedback to sign language users,
helping them improve their signing accuracy and fluency.

Bridging the Gap Between the Hearing Impaired and the Hearing World - AI-Powered

RAGfier

Empower your AI projects with TruLens, a suite of tools for developing and evaluating large language models.

Enabling trust in AI models with TruEra's quality solutions.

A powerful and flexible document-based NoSQL database that has gained popularity among developers.

MongoDB

Vercel is a platform designed for developers, providing speed, reliability, and scalability to create and deploy web applications. With built-in CI/CD, zero configuration, and deep integrations with popular Git providers such as GitHub, GitLab, and Bitbucket, Vercel streamlines the development process, making it easy for teams to collaborate and iterate on their projects.

Vercel

RAGfier 

Chessboxing is the ultimate blend of brains and brawn, where competitors juggle checkmates and uppercuts in an alternating series of blitz chess and boxing rounds. This unique sport requires participants to strategize on the chessboard before immediately defending themselves in the ring. Chessboxing demands quick wits and a solid right hook, creating an unpredictable competition where a sudden shift in gears can make or break a player.

Enter video AI, the game-changer that can take chessboxing to the next level. By analyzing matches frame by frame, AI provides critical insights into both mental strategies and physical techniques. Athletes can improve by targeting specific weaknesses, like rook gambits and jabs, to outsmart their opponents.

Beyond player improvement, AI ensures fair play by catching fouls or rule breaches that may go unnoticed in the heat of the moment. It gives referees the tools to make objective calls, providing instant replays and analysis that uphold the integrity of the sport.

For fans, video AI brings new excitement by breaking down each match, allowing viewers to appreciate the combination of strategic brilliance and boxing intensity. Real-time stats and analysis deepen understanding, making chessboxing even more thrilling and potentially drawing a wider audience.

Use Twelvelabs video understanding to explain the frankly confusing sport of ChessBoxing - an athletic competition that exists and is totally amazing. 

State Change Labs

ChatGPT is a large language model trained by OpenAI to generate human-like text in a conversational style. It is a variant of the GPT-3 model, which was specifically designed to be used to generate text in response to user input. The ChatGPT model has been trained on a vast amount of text data, including conversations and other types of human-generated text, which allows it to generate text that is similar in style and content to human conversation. ChatGPT can be used to generate responses to questions, code, make suggestions, or provide information in a conversational manner, and it is able to do so in a way that is often indistinguishable from human-generated text. The initial model has been trained using Reinforcement Learning from Human Feedback (RLHF), using methods similar to InstructGPT, but with slight differences in the data collection setup. The model is trained using supervised fine-tuning, where human AI trainers provided conversations in which they played both sides—the user and an AI assistant. The trainers would have had access to model-written suggestions to help them compose their responses.

ChatGPT

Grandmaster Gladiators - ChessBoxing AI Insights

Here's how it could work:

Personalized Training Programs: Athletes can upload videos of their training sessions or games to the app. Twelve Labs' models would analyze these videos to provide personalized feedback and training programs tailored to each athlete's strengths, weaknesses, and goals. This could include technique improvement suggestions, strategies for game situations, and fitness training recommendations.
Game Analysis: Coaches and players could use the app to analyze game footage in detail. The models could automatically detect key moments in the game, such as goals, turnovers, or important plays, and provide insights into what happened during those moments. This could help teams identify patterns, adjust strategies, and improve performance.
Scouting and Recruitment: Scouts and recruiters could use the app to discover talented athletes from around the world. The models could analyze highlight reels and match footage to identify promising players based on their skills and performance metrics. This could streamline the scouting process and help teams find the perfect fit for their roster.
Fan Engagement: The app could also enhance the fan experience by providing interactive features during live games. Fans could use their smartphones to capture moments from the game and receive instant analysis and commentary from Twelve Labs' models. This could make watching sports more engaging and educational for fans of all ages.
Overall, "Athlete Insight" could transform the way athletes train, coaches strategize, scouts recruit, and fans engage with sports, thanks to Twelve Labs' cutting-edge technology in video understanding.

This app could revolutionize sports training and analysis by leveraging Twelve Labs' multimodal foundation models for video understanding

The MAT

Empower your projects with customizable language models, prompt precision, and extensive tool integration through OpenGPTs by LangChain.

OpenGPTs

Large language models (LLMs) have transformed the way we approach machine learning and artificial intelligence. These models are incredibly powerful, but their true potential lies in their ability to work in harmony with other sources of data and computation. This library has been developed to assist developers in building applications that combine LLMs with other technologies, allowing them to create truly intelligent and innovative products.