Unlock the future of video understanding with Twelve Labs!

🕒 48 hours to complete the challenge
💡 Create revolutionary sport apps with Twelve Labs' text-to-video synthesis!
🤝 Take part alone or form a team with other participants
🚀 The final project can be used for your portfolio, and the startup application to the Slingshot accelerator
🏆 Win up to 50 hours of Twelve Labs video credits to develop further!

Twelve Labs Weekend Hackathon

We dream of Science, Wonder by Technology, and Realize by Data and AI

Hadox Human Networks

ekaropolus_master

MotionMinds

Jatin Kshatriya

Crest_Arborb9tj

Deleted User

🌟Building Multimodal Retrieval To Improve Business Operations Performance 🌟

Team Tonic

Tonic

Isayah Culbertson

FlyinEye

Eden_Blitz49su

Arcane_Etherealxhew

javaria_s

Introducing the Innovation of Sports Here to Tackle the major issues

Game Time Genius

unais

Start

Hackathon Guide and Lablab Platform Walk-through

Opening Words by Twelve Labs

Q&A on Discord 

Submissions Deadline

About Twelve Labs

Hackathon Challenge

Rules

Prizes

What's Exciting about Twelve Labs?

Which Apps Go Best with Twelve Labs?

Who Should Join?

The Community Can Judge!

Unlock the future of video understanding with Twelve Labs!🔥

Cricket VIDEO ANALYZER to understand a batsman using 12 labs API +llama index + GPT 4

Solution:
Choose 1 batsman (Glenn Maxwell of Australia)
(Source 1) : Use 12 labs API to understand their playing style - 
Understand the video
Generate the text
(Source 2 for additional augmentation) : Use cricinfo.com APIs to get ball by ball commentary of the batsman 
Build a vector store of the dataset built using (2) and (3)
Use GPT-4 to answer questions on this dataset (RAG application)

Global Popularity and Demand:
The immense popularity of cricket has led to a high demand for video analysis tools.
Coaches, players, and teams use these tools to analyze player performance, match strategies, and opponent weaknesses. The ability to break down every aspect of a game, from batting techniques to bowling actions, has become crucial for success.
As cricket leagues (such as the Indian Premier League) and international tournaments continue to grow, the demand for sophisticated video analysis software has skyrocketed.
Advanced Technology and Data Insights:
Cricket video analysis tools have evolved significantly over the years. High-speed cameras, ball-tracking systems, and AI algorithms allow for precise analysis of player movements, ball trajectories, and field placements.
Coaches can identify patterns, assess player fitness, and make data-driven decisions. For example, analyzing a batsman’s scoring zones or a bowler’s release point can provide valuable insights.


Developed a cricket video analyzer to understand the strengths and weakness of a batter (batsman) in the game of cricket

Cricket

Raghavan

Twelve Labs is a platform that harnesses the power of AI to revolutionize video understanding.

Twelve Labs

LlamaIndex connects data sources to large language models, providing tools to ingest, index, and query data for building powerful AI apps augmented by your knowledge.

LlamaIndex

Explore the groundbreaking GPT-4 Vision, empowering AI to understand and process images, revolutionizing capabilities across diverse domains.

GPT-4 Vision

OpenAI is an AI research and deployment company

OpenAI

Cricket Video Analyzer - 12 labs RAG

The education sector is ripe for innovation, with technology playing an increasingly vital role in modern teaching methods. However, many existing tools focus solely on content delivery and/or content generation, overlooking the crucial aspect of personalized feedback and improvement. TeachWise is a demo that showcases how AI can be utilized such that students and educators can receive targeted suggestions and enhancements for their teaching techniques and delivery style. By harnessing the power of Twelve Labs, TeachWise aims to open the door for more possible usage of AI in the teaching sector.

Have you ever wished for a smarter way to improve your teaching skills? Meet TeachWise, a demo designed to help you do just that.

Stroll

AliRaza

TeachWise

Chessboxing is the ultimate blend of brains and brawn, where competitors juggle checkmates and uppercuts in an alternating series of blitz chess and boxing rounds. This unique sport requires participants to strategize on the chessboard before immediately defending themselves in the ring. Chessboxing demands quick wits and a solid right hook, creating an unpredictable competition where a sudden shift in gears can make or break a player.

Enter video AI, the game-changer that can take chessboxing to the next level. By analyzing matches frame by frame, AI provides critical insights into both mental strategies and physical techniques. Athletes can improve by targeting specific weaknesses, like rook gambits and jabs, to outsmart their opponents.

Beyond player improvement, AI ensures fair play by catching fouls or rule breaches that may go unnoticed in the heat of the moment. It gives referees the tools to make objective calls, providing instant replays and analysis that uphold the integrity of the sport.

For fans, video AI brings new excitement by breaking down each match, allowing viewers to appreciate the combination of strategic brilliance and boxing intensity. Real-time stats and analysis deepen understanding, making chessboxing even more thrilling and potentially drawing a wider audience.

Use Twelvelabs video understanding to explain the frankly confusing sport of ChessBoxing - an athletic competition that exists and is totally amazing. 

State Change Labs

Ray Deck

Akshay Rakheja

ChatGPT is a large language model trained by OpenAI to generate human-like text in a conversational style. It is a variant of the GPT-3 model, which was specifically designed to be used to generate text in response to user input. The ChatGPT model has been trained on a vast amount of text data, including conversations and other types of human-generated text, which allows it to generate text that is similar in style and content to human conversation. ChatGPT can be used to generate responses to questions, code, make suggestions, or provide information in a conversational manner, and it is able to do so in a way that is often indistinguishable from human-generated text. The initial model has been trained using Reinforcement Learning from Human Feedback (RLHF), using methods similar to InstructGPT, but with slight differences in the data collection setup. The model is trained using supervised fine-tuning, where human AI trainers provided conversations in which they played both sides—the user and an AI assistant. The trainers would have had access to model-written suggestions to help them compose their responses.

ChatGPT

Grandmaster Gladiators - ChessBoxing AI Insights

Here's how it could work:

Personalized Training Programs: Athletes can upload videos of their training sessions or games to the app. Twelve Labs' models would analyze these videos to provide personalized feedback and training programs tailored to each athlete's strengths, weaknesses, and goals. This could include technique improvement suggestions, strategies for game situations, and fitness training recommendations.
Game Analysis: Coaches and players could use the app to analyze game footage in detail. The models could automatically detect key moments in the game, such as goals, turnovers, or important plays, and provide insights into what happened during those moments. This could help teams identify patterns, adjust strategies, and improve performance.
Scouting and Recruitment: Scouts and recruiters could use the app to discover talented athletes from around the world. The models could analyze highlight reels and match footage to identify promising players based on their skills and performance metrics. This could streamline the scouting process and help teams find the perfect fit for their roster.
Fan Engagement: The app could also enhance the fan experience by providing interactive features during live games. Fans could use their smartphones to capture moments from the game and receive instant analysis and commentary from Twelve Labs' models. This could make watching sports more engaging and educational for fans of all ages.
Overall, "Athlete Insight" could transform the way athletes train, coaches strategize, scouts recruit, and fans engage with sports, thanks to Twelve Labs' cutting-edge technology in video understanding.

This app could revolutionize sports training and analysis by leveraging Twelve Labs' multimodal foundation models for video understanding

The MAT

Yashvi_45

Gaurav_9889

Ankit_Savaliya

Shreyash_5506

Mansi_999

Shruti_shekhada

Empower your projects with customizable language models, prompt precision, and extensive tool integration through OpenGPTs by LangChain.

OpenGPTs

Large language models (LLMs) have transformed the way we approach machine learning and artificial intelligence. These models are incredibly powerful, but their true potential lies in their ability to work in harmony with other sources of data and computation. This library has been developed to assist developers in building applications that combine LLMs with other technologies, allowing them to create truly intelligent and innovative products.

Langchain

Athlete Insight

The "Basketball Game AI Critic" app leverages Twelve Labs' technology to revolutionize basketball analysis. Users upload game videos, and the app automatically detects if it's a basketball game. It then generates a comprehensive analysis of player performance, team strategies, and game dynamics. The analysis includes insights on shooting accuracy, defensive prowess, teamwork, and more. By providing actionable insights, coaches, players, and fans can gain a deeper understanding of the game, improve performance, and refine strategies. The app aims to enhance the basketball experience, empowering enthusiasts to unlock the wonders of AI in the game they love.

Create 'Basketball Game AI Critic' app powered by Twelve Labs, analyzing player performance & game insights for basketball enthusiasts.

Twelve Labs Weekend Hackathon Summary

Hackathon Overview

Winners and Finalists

Grandmaster Gladiators - ChessBoxing AI Insights

Cricket Video Analyzer - 12 labs RAG

TeachWise

Submitted Concepts, Prototypes and Pitches

Cricket Video Analyzer - 12 labs RAG

TeachWise

Grandmaster Gladiators - ChessBoxing AI Insights

Athlete Insight

Curiosity