Llama Impact Hackathon

Start

Dub the video in any language via Llama models

VideoLangua

alabulei1

juntao

shadowJack

VideoLangua: Bridging the Language Divide through AI-Powered Video Translation

English dominates the world of online content, with more than 60% of digital content in English. This bias also reflects in large language model training, where English remains the primary language. Yet, 75% of the world's population does not speak English, creating a significant information divide. For non-English speakers, the cost of translation is prohibitive—for instance, professional video subtitling can range from $0.18 to $0.25 per word, according to Marshub.

VideoLangua addresses this challenge by offering cheap and accurate AI translation services to bridge language barriers, making information more accessible to non-English speakers.

Our solution leverages a suite of large language models and specialized agents for efficient, culturally sensitive, and accurate video translation:

1. Speech-to-Text Conversion: We use Whisper for accurate transcription, including timestamps.
2. Translation: For translation, we call Llama 3.1-70B-Chinese and Llama 3.1 70B to translate text. To ensure translation accuracy, Llama 3.2 3B, which supports eight languages, reviews the translation.
3. Subtitle Generation: Translated text is synced back to the video’s timeline as subtitles.
4. Optional Dubbing: For users who need voiceover in their native language, we offer an option for dubbing, ideal for video content files.

With the global translation service market valued at $40.95 billion in 2023 and projected to reach $41.78 billion in 2024, VideoLangua is well-positioned to capture a share by offering a high-quality, affordable alternative to traditional video translation services.

Unlike typical text-based translation tools, VideoLangua focuses on video and aduio translation, combining affordability with quality. Our solution uses Llama fine-tuned for different languages, allowing users to easily access translation and dubbing features in multiple languages.


VideoLangua provides high-quality, affordable video translation service, powered by open source AIs. Upload any video file and let a swarm of AI agents translate it for you! 

"VideoLangua team on Llama Impact Hackathon Hackathon"

Team Idea

Submission