OpenAI Whisper AI technology Top Builders

Explore the top contributors showcasing the highest number of OpenAI Whisper AI technology app submissions within our community.

OpenAI Whisper

The Whisper models are trained for speech recognition and translation tasks, capable of transcribing speech audio into the text in the language it is spoken (ASR) as well as translated into English (speech translation). Whisper has been trained on 680,000 hours of multilingual and multitask supervised data collected from the web. Whisper is Encoder-Decoder model. Input audio is split into 30-second chunks, converted into a log-Mel spectrogram, and then passed into an encoder. A decoder is trained to predict the corresponding text caption, intermixed with special tokens that direct the single model to perform tasks such as language identification, phrase-level timestamps, multilingual speech transcription, and to-English speech translation.

General
Relese date	September, 2020
Author	OpenAI
Repository	https://github.com/openai/whisper
Type	general-purpose speech recognition model

Start building with Whisper

We have collected the best Whisper libraries and resources to help you get started to build with Whisper today. To see what others are building with Whisper, check out the community built Whisper Use Cases and Applications.

Tutorials

👉 Discover more Whisper Tutorials on lablab.ai

Boilerplates

Kickstart your development with a GPT-3 based boilerplate. Boilerplates is a great way to headstart when building your next project with GPT-3.

Python Whisper Boilerplate Whisper gpt3 email generator
Streamlit Whisper, GPT-3 Boilerplate Whisper gpt3 sentiment analysis
React app to upload audio file boilerplate Uploading audio file to an API endpoint
Whisper Flask API Boilerplate Whisper API with Flask
Whisper Flask API with GPT-3 Boilerplate Whisper API with Flask and GPT-3
Whisper Streamlit Boilerplate Automatic Speech Recognition using OpenAI's Whisper

Libraries

Whisper API libraries and connectors.

Whisper API Whisper API reference
OpenAI Node.js API library for Whisper The OpenAI Node.js library provides convenient access to the OpenAI API from Node.js applications
OpenAI Python Library for Whisper The OpenAI Python library provides convenient access to the OpenAI API from applications written in the Python language

Edit on Github

OpenAI Whisper AI technology Hackathon projects

Discover innovative solutions crafted with OpenAI Whisper AI technology, developed by our community members during our engaging hackathons.

E-GovConnect

eGovConnect is an AI-powered platform designed to streamline how citizens access government services. It solves issues like long wait times, fragmented systems, and accessibility barriers, providing a more efficient and inclusive experience. Citizens can call a single government-registered number to access 24/7 virtual assistance. The AI assistant helps them get instant answers to questions and complete tasks like renewing a driver’s license, applying for social security, or checking tax refund statuses. By consolidating multiple government services, eGovConnect makes it easier for citizens to navigate various processes from one platform. eGovConnect also prioritizes accessibility, offering multilingual support and voice interfaces for non-English speakers and differently-abled individuals. It sends proactive reminders and updates about deadlines, required documents, and application statuses, ensuring citizens are always informed. With strong security measures, eGovConnect allows citizens to securely access personal records and application statuses. The platform is designed to handle millions of interactions simultaneously, making it efficient even during peak times like tax season. By automating routine tasks and integrating services across different government departments, eGovConnect reduces the burden on staff and speeds up service delivery. In summary, eGovConnect makes government services more accessible, efficient, and secure, offering citizens a seamless experience in navigating public services. It’s a solution that empowers citizens, supports government efficiency, and strengthens trust in public institutions.

Mindsphere - powered by NeuralNexus

MindSphere is an innovative healthcare platform that makes it easier and less complicated to get medical help through its integration of various services into one seamless user experience. Made with the latest technologies, the platform offers accessible, personalized, and real-time health solutions. IVR Symptom Checking & Appointment Booking: MindSphere has an advanced IVR system that enables users to check symptoms and receive instant feedback. Users can easily book appointments with healthcare professionals, and confirmation is sent via SMS, so they remain updated. AI-Powered Health Chatbot: The platform includes an AI-powered chatbot that answers a wide range of health-related queries. Users can describe symptoms, ask about conditions or treatments, and receive instant, accurate responses, offering quick guidance when needed. Medical Image Analysis: MindSphere uploads a medical report, prescription, or medication images. Artificial Intelligence and image recognition then analyze these images and give meanings that explain to the person so that he or she could understand what's his health status and treatment to have. Video-based Health Education: MindSphere houses an extensive collection of education videos on topics such as prevention, wellness, mental health, and treatments. All these video-based learning enables users with health wisdom and advice. In its healthcare inspiration section, it highlights some success stories, wellness tips, and strategies for staying in balance, motivating people to stick to their health journey. User-Friendly Interface: MindSphere is made intuitive so that anyone without technical expertise can easily find his or her way through it and benefit from it.

LLAMA First Aid - your virtual first aid assistant

LLAMA First Aid is an advanced web-based assistant powered by Meta’s LLaMA AI, designed to provide real-time, step-by-step guidance during medical emergencies. It offers clear, easy-to-follow instructions for a variety of urgent situations, making it accessible to both trained first aid responders and those without medical experience. The app’s intuitive interface adapts to different emergency scenarios, offering tailored advice based on the severity of the situation. Users are guided through each step with the help of text and audio instructions, supported by educational video tutorials to explain complex procedures. The dual input functionality allows for efficient communication, even in high-stress situations where typing may not be practical. LLAMA also stores interaction history, ensuring consistent and accurate guidance. It assesses the severity of an emergency and factors in the user's location to suggest the best course of action. It can recommend nearby hospitals or emergency services, helping users decide whether to call an ambulance, visit a hospital, or manage the situation independently. This personalized, location-aware approach ensures timely and appropriate care based on the urgency of the emergency. Future updates will include real-time alerts to medical facilities, notifying them of an incoming emergency and allowing them to prepare. LLAMA will also feature image recognition, enabling users to upload photos of injuries for more precise guidance. Additionally, data analytics will track emergency response times and outcomes, providing valuable insights for improving future care. It is an indispensable tool for both everyday users and healthcare professionals, continuously evolving to offer fast, effective, and reliable support in medical emergencies. With its ability to assess situations, provide personalized guidance, and integrate with medical services, LLAMA ensures users can manage health crises with confidence.

KRIORA

Kriora è uno strumento innovativo che cerca di abbattere proprio queste barriere linguistiche, permettendo alle persone di comunicare senza difficoltà, anche quando parlano lingue diverse. Si tratta di una piattaforma di traduzione vocale che offre una soluzione pratica ed efficace per superare la distanza linguistica in tempo reale. Grazie alla sua tecnologia avanzata, Kriora consente a migranti, rifugiati e chiunque si trovi a dover interagire in una lingua straniera di comunicare senza ostacoli, migliorando l'accesso ai servizi, il dialogo interculturale e l'integrazione sociale. Con Kriora, non solo la lingua diventa un mezzo per farsi capire, ma anche uno strumento che crea connessioni, promuove la comprensione reciproca e combatte l'esclusione. È una risposta concreta alla necessità di abbattere i muri invisibili che ancora separano molte persone, un passo verso una società più inclusiva e accogliente per tutti.

Rural LLama-Health

Rural areas in our country face a severe healthcare crisis, particularly in Santiago del Estero, Argentina’s most rural province. With only 1.7 doctors per 1,000 people—less than half the national average—and 64% of residents living in poverty, limited access to care has devastating consequences. Late HIV diagnoses affect 56% of cases, with 39% identified at advanced stages. Broken referral systems, a shortage of specialists, and poor internet infrastructure further isolate healthcare workers and hinder patient outcomes. Our solution, Rural Llama-Health, is an app tailored for healthcare workers in low-resource settings. It features an intuitive interface powered by RAG (Retrieval-Augmented Generation), speech-to-text capabilities, and Open Source LLAMA technology to diagnose and track diseases effectively. The app provides rapid access to medical data and decision-making tools, saving time and improving care, even in areas with poor infrastructure or limited specialist availability. By empowering primary care and community health workers, Rural Llama-Health addresses key challenges and aims to bridge healthcare gaps in underserved communities.

ePluribusUnum

ePluribusUnum is a comprehensive translation platform that enables seamless speech-to-speech and document-to-document translation, with a specific focus on Ukrainian to Dutch (and vice versa) translation. The platform combines traditional translation methods with advanced LLM capabilities to provide accurate and context-aware translations.By leveraging the power of LLM, ePluribusUnum goes beyond standard translation, ensuring clarity, context relevance, and an intuitive experience across both spoken and written language translations. Its responsive design and advanced text-to-speech (TTS) capabilities make it suitable for various devices and environments, aiming to bridge language barriers and foster better understanding between users worldwide.