OpenAI Whisper Top Builders

Explore the top contributors showcasing the highest number of OpenAI Whisper app submissions within our community.

OpenAI Whisper

The Whisper models are trained for speech recognition and translation tasks, capable of transcribing speech audio into the text in the language it is spoken (ASR) as well as translated into English (speech translation). Whisper has been trained on 680,000 hours of multilingual and multitask supervised data collected from the web. Whisper is Encoder-Decoder model. Input audio is split into 30-second chunks, converted into a log-Mel spectrogram, and then passed into an encoder. A decoder is trained to predict the corresponding text caption, intermixed with special tokens that direct the single model to perform tasks such as language identification, phrase-level timestamps, multilingual speech transcription, and to-English speech translation.

General
Relese date	September, 2020
Author	OpenAI
Repository	https://github.com/openai/whisper
Type	general-purpose speech recognition model

Start building with Whisper

We have collected the best Whisper libraries and resources to help you get started to build with Whisper today. To see what others are building with Whisper, check out the community built Whisper Use Cases and Applications.

Tutorials

👉 Discover more Whisper Tutorials on lablab.ai

Boilerplates

Kickstart your development with a GPT-3 based boilerplate. Boilerplates is a great way to headstart when building your next project with GPT-3.

Python Whisper Boilerplate Whisper gpt3 email generator
Streamlit Whisper, GPT-3 Boilerplate Whisper gpt3 sentiment analysis
React app to upload audio file boilerplate Uploading audio file to an API endpoint
Whisper Flask API Boilerplate Whisper API with Flask
Whisper Flask API with GPT-3 Boilerplate Whisper API with Flask and GPT-3
Whisper Streamlit Boilerplate Automatic Speech Recognition using OpenAI's Whisper

Libraries

Whisper API libraries and connectors.

Whisper API Whisper API reference
OpenAI Node.js API library for Whisper The OpenAI Node.js library provides convenient access to the OpenAI API from Node.js applications
OpenAI Python Library for Whisper The OpenAI Python library provides convenient access to the OpenAI API from applications written in the Python language

Edit on Github

OpenAI Whisper Hackathon projects

Discover innovative solutions crafted with OpenAI Whisper, developed by our community members during our engaging hackathons.

a Role-Playing Novel Game

We are a team dedicated to creating immersive and interactive gaming experiences. Our latest project is a text-based role-playing novel game that allows users to interact with the game's characters and environment, shaping their own unique storylines. Our game aims to offer a rich narrative experience, and we believe that the Claude-100K model API can be a valuable tool in achieving this goal. We plan to use the model API to generate dynamic and engaging text-based interactions and narratives. This includes but is not limited to: Character Interactions: Utilizing the model API, we aim to create non-player characters (NPCs) that can carry out complex and engaging conversations with the player. These interactions will be context-aware and responsive to the player's inputs. Narrative Generation: The API will also be used to generate a diverse range of narratives, including descriptions of environments, events, and plot developments, based on the player's decisions and actions within the game. Decision Making: We also intend to use the API to help generate meaningful decision prompts for the player, providing a deeper level of immersion and engagement. Game Guidance: The API can be used to provide helpful tips and guidance to players, making the game more accessible to new players while also providing depth for experienced ones. By using the Claude-100K model API, we hope to provide a more immersive and engaging experience for our players, offering them a unique narrative journey in every playthrough. We are excited about the potential of this collaboration and look forward to the possibility of integrating the Claude-100K model into our game. Thank you for considering our application.

FRAN AIVoice Aid for Psycology

FRAN is an AI-powered chatbot designed to provide 24/7 mental health support to students. It offers immediate, personalized assistance for issues such as stress, anxiety, sleep difficulties, and depression. FRAN is multilingual and ensures complete anonymity and privacy, making mental health support accessible and stigma-free. It's tailored to individual needs, learning from previous conversations to provide the most effective support. FRAN is scalable, capable of reaching a large number of students, and includes a premium subscription for enhanced features. It's a revolutionary tool in promoting student mental health and wellbeing.

Flow Genius

Flow Genius is an intuitive and user-friendly conversational bot creation platform designed to help businesses of all sizes build powerful chatbots without coding or technical knowledge. With Flow Genius, users can easily create custom chatbots that can handle customer queries, process transactions, and perform various other functions. The platform features a drag-and-drop interface, pre-built templates, and a variety of integrations with popular messaging platforms and business tools. Flow Genius is designed to be simple and easy to use, even for users without technical knowledge or coding experience. The platform's drag-and-drop interface and pre-built templates make creating custom chatbots that can handle a wide range of customer queries and tasks quick and easy. With Flow Genius, businesses can create chatbots that perform various functions, from handling customer queries and processing transactions to scheduling appointments, sending notifications, and more. This versatility makes the platform a valuable tool for businesses of all sizes and industries. Flow Genius integrates with popular messaging platforms and business tools, including Facebook Messenger, Slack, and Zapier. This makes it easy for businesses to connect with their customers on their preferred platforms and automate their workflows across multiple tools. Flow Genius provides users with detailed analytics and reporting tools to help them track their bot's performance, optimize their conversational strategies, and improve their customer engagement over time. This data-driven approach can help businesses save time, increase efficiency, and boost customer satisfaction.

RubberDuck MVP

Have you ever felt like you couldn't retain all the information from a talk, class, or event? Or maybe you feel stuck on a problem and need new perspectives to find innovative solutions? Introducing "Rubber Duck," your intelligent virtual assistant based on the concept of "rubber ducking"! The term "rubber ducking" comes from the practice in which programmers explain their problems to a rubber duck in order to clarify their thoughts and find solutions. Rubber Duck uses the power of GPT and Whisper to listen and transcribe your conversations, classes, or events, summarize the most important points, and the power of Stable diffusion to turn those abstract concepts into mnemonic support images and ask Socratic questions to help you learn and find innovative solutions. With Rubber Duck, you'll never have to worry about taking notes or missing important details again. Let Rubber Duck be your study and problem-solving companion, and see how it helps you reach new heights in your learning and creativity!

KlassNaut

KlassNaut is a cutting-edge AI-powered note generator designed to streamline the note-taking process for teachers. With its easy-to-use interface, teachers can generate notes with text input or audio input, depending on their preferences. Once the input is received, the app sends the request to a Flask server that distributes the task to Celery workers via Redis. The workers utilize GPT3.5, Whisper (when audio is involved), and Stability AI to generate meticulously formatted notes, complete with corresponding images. The generated notes are then saved to PostgreSQL, allowing teachers to easily access them at any time. To ensure that teachers receive timely notifications, KlassNaut sends notifications via a socketio server once the note has been generated. Teachers can then view the note, edit it if needed, and download it in either PDF or Docx format for future reference. The KlassNaut ReactJS client is deployed to Vercel, while the server-side code is deployed on Digital Ocean, providing a seamless user experience. KlassNaut represents the future of note-taking, simplifying and enhancing the teaching and learning experience.

DreamSteam

Our team has created an exciting prototype that utilizes cutting-edge technologies to help you explore and visualize your dreams in a whole new way. By leveraging the power of natural language processing (NLP) and Stability.ai, we've developed a system that can interpret the content of your dreams and generate stunning visual representations of them in a small booklet. Imagine being able to revisit your dreams in vivid detail, capturing the sights, sounds, and emotions that you experienced while you slept. With our prototype, you'll be able to do just that. By using NLP to analyze the content of your dreams, we can identify key themes and symbols, and then use Stability.ai to create stunning, personalized visualizations that bring your dreams to life. Whether you're looking to gain a deeper understanding of your subconscious mind or simply want to explore the fantastical worlds that your dreams create, our prototype is the perfect tool to help you do so. So why wait? Try it out for yourself and discover the endless possibilities of dream exploration.