Hero Banner

Top Builders

Explore the top contributors showcasing the highest number of app submissions within our community.

Meta AudioCraft: Audio Processing and Generation Library

Welcome to the ultimate destination for groundbreaking audio technology. Crafted meticulously by Meta, AudioCraft is a cutting-edge library for deep learning-powered audio generation and research.

General
AuthorMeta
Repositoryhttps://github.com/facebookresearch/audiocraft
TypeThe library for audio processing and generation

What is AudioCraft?

AudioCraft is a next-gen library revolutionizing the audio industry with its array of features. It's not just an audio library, it's the future of audio.

Key Features:

  • Advanced Audio Generation Models: With models like AudioGen and MusicGen, prepare to experience unparalleled audio quality.
  • EnCodec: An innovative audio compressor and tokenizer that is setting a new standard in audio processing.

Capabilities:

  • Generative Audio Needs: A comprehensive code base for all generative audio needs - be it music, sound effects, or compression after training on raw audio signals.
  • Simplified Model Design: The model design, especially for MusicGen and AudioGen, is simplified compared to previous generative models. With a single autoregressive Language Model (LM) that operates on compressed discrete music representation, or tokens, AudioCraft efficiently captures long-term dependencies in audio for high-quality generation.
  • EnCodec: A unique neural audio codec that converts audio signals to discrete tokens and vice-versa. It acts as the bridge between the raw waveform and the autoregressive language model.
  • Text-to-sound Generation: With AudioGen, you can convert text into environmental sounds.
  • Text-to-music Generation: MusicGen brings texts to life by crafting diverse, enchanting melodies based on the provided textual cues.

AI Tutorials

AudioCraft Resources

A curated list of libraries and technologies to help you build great projects with AudioCraft.

  • Installation Guide: Get started with AudioCraft using the detailed guide on GitHub.
  • Models Overview:
    • MusicGen - A top-tier controllable text-to-music model.
    • AudioGen - A groundbreaking text-to-sound model.
    • EnCodec - A high fidelity neural audio codec.
    • Multi Band Diffusion - An EnCodec compatible decoder using diffusion.
  • API Documentation: Delve deeper into the features, functionalities, and integrations with the detailed API Documentation.
  • Meta Intro Article: Understand the technology, its creation, and its capabilities with this Meta Intro Article.
Edit on GitHub

AudioCraft AI technology page Hackathon projects

Discover innovative solutions crafted with AudioCraft AI technology page, developed by our community members during our engaging hackathons.

Qubic Liquidation Guardian

Qubic Liquidation Guardian

Qubic Liquidation Guardian is a hybrid Track 1 + Track 2 project built by CrewX that brings real-time liquidation protection, institutional-grade risk analysis, and automated alerting to the Qubic Network. The problem is simple: DeFi liquidations happen instantly, but users do not get instant signals. As a result, borrowers lose capital, protocols lose liquidity, and investors hesitate to adopt new systems without safety infrastructure. Inspired by this gap, Qubic Liquidation Guardian provides a complete safety layer over lending protocols deployed on the Nostromo Launchpad. At its core, the system includes an on-chain event listener and a real-time risk scoring engine, which analyzes: • Health Factor • Liquidation Proximity • Total Debt Exposure • Active Positions These metrics are combined into a 0–100 Risk Score, dynamically updated for each borrower. Based on the score, users are automatically classified into Low, Medium, High, and Critical risk tiers, enabling rapid decision-making. The platform also includes advanced features such as: • Whale Watch: Detect large-value transactions to anticipate market shifts • Smart Alerts: Severity-based notifications connected to any tool • Auto-Airdrop: Rewards for users who resolve high-risk positions • Crash Simulator: A built-in testing environment to simulate -70% market dumps, rebounds, and full resets to verify protocol safety Qubic Liquidation Guardian is designed to strengthen the Nostromo ecosystem by improving investor confidence, increasing protocol safety, and enabling risk-aware liquidity management. With over 35 production-ready API endpoints, an edge-distributed database, and a Next.js 15 architecture, the application is fully deployable and already live for testing. Ultimately, this project delivers exactly what new chains and protocols need: speed, stability, transparency, and automation—making Qubic safer for everyone.

Imagine Sound Where Your Images Revived

Imagine Sound Where Your Images Revived

Imagine Sound introduces a groundbreaking way for the media sector and creatives to add depth to their visual content. It's a bridge between visual art and auditory sensation, transforming images into bespoke sound effects with advanced AI. This tool is perfect for anyone seeking innovative methods to enhance storytelling or create immersive experiences. With Imagine Sound, photographers, filmmakers, and content creators can bring a new layer of emotion and context to their work, making visuals not just seen but heard. Whether it's adding ambiance to a photo exhibition or creating unique soundscapes for digital art, Imagine Sound opens up endless possibilities for creativity and engagement in the media world.

THE 12 DAEMONS OF XMAS

THE 12 DAEMONS OF XMAS

In "THE-12-DAEMONS-OF-XMAS," players enter a peculiar and shadowy rendition of Christmas, now overrun by 12 Daemons. Each Daemon embodies a distorted aspect of the traditional 12 Days of Christmas, creating a unique and challenging world. The game's hero, an unlikely character such as an elf or a disillusioned reindeer, is tasked with the monumental quest of saving Christmas. Players must navigate through various puzzles and challenges, each designed to test their wit and resolve. The game is created using Stability AI to generate game content on the fly to create a fully AI-generated game where every play-through is unique!

Brand Vision-See and Hear Your Brand

Brand Vision-See and Hear Your Brand

BrandVision presents a groundbreaking approach to brand identity, leveraging Google Gemini's advanced capabilities to deeply analyze and interpret your brand's visual elements. This innovative solution goes beyond traditional methods, meticulously creating a bespoke sonic persona that resonates with the core of your brand's identity. By embracing this technology, BrandVision allows you to move away from commonplace, generic soundscapes, offering a unique and distinctive auditory signature. This not only differentiates your brand in a competitive market but also fosters a more profound and memorable connection with your audience. BrandVision is the key to unlocking a new dimension of brand expression, where sound and vision harmoniously intertwine to redefine brand experiences.

Radio Imaging and MusicGen Ai

Radio Imaging and MusicGen Ai

Radio Imaging and MusicGen AI, a pioneering Custum GPTs crafted for radio producers and music creators! This GPTs is a creative assistant both in audio and music production, harnessing the power of AI to address advanced real-world challenges in media production sectors. The primary goals for creating these custom GPTs are: 1. Innovation in Audio Production: To revolutionize radio imaging and music creation by integrating advanced AI capabilities, offering new, creative ways to produce audio content. 2. Simplification and Efficiency: To streamline the music and audio production process, making it more efficient and accessible for creators of all skill levels. 2. Diverse Creative Options: To provide a vast array of musical and audio possibilities, from generating music based on text prompts to offer novel radio imaging ideas, thereby enhancing creative freedom. 4. User Empowerment: To empower users with user-friendly guidance and the ability to build and run the system locally, catering to both novices and professionals. 5. Market Leadership in Audio AI: To position this GPTs as a leading tool in the field of AI-driven audio production, setting new standards for innovation and quality in the industry

PsychGen - Conversational AI for Psychotherapy

PsychGen - Conversational AI for Psychotherapy

With 15% of working-age adults facing mental disorders and an annual loss of US$ 1 trillion in the world due to impaired productivity from depression and anxiety, the necessity for real-time emotional and physiological monitoring is paramount. PsychGen, developed using AutoGen multi-agent platform, aims to democratize mental healthcare through AI-driven personalized psychotherapy sessions, addressing the global rise in mental health issues and the inaccessibility of traditional therapy. Utilizing a robust technology stack including AutoGen, Streamlit, OpenAI, AssemblyAI, Audiocraft, and DALL-E, PsychGen transitions seamlessly from text to audio, audio to music, and finally to video to enrich the therapeutic experience. The project encompasses multi-faceted agents such as a Psychological Chatbot for profiling and script generation, Speech and Music Generation for a meditative voice output and soothing soundtrack, Image and Video Generation for visual representation of therapy themes, and a Mixing agent for creating a comprehensive therapy session. PsychGen holds the promise of democratized access to psychotherapy, real-time personalized mental health support, and scalability for integration with other mental health resources, envisioning a future where quality mental healthcare transcends traditional barriers and is accessible to all.