AudioCraft 24-hours Hackathon

For more details, please, check your inbox

Hackathon Kick-Off

Submission deadline!

A tool that transforms Bach's music into emoji representations of neuron activation patterns. 🎵🤖😊

IntrospectiWaveVisioneers

inshayaqoob

AqsaAshfaq07

jmikedupont2

IbrahimLaeeq

Zain-Ramzan

imwaqaxsandhu

You have outlined the process quite comprehensively:

1. Utilize the EnCodec model to encode audio files into vector representations, saved as text files.
2. Process these text embeddings using the "emojiintrospector" tool to generate emoji sequences that represent the audio.
3. Validate the emoji outputs across test audio samples to ensure that the harmonic relationships are maintained.

Key points:

- EnCodec encodes audio to discrete embeddings, output as text.
- The "emojiintrospector" tool maps these text embeddings to emojis.
- Generated audio samples with 3 harmonics are encoded.
- Analyze the emoji outputs to identify common patterns representing harmonic frequencies.
- This demonstrates that the pipeline retains the harmonic structure in the emoji mapping.
- The resulting emoji sequences can be used for visualization or further analysis.

"Emojifying Bach": Transform Bach's music into emoji art using EnCodec embeddings and neural networks. Visualize and interact with emotions, tempo, and melodies through dynamic emoji representations. An innovative fusion of music and visuals.

"IntrospectiWaveVisioneers team on AudioCraft 24-hours Hackathon Hackathon"

Team Idea

Submission