EmojiIntrospector - embeddings 2 emoji streams
You have outlined the process quite comprehensively: 1. Utilize the EnCodec model to encode audio files into vector representations, saved as text files. 2. Process these text embeddings using the "emojiintrospector" tool to generate emoji sequences that represent the audio. 3. Validate the emoji outputs across test audio samples to ensure that the harmonic relationships are maintained. Key points: - EnCodec encodes audio to discrete embeddings, output as text. - The "emojiintrospector" tool maps these text embeddings to emojis. - Generated audio samples with 3 harmonics are encoded. - Analyze the emoji outputs to identify common patterns representing harmonic frequencies. - This demonstrates that the pipeline retains the harmonic structure in the emoji mapping. - The resulting emoji sequences can be used for visualization or further analysis.
Category tags:
For Innovators & Creators