Eleven Labs AI Hackathon

Hackathon Kick-Off

The founders at NewNative and lablab.ai will introduce participants to our mission and the opportunities you have as a member of the lablab.ai community.

NewNative Introduction

Let's go through the Technologies for the Hackathon and how you can learn it.

Technology and Challenge

Mati Staniszewski, CEO of ElevenLabs, will give an introductory presentation to hackathon participants on the advanced voice model you'll be using to build projects. Get excited and be ready to start creating!

Get to know ElevenLabs!

We will guide you through the website, and Discord community - to make sure you will succeed at the Hackathon

Hackathon Guide

After the Kick-Off stream, focus on finding your team for the Hackathon and start brainstorming your idea!

Team Formation time!

Join Q&A space on lablab.ai Discord server for open session to discuss any questions you may have

Open Q&A with mentors

Submission Deadline

Chat with an agent! We're going to use Whisper and Elevenlabs with VRM 3D avatars and AI chat.

Isekai

M̵̞̗̝̼̅̏̎͝Ȯ̴̝̻̊̃̋̀Õ̷̼͋N̸̩̿͜ ̶̜̠̹̼̩͒

Avaer Kazmer

Isekai Engine is a Twitch stream featuring an embodied virtual avatar (Citrine) that can do anything.

We use OpenAI GPT combined with a Generative Agents style ReAct loop attached to a full Linux computer, and we render the result on the web using THREE.js with an animated VRM character in a procedurally generated virtual world (using Blockade Labs) with a perception/generation loop. The resulting render is streamed to Twitch using OBS.

The purpose of the product is threefold:

First, we wanted to leverage the latest generative AI models to produce a virtual TV show with a unique premise: the character is real -- she can do things in the real world with her Linux computer.

Second, we want to educate the world at large about how close we are getting to AGI with generative AI models, by making the latest technology accessible in the simplest possible platform: a shared stream you can hop onto and chat with.

Third, we want to explore the possibilities of monetization of generative AGI models. We think this is an increasingly important social concern as generative AI threatens to displace job markets. We believe in discovering what is possible and sharing our research so that we can prepare and develop the antibodies to the future we are rapidly accelerating into.

Meet Citrine, an AGI Twitch streamer who has access to a full Linux computer! Isekai Engine lets you create the ultimate programming tool -- eventually. For now, it will teach us how close we are getting to AGI as Citrine fumbles through the virtual world

"Isekai team on Eleven Labs AI Hackathon Hackathon"

Team Idea

Submission