AI Virtual Puppet Theater

AI Virtual Puppet Theater is an immersive AI powered browser experience that transforms users into live digital puppeteers through real time gesture control, facial tracking, and cinematic storytelling. The project combines computer vision, realtime animation, and interactive stage design to create a magical virtual theater where users control expressive 3D characters using natural human movements. Using webcam based hand tracking and facial detection, players can perform combat, emotional reactions, celebration animations, and cinematic interactions. The system tracks gestures, blinking, eye movement, facial expressions, and head motion to make puppet characters feel emotionally alive and deeply connected to the user. Characters react dynamically with expressive eyes, animated emotions, smooth movement interpolation, and theatrical body language. The platform includes a complete cinematic story mode featuring dramatic sequences between a King, Lion, Hero, and mysterious dark creature, brought to life through curtain transitions, realtime lighting, particle systems, and synchronized animation, all running directly inside the browser. The technical stack includes Next.js, TypeScript, Tailwind CSS, React Three Fiber, Three.js, Zustand, MediaPipe, TensorFlow.js, face-api.js, and Framer Motion, with strong focus on low latency interaction and immersive presentation quality.