Coach - Edge AI Sports Coach

Vercel
application badge
Created by team Coach - Edge AI Sports Coach on July 09, 2026
Unicorn Track

Coach turns any phone into a personal sports technique coach. Point the camera at yourself — or upload a clip — say "Coach Start," perform your serve, strike, or smash, and say "Coach Stop." The coach talks back with personalized feedback and concrete drills, no human trainer required. Coach uses a hybrid edge + cloud architecture. Everything perceptual happens on-device: MediaPipe's Pose Landmarker runs 33-point pose estimation on every frame in real time, draws a live skeleton overlay, and folds joint angles into technique scores — knee bend, shoulder tilt, and reach/contact height — plus a DTW technique match against reference form. Raw video never leaves the phone. Only the aggregate scores, about ten numbers per session, are sent to Fireworks AI. There, Google's Gemma 4 31B IT model — served from a dedicated Fireworks deployment, with graceful fallback to serverless GLM 5.2 — interprets the numbers and returns a headline, an explanation, and 2-4 concrete drills as structured JSON. A custom Capacitor voice plugin keeps the mic hot for wake-word commands throughout the session, and the AI's reply is spoken aloud, completing a full voice-in, voice-out coaching loop. The same pipeline already covers beach tennis and tennis serves, soccer strikes, and ping-pong smashes, and generalizes to any technique sport. Personal coaching is a multi-billion-dollar market gated on expensive human hours; Coach delivers a coach that sees, understands, and speaks — for the marginal cost of a few hundred LLM tokens per session.

Category tags: