Clio Gemma

Streamlit
application badge
Created by team Tuan Dev on July 08, 2026
Video Captioning

Who is Clio? She is the muse of history, storytelling, and preserving memory based on greek mythology. ClioGemma is a containerized video-captioning agent for AMD Developer Hackathon ACT II, Track 2. It reads the evaluator's `/input/tasks.json`, downloads each clip, extracts five chronological anchor frames with FFmpeg, and sends the visual timeline to a Novita-hosted Gemma multimodal model. One structured request produces all four required styles: formal, sarcastic, humorous-tech, and humorous-non-tech. The prompt forces the model to preserve visible evidence, avoid unsupported identities, locations, counts, motives, audio claims, and completed actions, and silently verify each caption before returning JSON. The runner validates the response, preserves the exact requested style schema, handles clips concurrently, enforces bounded per-clip and total runtime, and writes `/output/results.json`. The default release uses Google Gemma 3 27B for reliable latency; Gemma 4 31B is supported as a measured A/B variant. The image is built for `linux/amd64` and contains no external judge or non-Gemma provider. A deterministic schema-preserving placeholder is used only when a clip cannot be processed, preventing malformed output from invalidating the submission. The result is a small, reproducible Docker artifact designed for hidden clips rather than hardcoded examples.

Category tags: