VidTone Agent

VidTone Agent is a Caption QA Copilot for short-video teams, built for AMD Developer Hackathon Act-II Track 2: Video Captioning. It turns a short video clip into four platform-ready caption styles: formal, sarcastic, humorous-tech, and humorous-non-tech. Most captioning tools stop after generation. VidTone Agent adds a second QA layer: a Judge Agent scores every caption for accuracy, tone match, and hallucination risk. If a caption is weak, the system can revise it using the judge’s notes, then export the final result as JSON or CSV. The core workflow is Generate → Judge → Revise → Export. The app runs in real mode with Fireworks AI. The verified model is accounts/fireworks/models/gpt-oss-120b, and users can override the model from the Web UI or CLI if their Fireworks account exposes other models. The product also supports batch processing for Track 2 judging: a folder of video clips can be processed into one aggregate CSV, JSON, and manifest. For longer videos, VidTone Agent can optionally split the video into shorter segments, process each segment, and export segment-level results. This keeps the main Track 2 short-video flow stable while making the tool more useful for real-world video teams. The stack includes Python 3.11, FastAPI, React, Vite, TypeScript, Bun, OpenCV, Docker, and Fireworks AI. The app ships as a Docker-ready web product with a FastAPI backend, React UI, CLI workflow, mock mode for local demos, and real Fireworks mode for final scoring.