BlackBox - Video Captioning Agent

This project is built around the video captioning challenge: take a fixed set of short clips, thirty seconds to two minutes each, and write a caption for every one in four distinct voices. Rather than settling for one caption made safe enough for everyone, Blackbox writes four honest, independent takes on the same footage. For each clip it samples frames spread across the beginning, middle, and end, transcribes anything spoken in the audio, and then drafts all four captions at once rather than one after another, so a whole batch of clips can be worked through at the same time instead of queueing. It also checks its own work: every caption is graded against the clip for accuracy and tone before it's handed back, and anything that falls short gets quietly rewritten. Under the hood it leans on Google DeepMind's Gemma 4 as the first model to look at each clip, with Fireworks AI's minimax-m3 and qwen3p7-plus waiting as backups in case the primary model is busy or unavailable, Google Cloud Speech-to-Text for transcription, and a Dockerized Python pipeline .