CineCaption AI Multi-Style Video Captioning Agent
CineCaption AI is a video captioning agent built for the AMD Developer Hackathon Track 2. It downloads a video clip, extracts eight evenly-spaced key frames using ffmpeg, and sends them to Kimi K2.6 — a vision-language model on Fireworks AI — which produces a detailed factual description of the scene. That description is then passed to DeepSeek V4 Pro, a text model that generates four styled captions: formal, sarcastic, humorous-tech, and humorous-non-tech. The pipeline processes multiple videos in parallel using ThreadPoolExecutor, completing each clip in 30-60 seconds. It includes automatic retry logic, JSON parsing with fallback, and a per-style fallback caption generator to guarantee output for every requested style. The entire agent runs inside a lightweight Docker container (python:3.11-slim + ffmpeg) and is deployed to GitHub Container Registry with a linux/amd64 manifest.
Category tags:
For Innovators & Creators