SharkCast AI is a multimodal video-captioning agent built for the Video Captioning track. It uses Gemma to analyze a sequence of chronologically selected video frames, understand the main subject, actions, objects, and setting, and generate captions that remain grounded in what actually happens throughout the video. The system first extracts representative frames from the full video instead of relying on a single image or a compressed contact sheet. Gemma then produces a structured description of the main event and a factual formal caption. Based on this grounded event, SharkCast AI generates three additional captions: sarcastic, humorous with technology references, and humorous without technical jargon. To improve reliability, the system uses structured JSON responses, deterministic validation, safe fallback handling, and concurrent style generation. It is packaged as a Linux AMD64 Docker container that reads tasks from /input/tasks.json and writes the required results to /output/results.json. A Streamlit dashboard allows users to upload a video, inspect the selected frames, review the grounded event, compare all four caption styles, and view processing timings. SharkCast AI combines temporal video understanding, accurate grounding, and creative language generation in one practical captioning system.
Category tags: