Vdcap.AI

Vdcap.AI is a full-stack, automated video captioning platform that generates and compares four distinct caption styles side-by-side. Designed for creators and marketers, the system accepts video uploads and extracts audio and keyframes using FFmpeg and OpenCV. If audio is present, it uses cloud Speech-to-Text APIs Fireworks (Whisper and LLM available on Fireworks AI) for high-fidelity transcription. If the video is mute, the pipeline falls back to visual frame analysis. The transcript and visual context are processed via Fireworks AI using the Llama-3.1-8B-Instruct and GLM models. These generate four tailored caption styles: Formal (professional), Sarcastic (witty), Humorous-Tech (developer-oriented), and Humorous-NonTech (casual). FFmpeg overlay filters burn these captions directly onto separate video streams. On the frontend, a handcrafted dark-mode glassmorphism interface presents the results in a synchronized 4-quadrant player. Seeking, playing, or pausing any video instantly syncs the other three, allowing real-time comparison of subtitle styles. Users can export their captions as individual SRT files, structured JSON data, captioned MP4s, or a complete ZIP package including an interactive HTML summary report. Vdcap.AI also contains a modular pipeline using LoRA adapters for fine-tuning caption models on MSR-VTT and ActivityNet datasets, making it fully ready for custom AI deployment.