Ladybug - The Robot Reader

medal
Created by team Team Ladybug on February 14, 2026

There are 240 million children worldwide living with learning disabilities, and many struggle to access physical books independently. Ladybug: The Robot Reader was built to change that. Ladybug is an autonomous robotic system that reads physical books aloud from cover to cover with no human intervention. Built on the SO-101 robotic arm, it uses a perception-action loop powered by Claude Vision to assess the workspace, decide what to do next, and execute — opening a closed book, reading each page spread, turning pages, and closing the book when finished. Claude Vision analyzes camera frames to classify page types (content, title page, table of contents, index, blank) and extract text. ElevenLabs then streams natural-sounding speech in real time using a sentence-level prefetch pipeline so audio plays continuously without pauses. Motor skills — opening, closing, and page turning — are trained using ACT (Action Chunking with Transformers) policies. The system includes intelligent retry logic with frame hashing to detect failed page turns and automatically retry them. Ladybug supports multiple reading modes: verbose (reads everything), skim (headers and titles only), and silent (text extraction only). It also features a web dashboard for remote monitoring and a dry-run mode for testing without hardware. Our mission is accessibility in education — putting an autonomous reading companion in every special education classroom. We want 1,000,000 lady bug robot readers available to children around the world.

Category tags:Additional links:

"Constructive feedback Clarify robustness across real-world book variability Physical books vary widely in size, binding stiffness, paper type, and wear. The project would be stronger with clearer evidence or discussion of how Ladybug handles edge cases such as thick spines, glossy pages, torn pages, or non-standard layouts. Address cost, deployment, and maintenance at scale The mission is ambitious and impactful, but reaching classrooms globally will depend on affordability, durability, and ease of maintenance. Outlining a path to cost reduction, hardware reliability, and classroom-ready deployment would strengthen feasibility. Positive feedback Powerful alignment of technical ambition with social impact The end-to-end autonomy, thoughtful retry mechanisms, and multiple reading modes show strong engineering depth in service of a clear, meaningful accessibility goal."

avatar

Mallika Rao

Engineering Leader