NeuroPilot

Created by team NeuroPilot on February 14, 2026
Simulation-to-Real Training and Evaluation Pipelines

People who could benefit from hands-free control, for example those with limited mobility, often cannot access it. NeuroPilot changes that: open-source BCI middleware that turns a Muse 2 headband into a real control interface. Muse 2 is already connected to the app, and we have a working integration with DJI Tello. Users train in a 3D simulation and in a training environment; when their brainwave pattern matches a chosen action (move left, right, up, down), the backend fires configurable webhooks or WebSockets. We accumulate 5 actions from the headband; YOLOv8 runs on the Tello camera feed to detect obstacles and Tello state. That batch and the vision data are sent to Gemini, which decides the movement. Every command sent to the DJI Tello is the result of an AI API call, so BCI intent is refined by vision and reasoning before it reaches the drone. The stack is software-only and simulation-first: a Next.js frontend, a FastAPI + WebSocket backend, a web Lab (Three.js), a machine/Connect dashboard for status and live feedback, and per-control webhook URLs. No lab hardware or locked-in vendors. Teams can integrate with existing sims, digital twins, or robots via HTTP.

Category tags:Additional links:

"Good demo and interesting idea. 1. My main skepticism is if the EEG data will be accurate and if it will allow for a smooth operation of the drone. Muse has currently only been used for meditation so the data might not be accurate. The question is - will there ever be a EEG device on the market which will have accurate enough data for drone control? I recommend pivoting to voice based control or EMG control (see Meta neural wristband) to get into the market and keeping EEG control as a future integration. "

avatar

Ishaan Gupta

"Description: BCI middleware using Muse 2 headband for hands-free robot control. Train brainwave patterns → control DJI Tello drone. Features: Muse 2 EEG integration 5 configurable actions YOLOv8 for obstacle detection Gemini for AI reasoning 3D simulation for training Webhook/WebSocket outputs Software-only, simulation-first Demo: app.theneuropilot.com Pros: ✅ VERY UNIQUE! - BCI for robotics control ✅ Accessibility impact (hands-free for people with mobility issues) ✅ Real hardware (Muse 2 + DJI Tello) ✅ Full stack (Next.js + FastAPI + Three.js) ✅ Innovative concept! Cons: Zero stars Very niche Limited hardware requirements (Muse 2, Tello)"

avatar

Sanem Avcil

"Requires a lot of practice and testing to ensure commands don't fail, Definitely the future is in similar paradigm, but it might be just slightly running ahead of its time. "

avatar

Nathan Kay