AuraRoute: Token-Efficient Hybrid AI Router

AuraRoute is a cutting-edge hybrid AI orchestration framework engineered specifically for the AMD Developer Hackathon. Designed to excel under rigid wall-clock execution windows and tight scoring criteria, the system minimizes remote token overhead without sacrificing reasoning accuracy. The core architecture operates on a local-first paradigm. Low-compute workloads (such as sentiment analysis, basic entity extraction, and straightforward summarization tasks) are processed natively on a CPU-bound Docker container utilizing a heavily quantized Qwen2.5-1.5B-Instruct model. For maximum reliability, the framework enforces an innovative confidence-score parser coupled with strict JSON validation rules to safely isolate and execute tasks on the edge. When the local model exhibits low confidence, or when the specialized intent classifier flags a high-compute domain (such as advanced mathematics, code generation, logic puzzles, or general system failures), the agent executes a seamless fallback cascade to cloud-based serverless environments via the Fireworks AI API. To dominate the token-efficiency leaderboard, AuraRoute deploys a highly specialized token starvation strategy. By stripping conversational system prompts and appending precise 'anti-yap' structural suffixes to user queries, the model cuts out filler tokens completely. Furthermore, it leverages state-of-the-art API features like compressed reasoning effort constraints to limit invisible chain-of-thought overhead on remote reasoning backends. Fully crash-proof and timeout-resilient, AuraRoute provides the ultimate architecture for scalable, enterprise-grade AI routing.