DevFleet Orchestrator Routing Engine

The DevFleet Orchestrator Engine is a lightweight, concurrent Go agent designed to solve diverse query categories under strict token and execution constraints. It implements an intelligent multi-tiered router that classifies inputs into categories (such as math, sentiment, factual, summarization, and coding) and routes them cost-efficiently. For low-level queries like basic arithmetic, a zero-token local AST math solver evaluates equations instantly without reaching the cloud. Ambiguous sentiment queries trigger a local sentiment polarity classifier that utilizes a 1-token verification gate ("YES" or "NO") on a cheap Tier 1 model before escalating. Highly complex logical or code queries are routed dynamically to robust Tier 3 models. To prevent token waste, the engine enforces server-side max_token caps, strips reasoning tags (think blocks) and markdown fences, and runs a post-completion output auditor that cleans preambles, ensures sentence counts, normalizes lists, and grammatically formats truncated bullet points. Built on a thread-safe deduplication cache and wrapped in a scratch Docker image with root certificates, it guarantees high accuracy and zero TLS handshake overhead.