Aegis Semantic Routerv5
Aegis Semantic Router is a high-performance, cost-control gateway designed for enterprise AI deployments. The system acts as a hybrid intelligence router, dividing natural language queries between a local, in-process Gemma-2-2B-Instruct model (which incurs zero API cost) and a premium cloud model accessed via the Fireworks AI platform. By utilizing a lightweight, local all-MiniLM-L6-v2 embedding model, the router runs a k-Nearest Neighbors (kNN) semantic classifier on CPU to determine query complexity. Simple tasks like sentiment analysis, Named Entity Recognition (NER), factual recall, and summarization are handled locally at zero cost. More advanced logic, math, and code tasks are escalated to Fireworks AI. Crucially, the entire system is self-contained within a memory-restricted Docker container (under 4 GB RAM), pre-baked to run fully offline without start-up download delays.
Category tags:
For Innovators & Creators