WiseRouter — Token-Efficient Routing Agent
This project implements a token-efficient AI agent for AMD Hackathon Track 1. Incoming tasks are classified by category and routed through three tiers. Tier 1 uses deterministic solvers for math, sentiment, NER, and spam detection — consuming zero tokens with instant results. Tier 2 runs a local Qwen 2.5 0.5B GGUF model inside the container for summarization and general queries — again zero API tokens. Only tasks requiring strong reasoning (logic, code debugging, factual questions) reach Tier 3, the Fireworks cloud API. The system includes prompt caching, negation-aware sentiment analysis, exponential backoff, chunked batch processing, and pre-compiled regex patterns for handling 1000+ tasks efficiently. Built with Python, asyncio, aiohttp, and llama-cpp-python.
Category tags:For Innovators & Creators