
TokenTriage Agent is a runtime-driven AI routing system developed for the AMD Developer Hackathon Track 1. Instead of relying on a fixed model configuration, the agent dynamically discovers the models available through the runtime ALLOWED_MODELS environment and assigns them to the most suitable roles, including direct answering, semantic parsing, verification, and fallback. The final A2 architecture combines semantic parsing with deterministic execution and verification. Structured tasks such as mathematics, code analysis, formatting, logical reasoning, entity extraction, and other deterministic operations are handled through specialized local execution whenever possible, while complex natural-language tasks are delegated to Fireworks models only when required. This significantly reduces unnecessary remote inference while maintaining high answer quality. The system was designed specifically for constrained evaluation environments. It runs as a lightweight Linux/amd64 Docker container, automatically adapts to runtime-injected model allowlists, avoids hardcoded model identifiers, and remains compatible with future model families without code changes. Development emphasized engineering reliability as much as model quality. The project includes dynamic runtime model discovery, capability-based routing, deterministic validation, comprehensive automated testing, Docker portability, and strict output-contract verification to ensure every task produces a valid response. The final submission focuses on maximizing answer quality while minimizing Fireworks token usage through intelligent runtime model selection rather than static routing rules, making the system both efficient and robust under the competition’s resource constraints.
13 Jul 2026