@priyalraj16928185

FrugalRoute is a token-efficient LLM routing agent built for the AMD Developer Hackathon ACT II, Track 1. Instead of sending every request to an expensive remote model, it first tries a free local model served on an AMD MI300X GPU via Ollama, giving that model access to real tools (calculator, web search) to answer directly when possible. A calibrated confidence gate — fit with Platt/Isotonic scaling and an AutoMix POMDP belief model — decides, per request, whether the local answer is trustworthy enough to keep or whether to escalate to a paid Fireworks-hosted model. A semantic cache and prompt compression layer further cut redundant remote calls. The result: most traffic gets resolved for free, with paid tokens reserved only for genuinely hard cases, all while an enforced accuracy floor keeps output quality high.

To participate in the hackathon, simply click Sign up with AMD. If you are not already a member of the AMD AI Developer Program (ADP), you will need to create an account. ADP members can access AI tutorials, experts, and community support. In addition, new members can claim a free month of DeepLearning.ai pro, $100 in AMD GPU cloud credits, and $50 in Fireworks AI API credits. All hackathon participants will receive on hackathon launch additional compute and API credits for their projects. Ready to build what's next on AMD? Sign up with AMD below to secure your spot.