ForgeAi

ForgeAI is a hardware-aware AI model optimization platform that automatically finds the fastest, most efficient version of a model for a specific GPU — starting with AMD MI300X. Instead of manually tuning models for each accelerator, ForgeAI runs a 7-phase optimization pipeline: architecture search finds the best candidate structures, knowledge distillation transfers accuracy from a teacher model, pruning removes redundant weights, quantization compresses from FP32 to INT8, benchmarking measures real performance on target hardware, Pareto analysis identifies optimal latency-accuracy tradeoffs, and Optuna hyperparameter tuning auto-optimizes across 6 parameters with 50 trials and early stopping. The platform consists of a FastAPI backend with 9 optimization modules, a Next.js 14 frontend, and WebSocket-based live progress streaming. Users upload a PyTorch checkpoint, select target hardware, set constraints (max latency, max memory, min accuracy), and watch the pipeline execute in real time. Results include a Pareto frontier chart, before/after performance comparison, and export to ONNX or TorchScript. ForgeAI targets the $100B+ AI inference market where hardware-specific optimization is still done manually. Unlike Neural Magic and OpenVINO (CPU-focused, tool-by-tool), ForgeAI is AMD-native, full-pipeline, and open source under Apache 2.0.