Optimizing multi-vector RAGs for Edge. Using dynamic tensor pruning & INT8 quantization to slash VRAM by 80% with minimal recall drop.
Applied AI Engineer
Developer
Dynamic VRAM Optimization for Vision-Language Models on Edge Devices