A Busy GPU Is Not a Productive GPU: New Scorecard Rewrites AI Inference Metrics
NAND Research and WEKA's Inference Economics Scorecard argues GPU utilization hides wasted context rebuilding. An 8-hour HGX B300 test showed 3.7x more tokens per GPU-hour with shared NVMe cache.
