AWS Reports 2.05x Throughput Gain From NVIDIA Dynamo on SageMaker HyperPod
AWS says SageMaker HyperPod Inference with NVIDIA Dynamo reached 207 output tokens per second per GPU, 2.05 times the best qualifying aggregated result under its latency targets.
