AWS walks through a model improvement flywheel with SageMaker HyperPod Data Capture

AWS engineers demonstrate a complete loop on a single SageMaker HyperPod cluster using the new Data Capture capability, which records live inference inputs and outputs to Amazon S3 at three independent tiers. In the walkthrough, a Qwen2.5-3B-Instruct support-ticket router misses a newly launched air-conditioner line, Athena queries surface the blind spot, a SQL policy relabels the captured tickets, and a 60-second LoRA fine-tune on a second GPU lifts held-out accuracy from 83.9% to 100% with no regression on existing categories. The authors report no measurable latency difference between requests sent directly to vLLM and through the capture proxy.