Hacker News · AI·· 51 min agoAI score31
Trace-Driven Study of Network Sensitivity for AI Supercomputer Workloads up to 4,096 GPUs
Provisioning Networks for AI Supercomputers: A Trace-Driven Study of Performance
AI summary
A trace-driven study measures how training and inference workloads on up to 4,096 GPUs respond to interconnect latency, bandwidth and jitter. The method combines signature-based trace decomposition with linear programming to enable broad network-parameter sweeps while preserving recorded NCCL schedules and program dependencies, estimating a LogGP runtime lower bound. Latency-bandwidth envelopes reveal low-sensitivity regions and performance cliffs that vary across workloads, showing when bandwidth upgrades pay off and when extra network performance has little effect.
Source:Hacker News · AI · arxiv.org