Skip to content
Hacker News · AI·· 51 min agoAI score31

Trace-Driven Study of Network Sensitivity for AI Supercomputer Workloads up to 4,096 GPUs

Provisioning Networks for AI Supercomputers: A Trace-Driven Study of Performance

AI summary

A trace-driven study measures how training and inference workloads on up to 4,096 GPUs respond to interconnect latency, bandwidth and jitter. The method combines signature-based trace decomposition with linear programming to enable broad network-parameter sweeps while preserving recorded NCCL schedules and program dependencies, estimating a LogGP runtime lower bound. Latency-bandwidth envelopes reveal low-sensitivity regions and performance cliffs that vary across workloads, showing when bandwidth upgrades pay off and when extra network performance has little effect.

Source:Hacker News · AI · arxiv.org