Modal Blog· Erik Dunteman·· 25 d agoAI score58
Modal benchmarks NVIDIA Vera CPU: up to 2x sandbox throughput under load
NVIDIA Vera CPUs double throughput for Modal Sandboxes
AI summary
Modal benchmarked NVIDIA's new Arm-compatible Vera CPU server and measured up to double the task throughput of an equivalent x86 GNR machine, with per-task latency equal to or sometimes lower. The results come from Agentless Agent Bench, 50 Terminal-Bench oracle solutions and verifiers stripped of network calls and run in concurrent Docker containers. Modal attributes the gain to Vera holding its pace as concurrent containers accumulate, which it links to high memory bandwidth, and says supporting Arm would require changes across its infrastructure and image build system.
Source:Modal Blog · modal.com