Skip to content
AWS Machine Learning Blog· Dan Ferguson·· 21 h agoAI score40

Amazon SageMaker JumpStart Model Leaderboard launches in SageMaker Studio

Introducing the Amazon SageMaker JumpStart Model Leaderboard

AI summary

AWS launched the Amazon SageMaker JumpStart Model Leaderboard in SageMaker Studio, letting users compare JumpStart models side by side on quality, speed, and cost. It reports AWS-run scores on BIG-Bench Hard, GPQA Diamond, and MMLU-Pro, plus measured time to first token, throughput, and instance cost. At launch it covers 70+ models from providers including Meta, Google, Qwen, IBM, and Arcee.

Source:AWS Machine Learning Blog · aws.amazon.com