AWS Machine Learning Blog· Dan Ferguson·· 21 h agoAI score40
Amazon SageMaker JumpStart Model Leaderboard launches in SageMaker Studio
Introducing the Amazon SageMaker JumpStart Model Leaderboard
AI summary
AWS launched the Amazon SageMaker JumpStart Model Leaderboard in SageMaker Studio, letting users compare JumpStart models side by side on quality, speed, and cost. It reports AWS-run scores on BIG-Bench Hard, GPQA Diamond, and MMLU-Pro, plus measured time to first token, throughput, and instance cost. At launch it covers 70+ models from providers including Meta, Google, Qwen, IBM, and Arcee.
Source:AWS Machine Learning Blog · aws.amazon.com