Skip to content
Hacker News · AI·· 11 h agoPicksAI score88

Edge0 open-sources Edge0-145B and Edge0-120B on-device models with inference framework

Edge0-145B: Frontier AI Capabilities on Your Own Computer

AI summary

Edge0 open-sourced Edge0-145B and Edge0-120B along with its unified inference framework and deployment tools, claiming Edge0-145B is the first open-source 145B-parameter on-device model. The company reports 29GB peak memory, 1,100+ tokens/s prefill, 80+ tokens/s decode and roughly 120W typical power on a compatible laptop, with 128K–256K context. It cites internal scores of 64.6 on DeepSWE 1.1, 86.52 on Terminal-Bench 2.1, 90.4 on GPQA-Diamond and 80.6 on IFBench, and says weights are on Hugging Face with day-one support for macOS, Windows and Linux.

Why it matters

Edge0 open-sources a 145B on-device model that reports 29GB peak memory and 80+ tokens/s decode, offering a concrete data point on how far local inference can scale.

Source:Hacker News · AI · edge0.ai