Hacker News · AI·· 19 h agoAI score58
EU's open AI model EUROPA runs near-1T-parameter training trials on JUPITER supercomputer
Europa, the EU's open AI model, is aiming for nearly 1T parameters
AI summary
Domyn, the Milan company leading the EU-backed EUROPA consortium, ran training trials for the open model on the JUPITER supercomputer in Jülich, Germany, with a test setup of 951.9 billion parameters, more than double the European Commission's 400 billion minimum. The mixture-of-experts design splits the network into 384 experts with only 8 active per token, so 32.8 billion parameters are active per token, and Domyn says engineering fixes raised throughput from 90 to 1,293 tokens per second per GPU. Domyn has not released EUROPA's weights, and the post gives no date for the full training run, training data, license or benchmark results.
Source:Hacker News · AI · maccus.fr