Skip to content
Hacker News · AI·· 19 h agoAI score58

EU's open AI model EUROPA runs near-1T-parameter training trials on JUPITER supercomputer

Europa, the EU's open AI model, is aiming for nearly 1T parameters

AI summary

Domyn, the Milan company leading the EU-backed EUROPA consortium, ran training trials for the open model on the JUPITER supercomputer in Jülich, Germany, with a test setup of 951.9 billion parameters, more than double the European Commission's 400 billion minimum. The mixture-of-experts design splits the network into 384 experts with only 8 active per token, so 32.8 billion parameters are active per token, and Domyn says engineering fixes raised throughput from 90 to 1,293 tokens per second per GPU. Domyn has not released EUROPA's weights, and the post gives no date for the full training run, training data, license or benchmark results.

Source:Hacker News · AI · maccus.fr