Goodfire research essay argues neural networks are already clean and superposition was misread
Neural Networks Are Already Clean
เนื้อหานี้ยังไม่มีในภาษาของคุณ จึงแสดงเป็นEnglish
Goodfire researcher argues that the canonical evidence for polysemanticity and superposition in neural networks was misread, and that what looked like arbitrary packing is mostly a motif he calls recursive generalization. Retraining InceptionV1 with ordinary architectural improvements and no change to model size or training data made 99-100% of neurons in its last layer easily interpretable, and preliminary audits of Qwen3-32B estimate roughly 90% of neuron poles have one main job. The essay concludes networks use one learning principle rather than two, so interpretability can proceed by studying neurons and circuits directly instead of first training decomposition models such as sparse autoencoders.
A first-hand reinterpretation of the field's canonical polysemanticity evidence, arguing that networks generalize recursively rather than pack unrelated concepts, which would make direct mechanistic study viable.
แหล่งข่าว:Goodfire Research · goodfire.com