Hacker News · AI·· 12 h agoAI score34
e-means: A Faster k-means Variant and the Jevons Paradox of Cheaper Clustering
A short note on e-means and jevons paradox
AI summary
e-means is a new k-means variant that updates centroids continuously within each pass using mini-batches and exponential moving averages, reaching the test loss of full-batch k-means in 2.5 epochs instead of 25 on 10 billion DINO embeddings clustered into roughly 16.7 million clusters. It keeps the same objective and convex nearest-centroid geometry, with fitted scaling laws setting batch size and update rate automatically. The author argues cheaper runs mean trying more values of k rather than lower compute bills.
Source:Hacker News · AI · kovashikawa.com