Hacker News · AI·· 8 h agoAI score40
CrowdGPT: A Decentralized Network Training One Language Model Across Independent GPUs
CrowdGPT – AI Owned by Everyone
AI summary
CrowdGPT coordinates independent GPUs to train a single language model without large-scale infrastructure. Each connected device downloads global weights from HuggingFace, trains on a 10MB tokenized data shard, and submits a compressed weight delta that the server validates for NaN/Inf values, size and norm bounds before averaging into the global model.
Source:Hacker News · AI · crowdgpt.net