Hacker News AI· Retro_Dev·· 47 min agoAI score40
CrowdGPT – AI Owned by Everyone
CrowdGPT – AI Owned by Everyone
AI summary
CrowdGPT describes how it coordinates independent GPUs to train a single language model: the server assigns each connected device a 10MB data shard and the current global weights, the client trains locally and computes a delta, and the server validates submissions for NaN/Inf values, size matching the architecture, and acceptable delta norms to prevent poisoning. Valid updates are averaged into the global model periodically, and weights are pushed to HuggingFace for public auditing and testing.
Source: Hacker News AI · crowdgpt.net