INTELLECT–1: Launching the First Decentralized Training of a 10B Parameter Model 2024-10-16 · Primeintellect.ai
9 min We're excited to launch INTELLECT-1, the first decentralized training run of a 10-billion-parameter model, inviting anyone to contribute compute and participate. This brings us one step closer towards open source AGI.Recently, we published OpenDiLoCo, an open-source implementatio