Decoupled DiLoCo
May 31, 2026Posted by Federico Ulfo
Google DeepMind published Decoupled DiLoCo, the next iteration of their distributed low-communication training method. It enables training across data centers (and potentially across the planet) with dramatically reduced inter-node bandwidth — a key unlock for the multi-region GPU fleets everyone is racing to build.
Sources: tweet, Google DeepMind