Sakana's Continuous Thought Machines (CTM) architecture
May 20, 2025Posted by Federico Ulfo
Continuous Thought Machines (CTM)
Sakana proposes a new neural architecture (CTM) built from the ground up to use neural dynamics as a core representation for intelligence. Using neural dynamics as a first class citizen, CTM shows some interesting emergent behavior. CTM are naturally easier to interpret.
CTM can decide to think less once it finds a pattern, using a process similar to how humans think, this enables to save energy.