Sakana's Continuous Thought Machines (CTM) architecture

Continuous Thought Machines (CTM)

Sakana proposes a new neural architecture (CTM) built from the ground up to use neural dynamics as a core representation for intelligence. Using neural dynamics as a first class citizen, CTM shows some interesting emergent behavior. CTM are naturally easier to interpret.

CTM can decide to think less once it finds a pattern, using a process similar to how humans think, this enables to save energy.

https://x.com/hardmaru/status/1921751428508582329