Avoids using predefined vocabs and memory-heavy embedding tables. Instead, it uses Autoregressive U-Nets to embed information directly from raw bytes. This enables infinite vocab size and more. https:

Pfizer researchers argue that what looks like a collapse in AI reasoning may actually be an Agentic gap — models failing not in thought, but in action. When given tools, the same models crushed tasks

The paper documents a pattern they called Potemkins, a kind of reasoning inconsistency see figure below. They show that LLMs - even models like o3 — make these errors frequently. Gary Marcus: "You can