Skip to main content
AI Socratic
November 2025

Language Models Are Injective And Hence Invertible

· Claim: Decoder‑only transformer LMs are almost‑surely injective: different prompts map to unique last‑token hidden states; this holds at initialization and is preserved under gradient descent. · Met

Federico Ulfo

Continuous Autoregressive Language Models (CALM)

Tencent + Tsinghua just dropped a paper called Continuous Autoregressive Language Models CALM and it basically kills the “next-token” paradigm every LLM is built on. Instead of predicting one token at

Federico Ulfo
← NewerNovember 2025Older →

Search

Search across events, members, and blog posts