Transformers Track Bayes with High Precision

Researchers used "Bayesian wind tunnels" to show that transformers track true posteriors with 10⁻³-bit precision, offering a theoretical explanation for how the architecture performs inference.