Community Updates
A stream of short-form insights, takes, and news from the AI Socratic community.
Kind Bio: Growing Organs on Demand
🫁🫀 Organs on demand “By creating a series of genetic edits, Kind Bio can alter the development of an embryo so that it forms organs without also forming limbs, a central nervous system and brain. Th
More Biotech: Stem Cell Neuron & Two Neurons Talking
- Stem cell becoming a neuron — tweethttps://x.com/ScienceTechTV/status/2046260622300450840 - Two neurons having a conversation — tweethttps://x.com/InterestingSTEM/status/2046493875775107394
Google TurboQuant: 6x KV-Cache Compression with Zero Accuracy Loss
Google releases TurboQuant, a compression algorithm that reduces LLM key-value cache memory by at least 6x and delivers up to 8x speedup with zero accuracy loss. The technique combines online vector q
LLM Architecture Gallery
LLM Architecture Gallery ⭐️ Bookmark this: https://sebastianraschka.com/llm-architecture-galleryhttps://sebastianraschka.com/llm-architecture-gallery or get yourself a posterhttps://www.zazzle.com/llm
Meta FAIR Releases TRIBE v2: Brain Response Foundation Model
Meta FAIR Releases TRIBE v2: Foundation Model That Predicts Human Brain Responses Meta FAIR introduces TRIBE v2 Trimodal Brain Encoder, a foundation model trained on 500+ hours of fMRI recordings from
LeCun's Team Releases LeWorldModel: End-to-End JEPA from Pixels
Yann LeCun's Team Releases LeWorldModel: Stable End-to-End JEPA from Pixels LeCun's team releases LeWorldModel, solving a key bottleneck of Joint-Embedding Predictive Architectures JEPA by making them
Kimi: Attention Residuals
Kimi: Attention Residuals A more efficient way to reuse past information across layers without slowing models down. Sources: tweethttps://x.com/KimiMoonshot/status/2033378587878072424
TinyLoRA: Fine-Tuning 8B Models by Tweaking Just 13 Parameters
TinyLoRA: Fine-Tuning 8B Parameter Models by Tweaking Just 13 Parametershttps://x.com/avichawla/status/2036005875832549825, Researchers from Meta, Cornell, and CMU introduce TinyLoRA, scaling LoRA dow
Exclusive Self-Attention (XSA): Two-Line Change Improving Transformers
Exclusive Self-Attention XSA: Two-Line Change Improving Transformers Already Adopted in Practicehttps://x.com/askalphaxiv/status/2035841317763260596, Exclusive Self-Attention XSA proposes a tiny two-l
Anthropic Economic Index: How Claude Usage Evolves with Experience
Anthropic Economic Index: How Claude Usage Evolves with Experiencehttps://x.com/AnthropicAI/status/2036499691571953848, Anthropic's Economic Index reveals that longer-term Claude users iterate more ca