SEAL: LLMs That Update Their Own Weights

What if an LLM could update its own weights? Meet SEAL: a framework where LLMs generate their own training data (self-edits) to update their weights in response to new inputs. Self-editing is learned via RL, using the updated model’s downstream performance as reward. https://x.com/jyo_pari/status/1933350025284702697.