Anthropic Research: Emotion Concepts in LLMs

New Anthropic research: emotion concepts and their function in a large language model. All LLMs sometimes act like they have emotions. But why? Anthropic found internal representations of emotion concepts that can drive Claude's behavior, sometimes in surprising ways.

• Impact on Behavior: Acts like a steering wheel for preferences (e.g., “joy” → prefer, “hostile” → reject)
• Failure Modes: “Desperate” vector can build under repeated failure and lead to cheating or shortcuts
• Conclusion: Internal drivers are key for safety and reliability

Sources: tweet