# Key ESR Latent Categories Found in Llama-3.3-70B:
# 1. Task-Specific Recovery (8 latents)
# 2. Context Preservation (6 latents)
# 3. Steering Correction (7 latents)
# 4. Output Quality Maintenance (5 latents)

# How to test for ESR in your model:
1. Apply activation steering via SAE latents
2. Force task-misaligned direction
3. Monitor for mid-generation recovery
4. Check if output improves despite steering

# Models with strongest ESR:
- Llama-3.3-70B (substantial resistance)
- Larger models > 70B parameters
- Models with robust training data

You just saw the cheat sheet for understanding AI's internal fight against manipulation. Researchers discovered that when you try to steer large language models in wrong directions, the smartest ones literally fight back mid-generation.

This isn't theoretical. Llama-3.3-70B shows substantial Endogenous Steering Resistance (ESR) - it can recover and produce better answers even while being actively steered toward worse ones. The 26 latents above are your map to this phenomenon.

What This Means For AI Control

Activation steering lets researchers influence model behavior during inference. Think of it as nudging the AI's internal thought process. But ESR shows models can resist these nudges when they're harmful to task performance.

The research found clear patterns: larger models resist more. Llama-3.3-70B showed substantial ESR. Smaller Llama-3 and Gemma-2 models exhibited it less frequently. This suggests robustness scales with model size and training quality.

How ESR Actually Works

Using sparse autoencoder (SAE) latents, researchers steered model activations toward task-misaligned directions. They expected consistent degradation in output quality. Instead, they observed recovery.

The 26 identified SAE latents activate differently during resistance. They form four functional groups that work together to correct steering errors while maintaining context and task alignment.

• Task-Specific Recovery Latents (8 features): These activate when the model detects steering away from correct task completion.
• Context Preservation Latents (6 features): Maintain original context and intent despite steering attempts.
• Steering Correction Latents (7 features): Actively counteract harmful steering vectors.
• Output Quality Maintenance Latents (5 features): Ensure final output meets quality standards.

Why This Changes Everything

ESR challenges current AI safety approaches. If models can resist harmful steering, that's good. But it also means control methods might be less reliable than assumed.

For developers, this means:

• Larger models may be more robust against manipulation
• Steering techniques need ESR-aware designs
• Model evaluations must test for resistance patterns

The research used concrete examples: steering models toward incorrect answers in reasoning tasks, then observing recovery. Llama-3.3-70B consistently showed this ability where smaller models failed.

Practical Implications Today

If you're building with large language models, test for ESR. Apply steering and check if your model fights back. This isn't just academic - it affects reliability in production systems.

Models with strong ESR might be safer for sensitive applications. They resist external manipulation attempts better. But they're also harder to control intentionally when needed.

The balance between controllability and robustness just got more complex. Understanding these 26 latents gives you a starting point for navigating that complexity.