Concept · Building with AI
Attention degradation
Also called: context rot, context degradation, long context degradation, lost in the middle
The drop in an agent's sharpness as a session gets long. Each token's attention is spread over more material, important connections weaken, and the agent misses details it handled well earlier.
For example: Two hours into one session, the agent ignores a rule it followed perfectly in the first ten minutes.
Connects to 7
- Attention budget Concept
- Smart zone Concept
- Session Concept
- Context window Concept
- Clearing Concept
- Compaction Concept
- Attention relationship Concept