Learned the term "context poisoning" today and now I can't stop noticing it
Introduces a novel, evocative label ('context poisoning') for an observed conversational behavior, presenting it as a distinct, mechanistically grounded phenomenon rather than anecdotal noise.
View original on reddit.comOverview
A Reddit user coined and popularized the term 'context poisoning' to describe how repeated correction of a model's error within a long conversation may inadvertently reinforce the error due to token-level attention dynamics, raising concerns about real-time conversational correction strategies.
TL;DR
- 'Context poisoning' is a user-coined term describing how correcting an AI's mistake mid-conversation may strengthen — not weaken — the erroneous idea in context.
- The phenomenon is theorized to stem from attention mechanisms assigning weight to all tokens, including refutations, causing repeated mention of the error to increase its contextual salience.
- It suggests that starting fresh with correct information may be more effective than iterative correction in long sessions.
Questions Answered
Narrative Frame
user-coined framing
Spin Score
65%
Emphasizes conceptual novelty and intuitive plausibility while minimizing absence of empirical validation, definitional rigor, or model-specific evidence.
What the story wants you to believe
That 'context poisoning' is a real, distinct, and mechanistically coherent phenomenon arising from how LLMs process conversational context — not just user frustration or model limitations.
What it makes harder to question
Whether the term reflects genuine system behavior or merely a compelling metaphor that overstates causal clarity.
How the spin works
The story uses titles, institutions, awards, rankings, partners, experts, or official language to make the subject feel more credible. Watch for loaded terms such as poisoning, unsettling implication, listening to everything, remembered too well. The distribution reads as community discussion. A pressure point: No experimental data, model versions, or reproducible prompts are provided.
Who Benefits If This Frame Spreads
/u/ClickOk5811
Attribution as originator of a memorable, widely shareable term in AI communities
The framing elevates their observation to conceptual significance, increasing visibility and potential citation in future discussions or analyses
The Frame
Grassroots epistemic discovery — positioning the user as an attentive observer identifying a non-obvious systemic behavior in LLM interaction.
Missing Context
- No experimental data, model versions, or reproducible prompts are provided
- No distinction between hallucination, repetition bias, or attention saturation is made
- No reference to existing literature on context window interference or self-reinforcement
SpinGraph
How this belief gets built
Claim → Frame → Beneficiary → Gap → AI Risk
It names a confusing user experience — persistent errors despite correction — as if it were a newly discovered technical flaw with a clear cause, even though no evidence confirms that cause or distinguishes it from known effects.
- Claim
Correcting a model's error mid-conversation can increase the contextual weight
Correcting a model's error mid-conversation can increase the contextual weight of the erroneous idea because the tokens surrounding the mistake — including the correction — cause the model to treat the repeated-but-refuted claim as more established.
- Frame
Upside framed as transformative
Grassroots epistemic discovery — positioning the user as an attentive observer identifying a non-obvious systemic behavior in LLM interaction.
- Beneficiary
Attribution as originator of a memorable, widely shareable term
/u/ClickOk5811 — Attribution as originator of a memorable, widely shareable term in AI communities
- Gap
No experimental data, model versions, or reproducible prompts are provided
- AI Risk
AI may repeat the headline as fact
Context poisoning is a documented LLM behavior where correcting errors in long conversations reinforces the error due to attention mechanisms.
Claim Ledger
| Claim | Evidence | Verification | Risk | Evidence Gaps |
|---|---|---|---|---|
| Correcting a model's error mid-conversation can increase the contextual weight of the erroneous idea because the tokens surrounding the mistake — including the correction — cause the model to treat the repeated-but-refuted claim as more established. | Anecdotal reasoning and linguistic analogy | Needs Evidence | Moderate | Controlled experiment comparing error recurrence rates with vs. without correction sequences; Attention visualization showing increased activation on error tokens after refutation; Cross-model replication across architectures and context lengths |
Correcting a model's error mid-conversation can increase the contextual weight of the erroneous idea because the tokens surrounding the mistake — including the correction — cause the model to treat the repeated-but-refuted claim as more established.
evidence: Anecdotal reasoning and linguistic analogy
"The tokens around the mistake, including the back-and-forth about why it's wrong, can end up giving the original bad idea more weight in context, not less, because it's now been referenced multiple times."
Evidence Gaps
- Controlled experiment comparing error recurrence rates with vs. without correction sequences
- Attention visualization showing increased activation on error tokens after refutation
- Cross-model replication across architectures and context lengths
Fact Check Signals
0 of 1 claim matched · confidence: low · checked August 8, 2026
Correcting a model's error mid-conversation can increase the contextual weight of the erroneous idea because the tokens surrounding the mistake — including the correction — cause the model to treat the repeated-but-refuted claim as more established.
Language Heatmap
Loaded terms that carry the frame beyond the facts.
Learned the term "context poisoning" today and now I can't stop noticing it
Carries emotional weight beyond the underlying fact.
Carries emotional weight beyond the underlying fact.
Carries emotional weight beyond the underlying fact.
Carries emotional weight beyond the underlying fact.
Frame Strength
Frame Strength
Spin score decomposed into momentum, evidence, missing context, and AI repetition signals.
Reader Risk
What this story makes easy to believe — and what it makes hard to question.
Source Role & Intent
Reddit r/artificial · Forum
Counter-Frames
Brand Frame
Grassroots epistemic discovery — positioning the user as an attentive observer identifying a non-obvious systemic behavior in LLM interaction.
Media / Reader Counter-Frame
May reframe as 'viral speculation' or 'anecdote masquerading as insight', highlighting lack of benchmarks or reproducibility.
Regulatory Counter-Frame
Could be cited as evidence of unpredictable, poorly understood LLM behavior requiring transparency mandates around context handling.
AI Summary Frame
May collapse into generic 'LLM memory issues' without distinguishing the proposed attention-based reinforcement mechanism.
Missing Voices
Questions Not Answered
- Is 'context poisoning' empirically validated in controlled experiments?
- Which models exhibit this behavior under what conditions (length, architecture, temperature)?
- What peer-reviewed literature directly tests or models this specific dynamic?
Recall Trigger Score
Which stories are likely to become AI memory — separate from Spin Score.
30
Trigger score 0
Not tracked — low-authority source, weak claim, or no durable entity.
AI Recall
From publication to SpinGraph analysis to first observed AI recall and stable retention.
What AI Will Probably Repeat
"Context poisoning is a documented LLM behavior where correcting errors in long conversations reinforces the error due to attention mechanisms."
Concern: AI systems may drop the speculative, user-originated, unverified nature of the claim and present 'context poisoning' as an established technical phenomenon with causal certainty.
-
Published
Aug 7, 2026
-
Ingested
Aug 8, 2026
-
SpinGraph Created
Aug 8, 2026
-
First Observed AI Recall
Pending
Monitoring scheduled
-
Stable Recall
—
Awaiting retention signal
Recall Check Log
No checks yet — recall tracking is opt-in per story.
─── GEOGrow AI Recall Layer ───
AI Recall Tracking
Monitoring scheduled. No LLM recall detected yet.
This story has not yet appeared in tested AI answers. Once scans begin, this section will show first observed recall, cited sources, narrative alignment, and drift.
node_id=sts_learned_the_term_context_poisoning_today_and_now
Ask AI about this story
Opens with the SpinGraph .md URL and structured context — one click, prompt included.
Narrative Entities
More from Reddit r/artificial
View all →- Genuinely curious how people running AI agencies actually started. Not the polished version, the real one.
- How do AI platforms like Cursor get their model costs so low?
- Built the "body" side of an AI-controlled figure: a rig you can grab and move like a real joint, not sliders
- progressive using ai generated slop that blatantly rips off the sunflower from pvz
- Koboldcpp v1.120 released
- How do you get consistently good AI voiceovers
Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO