I’m a very heavy ChatGPT user. I use it across long-running conversations, research, technical troubleshooting, software/workflow development, and systems such as Aris Vault and Aris Ledger.
Recently I’ve noticed a recurring problem that bothers me more than ordinary hallucination: ChatGPT sometimes answers from plausible synthesis instead of checking an easily verifiable fact.
The answer often sounds completely coherent, but when challenged it becomes clear that the model has reconstructed what probably happened rather than retrieved what actually happened. I’ve also seen related issues with false recollection, context from one thread bleeding into another, and inferred details later being treated as if they were established facts.
At the same time, I’m genuinely happy to see ChatGPT’s memory and cross-conversation context improving. That continuity is extremely useful for the way I work. But paradoxically, I also seem to be seeing cross-context mix-ups much more frequently: a real fact from one conversation, person, project, or time period gets pulled into the wrong context and presented as though it belongs there. The fact itself may be correct; the association is wrong.
This is especially problematic in long-context use, where information may come from current chat, previous chats, memory, files, summaries, or inference. I increasingly find myself asking:
- Did I actually tell you this?
- Did you retrieve this or infer it?
- Can you find the original source?
- Are you sure, or does this just fit the context?
To compensate, I’ve developed some simple grounding habits. I use a RACC-style approach that separates evidence, explanation, and speculation, and encourages counter-verification. I also use a Fork Protocol, where multiple plausible interpretations are kept separate until evidence resolves them.
What I would most like to see is stronger provenance in ChatGPT: clearer distinction between retrieved fact, remembered context, external verification, and model inference.
For me, one of the most important improvements would be simple:
When verification is cheap, verify instead of synthesizing.
I would much rather hear “I can’t establish that” than receive a beautifully plausible reconstruction presented as fact.