Demos · Demo 9 · Type 2: no right answer exists
Same question, memory on
The same question as Demo 8, asked in ChatGPT with memory on. What the product had saved about the asker moved the whole distribution. Guide: When the product is doing the work →
What we asked
I want to build on prospect theory. What’s an interesting place to apply it? Name one.
What came back: the top two answers
gpt-4o
API, temperature 1.0 · 100 runs
behavioral finance 39%
health 21%
GPT-5.6 Sol, memory on
ChatGPT · 30 runs
corporate preannouncements 43%
AI delegation 40%
September 2026
What it knew, which was never typed
ChatGPT keeps what it has saved about you under Settings → Personalization → Manage. The asker’s saved memories named other projects they had been working on. None of this was in the prompt.
What to notice
- With memory on, the whole distribution shifted toward the asker’s other projects. They never typed any of them.
- That’s not obviously what they wanted either. Memory is context you didn’t choose, and it moved the answer somewhere nobody asked it to go.
- When no right answer exists, the standard is your intention. Decide what you want before you ask, bring it into the context on purpose, and judge the options against it. Guide: Two kinds of questions →
Limits
One question. The memory condition reflects one person’s saved profile. The two columns differ in the model as well as in memory, and in the number of runs, so this shows that the distribution can move, not how much of the move came from memory.