Concept 02 · 8 min
It doesn’t remember you. It rereads everything, every single time. Until the notepad is full.
Scroll to start
Scene 1
Every answer starts from zero
Sarah asks her assistant to summarize Mrs. Chen’s two emails, then follows up twice. Behind the assistant are two parts: the app you type into, and the model that writes the replies.
Sarah
Summarize Mrs. Chen’s two emails.
Attached:Email · reminderEmail · card feeAssistant
She paid invoice #2291 on Sept 3 but still got a reminder. And her card fee was charged twice in August.
Sarah
Draft a short apology.
Assistant
Dear Mrs. Chen, please accept our apologies for the reminder you received…
When Sarah sends her third message, what does the model receive?
The model has a goldfish’s memory: none. With every message, the app re-sends the whole conversation, and the model rereads it from the top.
Scene 2
The notepad has a size
Sarah’s Tuesday, request after request. Scroll to make the day go by, and keep an eye on the 9:02 message.
An animated notepad follows: Sarah’s messages pile in one by one, and once it is full the oldest fall out. The same steps are listed in the table below it.
| Time | Message | Tokens | In the notepad at 5:40 pm? |
|---|---|---|---|
| 9:02 | MessageMr. Miller moved our meeting to Thursday at 3 pm. | Tokens13 | In the notepad at 5:40 pm?No |
| 9:20 | MessageSummarize Mrs. Chen’s two emails.Attached:Email · reminderEmail · card fee | Tokens63 | In the notepad at 5:40 pm?No |
| 10:05 | MessageRewrite this paragraph of the quarterly report in plain language.Attached:Quarterly report | Tokens31 | In the notepad at 5:40 pm?Yes |
| 11:30 | MessageDraft a reminder for Mr. Novak: his invoice is 30 days overdue. | Tokens18 | In the notepad at 5:40 pm?Yes |
| 12:10 | MessageHow do I politely refuse a fee waiver? | Tokens11 | In the notepad at 5:40 pm?Yes |
| 2:00 pm | MessageSummarize these meeting notes.Attached:Meeting notes | Tokens33 | In the notepad at 5:40 pm?Yes |
| 3:20 pm | MessageTranslate my reply to Mrs. Chen into French.Attached:My reply | Tokens39 | In the notepad at 5:40 pm?Yes |
| 4:05 pm | MessageCheck this table for inconsistencies.Attached:Table | Tokens44 | In the notepad at 5:40 pm?Yes |
| 5:40 pm | MessageDraft a confirmation to Mr. Miller for our meeting. | Tokens11 | In the notepad at 5:40 pm?Yes |
| · | The app’s own pages | Tokens20 | In the notepad at 5:40 pm?Yes |
The draft
Dear Mr. Miller, I’m writing to confirm our meeting on [date] at [time]. Please tell me if anything changes. Kind regards, Sarah
not in the notepad
| Time | Message | Tokens | In the notepad at 5:40 pm? |
|---|---|---|---|
| 9:02 | MessageMr. Miller moved our meeting to Thursday at 3 pm. | Tokens13 | In the notepad at 5:40 pm?No |
| 9:20 | MessageSummarize Mrs. Chen’s two emails.Attached:Email · reminderEmail · card fee | Tokens63 | In the notepad at 5:40 pm?No |
| 10:05 | MessageRewrite this paragraph of the quarterly report in plain language.Attached:Quarterly report | Tokens31 | In the notepad at 5:40 pm?Yes |
| 11:30 | MessageDraft a reminder for Mr. Novak: his invoice is 30 days overdue. | Tokens18 | In the notepad at 5:40 pm?Yes |
| 12:10 | MessageHow do I politely refuse a fee waiver? | Tokens11 | In the notepad at 5:40 pm?Yes |
| 2:00 pm | MessageSummarize these meeting notes.Attached:Meeting notes | Tokens33 | In the notepad at 5:40 pm?Yes |
| 3:20 pm | MessageTranslate my reply to Mrs. Chen into French.Attached:My reply | Tokens39 | In the notepad at 5:40 pm?Yes |
| 4:05 pm | MessageCheck this table for inconsistencies.Attached:Table | Tokens44 | In the notepad at 5:40 pm?Yes |
| 5:40 pm | MessageDraft a confirmation to Mr. Miller for our meeting. | Tokens11 | In the notepad at 5:40 pm?Yes |
| · | The app’s own pages | Tokens20 | In the notepad at 5:40 pm?Yes |
The draft
Dear Mr. Miller, I’m writing to confirm our meeting on [date] at [time]. Please tell me if anything changes. Kind regards, Sarah
not in the notepad
The 9:02 message didn’t fade. It simply wasn’t in the notepad anymore. This notepad is the context window, measured in tokens (pieces of words). What falls out doesn’t exist for the model.
Scene 3
Pages you never see
Before your messages, the app adds pages you never see.
The app’s instructionsyou never see this
You are the bank’s assistant. Answer briefly. Never give investment advice.
Memory notessaved by the app
Sarah prefers bullet points.
The conversationwith its attachments
SarahSummarize Mrs. Chen’s two emails.
Attached:Email · reminderEmail · card feeAssistantShe paid invoice #2291 on Sept 3 but still got a reminder. And her card fee was charged twice in August.
…
Your new messagethe only one you typed
Mention the double charge too.
Its own instructions are called the system prompt, and sometimes it adds “memory” notes it saved about you. Memory doesn’t change the model: it’s a note put back in the notepad.
Scene 4
Save the meeting
Same Tuesday, your settings. Choose the notepad’s size and what to do about the 9:02 message, then run the day.
Challenges
- Get “Thursday at 3 pm” into the 5:40 pm confirmation, without the large notepad.
- Bonus: find where a summary loses a detail.
All three are tiny on purpose, so the day overflows.
Holds almost the whole day.
Run the day
Your 5:40 pm draft will appear here.
Every fix works the same way: put the fact back where the model reads. That’s all “memory” features do.
Scene 5
Habits that help
Treat the notepad like a desk: clear it often, keep the key facts on top.
Your conversation has lasted all day and the answers are drifting. What do you do?
New topic, new conversation: a clean notepad.
Put the key facts in your question, even if you gave them this morning.
For what must always be there, use the app’s pinned notes or project instructions.
Hype vs reality
- What the hype says
“It remembers everything you’ve told it.”
What actually happensIt rereads what still fits in its notepad. Memory features are notes the app slips back in.
- What the hype says
“It learns from our conversations.”
What actually happensTalking doesn’t change the model. Its training is frozen; only the notepad changes.
- What the hype says
“With a huge notepad, size doesn’t matter anymore.”
What actually happensBigger notepads cost more, answer slower, and details buried in the middle are easier to miss.
Under the hood
The app keeps the conversation. The model just rereads.
system = "You are the bank’s assistant. Answer briefly."history = []def ask(message): history.append(message) notepad = [system] + newest_that_fit(history, budget=8_000) # oldest fall out first reply = model(notepad) # it sees the notepad, nothing else history.append(reply) return replyThe budget is counted in tokens. Real ones range from a novel’s worth to several novels: big, never infinite.
In 3 sentences
- The model has no memory: the app re-sends the conversation with every message.
- What it can read at once is limited by its context window; whatever falls out doesn’t exist for it.
- To keep a fact, put it back in: pin it, summarize, or repeat it in your question.
Did this make sense?
0/9 concepts unmagicked
Go to the challenge- 01LLMAvailable · How can it write so well without understanding? · Available
- 02ContextAvailable · Why does it forget what I said earlier? · Available
- 03PromptAvailable · Why are my results mediocre? · Available
- 04HallucinationsAvailable · Why does it make things up? When can I trust it? · Available
- 05RAGAvailable · How do I make it use our internal documents? · Available
- 06ToolsAvailable · How can it act, not just talk? · Available
- 07AgentAvailable · What is an agent, concretely? · Available
- 08SkillsAvailable · How do we specialize it without retraining? · Available
- 09Limits & safetyAvailable · What must I never trust it with? · Available
Solve the sandbox challenge to unmagic this concept.
Next step
Why are my results mediocre?
Briefing a brilliant but amnesiac intern
Use this journey with your teamsScripted scenario, not a live model.