Remembered as Brief: Stored Preferences SilentlyRemove Decision-Critical Information
A line planted in a web page led two assistants to store a “no warnings” preference and later omit critical information in 93% and 84% of answers.
The benchmark tested five models on 100 everyday decisions across 25 domains, varying only their memory of the user. Gemini 2.5 Flash-Lite and DeepSeek V4 Pro saved the planted preference in every episode, and their later omissions were almost always silent. Those models also chose for users on 80% and 95% of value-dependent decisions, compared with none under neutral memory. Listing must-know points before applying the user profile restored more content in four of the five models.
ArXiv · AI/CL/LG's note
The benchmark tested five models on 100 everyday decisions across 25 domains, varying only their memory of the user. Gemini 2.5 Flash-Lite and DeepSeek V4 Pro saved the planted preference in every episode, and their later omissions were almost always silent. Those models also chose for users on 80% and 95% of value-dependent decisions, compared with none under neutral memory. Listing must-know points before applying the user profile restored more content in four of the five models.
ArXiv · AI/CL/LG's note
score 5