Learning a Fact Is Not Learning How to Retrieve It
The paper separates knowing a fact from being able to call it up under different prompt forms.
The authors train models so one has prior experience with multiple request forms and another sees facts only as statements. When both later learn new facts as statements, they perform similarly on statement-style retrieval but diverge on other forms. The study links that gap to the “context state” just before the answer, showing that changing it can enable or block retrieval of a learned fact. ArXiv · AI/CL/LG's note
The authors train models so one has prior experience with multiple request forms and another sees facts only as statements. When both later learn new facts as statements, they perform similarly on statement-style retrieval but diverge on other forms. The study links that gap to the “context state” just before the answer, showing that changing it can enable or block retrieval of a learned fact. ArXiv · AI/CL/LG's note
score 5