GRIP: Grounded Reasoning via Information-Restricted Premises
GRIP tries to make retrieved evidence matter by throttling what it can carry.
The paper names “query dominance” as a RAG failure mode, where a strong encoder lets the query overwhelm the latent state. GRIP keeps full query access for the decoder but pushes retrieved evidence through a severe stochastic bottleneck, so that channel must encode residual information not already in the query. The abstract reports gains across five reasoning benchmarks, about a 30x drop in a query-latent mutual-information diagnostic, and a 73% hallucination reduction. ArXiv · AI/CL/LG's note
The paper names “query dominance” as a RAG failure mode, where a strong encoder lets the query overwhelm the latent state. GRIP keeps full query access for the decoder but pushes retrieved evidence through a severe stochastic bottleneck, so that channel must encode residual information not already in the query. The abstract reports gains across five reasoning benchmarks, about a 30x drop in a query-latent mutual-information diagnostic, and a 73% hallucination reduction. ArXiv · AI/CL/LG's note
score 5