Megadose The AI curve, compressed.

MemInStream: Memorizing or Merely Recognizing? Rethinking Streaming Video Memory Evaluation

· HF Daily Papers ·
MemInStream keeps questions models can answer from earlier video evidence but cannot solve through shortcuts.

Each question is tied to a specific evidence interval and checked for whether historical memory is necessary. Questions are retained only if models can answer from that evidence but cannot resolve them using recent footage, post-evidence footage or text alone. The protocol aims to separate forgetting from failures to understand the video. It tests episodic retrieval, state tracking and updating, integration of multiple pieces of evidence, and contextual memory.

HF Daily Papers' note

score 5

Categories: Research