Megadose Models, research, and what moved.

TokenGate: Adapting LLMs for Fast and Memory-Efficient Prefill with Learned Token Pruning

· ArXiv · AI/CL/LG ·

score 5

Categories: Research