Megadose Signal over noise.

FuTransformer: FP8 prefill and INT4 decode for Llama-style inference on Hopper

· ArXiv · AI/CL/LG ·

score 5

Categories: Research