​Sequential Attention: Making AI models leaner and faster without sacrificing accuracy

Google Research introduced Sequential Attention, a method for reducing model compute while preserving accuracy.

Categories: Research

Read at source: https://research.google/blog/sequential-attention-making-ai-models-leaner-and-faster-without-sacrificing-accuracy/