Star Attention: Efficient LLM Inference over Long Sequences
Paper • 2411.17116 • Published • 53
llm attentions
-
-
MSA: Memory Sparse Attention for Efficient End-to-End Memory Model Scaling to 100M Tokens
Paper • 2603.23516 • Published • 50 -
TriAttention: Efficient Long Reasoning with Trigonometric KV Compression
Paper • 2604.04921 • Published • 114 -
Let ViT Speak: Generative Language-Image Pre-training
Paper • 2605.00809 • Published • 33 -
MobileMoE: Scaling On-Device Mixture of Experts
Paper • 2605.27358 • Published • 11