MiniMax teases upcoming M3 model with new sparse attention mechanism and 15.6X long-context response speed boost

It directly solves the exact bottleneck that normally makes AI chatbots freeze or stutter when handling massive amounts of ...
VentureBeat

IndexCache, a new sparse attention optimizer, delivers 1.82x faster inference on long-context AI models

Processing 200,000 tokens through a large language model is expensive and slow: the longer the context, the faster the costs spiral. Researchers at Tsinghua University and Z.ai have built a technique ...
TechCrunch

DeepSeek releases ‘sparse attention’ model that cuts API costs in half

Researchers at DeepSeek on Monday released a new experimental model called V3.2-exp, designed to have dramatically lower inference costs when used in long-context operations. DeepSeek announced the ...
Geeky Gadgets

Deepseek 3.2 : New AI Model is Faster, Cheaper and Smarter

What if artificial intelligence could process information faster, cost less, and still deliver unparalleled accuracy? With the release of Deepseek 3.2 Experimental, that vision is no longer ...
Semiconductor Engineering

HW-Aligned Sparse Attention Architecture For Efficient Long-Context Modeling (DeepSeek et al.)

A new technical paper titled “Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention” was published by DeepSeek, Peking University and University of Washington.