DeepSeek-V3.2-Exp

The experimental V3.2 build that pioneered sparse attentionThe mechanism inside a Transformer that lets the model weigh which parts of the input matter most when processing each word. When you read "the cat sat on the mat," attention is how the model knows that "it" in a later sentence refers back to the cat, not the mat. Attention is what made modern language models possible. for cheaper long context; MIT-licensed and now superseded by stable V3.2 and V4.