Llama 4 Maverick (Base)

Base pretrained variant of Meta's Llama 4 Maverick. Frontier-class MoEA model architecture that splits the model into many smaller specialized "expert" networks, only activating a handful per input rather than running the whole model every time. The practical effect: you get the knowledge capacity of a big model with the compute cost of a much smaller one. Mistral Large 3 and Mistral Small 4 are both MoE models. with 17B active parametersIn a Mixture of Experts model, the number of parameters that actually run for any given input, as opposed to the total parameter count that's stored. Mistral Large 3, for example, has 675B total parameters but only 41B active per query — meaning it runs at roughly the cost of a 41B dense model while drawing on 675B worth of knowledge. out of 400B total, 128 experts, natively multimodalA model that can handle more than one type of input or output — typically text plus images, sometimes plus audio or video. "GPT-4 Vision" and "Llama 3.2 11B Vision" are multimodal models that accept both text and images. A text-only model is called "unimodal" but nobody uses that term; text-only is the assumed default., 1M context — designed for fine-tuning at scale rather than direct chat use.