Llama 4 Scout (Base)

Base pretrained variant of Meta's Llama 4 Scout. Mixture-of-Experts architecture with 17B active parametersIn a Mixture of Experts model, the number of parameters that actually run for any given input, as opposed to the total parameter count that's stored. Mistral Large 3, for example, has 675B total parameters but only 41B active per query — meaning it runs at roughly the cost of a 41B dense model while drawing on 675B worth of knowledge. out of 109B total, natively multimodalA model that can handle more than one type of input or output — typically text plus images, sometimes plus audio or video. "GPT-4 Vision" and "Llama 3.2 11B Vision" are multimodal models that accept both text and images. A text-only model is called "unimodal" but nobody uses that term; text-only is the assumed default., designed for fine-tuning rather than direct chat use.