Mixture of experts

3 entries between March 2026 and October 2026.

Every entry

  1. Aleph Alpha releases open-weight model Kolibri

    On 3 October 2026 Aleph Alpha released Kolibri, an English-German mixture-of-experts Transformer with 78.1B total parameters and 3.46B active, under Apache 2.0 on Hugging Face. Context reaches 1M tokens, and Merlin-Arthur withholds answers the context does not support.

  2. DeepSeek publishes its V4 model series under an MIT license

    DeepSeek published a preview of its V4 series on 26 April 2026, comprising V4-Pro at 1.6 trillion total parameters with 49 billion active and V4-Flash at 284 billion with 13 billion active, released under the MIT license with checkpoints on Hugging Face.

  3. Mistral releases Small 4 and joins Nvidia’s Nemotron Coalition

    Mistral AI released Mistral Small 4 on 16 March 2026, a 119-billion-parameter mixture-of-experts model with 6 billion active parameters, a 256,000-token context window and an Apache 2.0 license. It joined Nvidia’s Nemotron Coalition the same day.