1 Trillion Parameter Model

Mistral ML4 Packs 1 Trillion Parameters, Open Weights Due in Three Weeks

Mistral unveils 1 trillion parameter ML4, trained on 4,000 Nvidia GPUs, with guarded access now and open weights planned after three weeks of testing.