Stories tagged “moe” on AI Learning Ground Buzz.
Alibaba unveiled Qwen3.8-Max, a sparse mixture-of-experts model with 2.4 trillion total and about 95B active parameters aimed at coding and 'cowork' agent tasks, and committed to…
Alibaba Qwen
Moonshot AI published weights for Kimi K3, a 2.8-trillion-parameter mixture-of-experts model with about 104B active parameters, a 1M-token context window and native text, image…
Moonshot AI
Mistral Small 4 is a 119B-parameter mixture-of-experts model with about 6B active parameters per token, a 256k context window and image input, released under Apache 2.0. It…
Mistral AI
Z.ai launched GLM-5, a 744B-parameter mixture-of-experts model with about 40B active parameters, released with open weights under the MIT license. It targets complex systems…
Z.ai
