Tag

#mixture-of-experts

8 posts

AI & Machine LearningJune 20, 20269 min
MiniMax M3: Open-Weight 1M-Context Coding Model
MiniMax M3 is an open-weight, 1M-context AI coding model with native multimodality and Sparse Attention. What its benchmarks, pricing, and license really mean.
AI & Machine LearningMay 17, 202616 min
China's Open-Weight Coding Wave: 4 Models, 18 Days
Four Chinese labs shipped open-weight coding models in 18 days. Inside the benchmarks, prices, and architectures reshaping agentic coding economics in 2026.
AI & Machine LearningMay 11, 202613 min
Chinese Open-Weight Coding LLMs: 2026's Three-Week Sweep
In 17 days, GLM-5.1, Kimi K2.6, and DeepSeek V4 shipped frontier-tier open-weight coding LLMs at a fraction of Western prices. Inside the April 2026 wave.
AI & Machine LearningMay 2, 202621 min
DeepSeek V4: Open-Weight Frontier at 1/7 the Cost
DeepSeek V4 ships 1.6T MoE open weights with 1M-token context: 80.6% on SWE-bench Verified at $1.74/$3.48 per million — roughly 1/7 the output cost of Claude Opus 4.7.
AI & Machine LearningApril 27, 202613 min
Kimi K2.6: Open-Weight 300-Agent Swarm Tops GPT-5.4 (2026)
Moonshot AI's Kimi K2.6 (April 20, 2026): a 1T-parameter open-weight MoE that orchestrates 300 sub-agents and tops GPT-5.4 on SWE-Bench Pro at 58.6%.
AI & Machine LearningApril 4, 202613 min
Gemma 4 Review: Apache-2.0 Open AI, 89.2% on AIME 2026
Google DeepMind's Gemma 4 family: 31B Dense scores 89.2% on AIME 2026, 26B MoE activates 3.8B/token, E2B fits in 1.5 GB. Apache 2.0, runs on your GPU.
AI & Machine LearningApril 1, 202612 min
Qwen3.5-Omni: Alibaba Omnimodal AI Model (2026)
Alibaba's Qwen3.5-Omni processes text, images, audio, and video natively with real-time speech output, 113-language recognition, and 215 SOTA audio subtasks.
LLM & IntegrationMarch 3, 202610 min
DeepSeek V3 Coding: Power, Pricing, and Practical Integration
DeepSeek V3 coding: 671B MoE, 82.6% HumanEval, competitive with GPT-4o and Claude 3.5 on coding benchmarks. Pricing, integration patterns, and real caveats.

Every post in #mixture-of-experts (8)