For years, the open-weight community lived by a simple rule: you could have privacy, or you could have frontier intelligence, but not both at the same time. The best models you could download and run yourself were always a visible step behind the closed giants. Good enough for many tasks, but not the hard ones.
Kimi K3 is the model that makes that rule feel outdated.
Moonshot AI released the full weights on July 27, 2026, and the numbers are startling. 2.8 trillion parameters organized as a mixture-of-experts architecture — 896 experts, of which 16 fire on any given token (104 billion active). A built-in vision encoder called MoonViT-V2 lets the model read screenshots, diagrams, charts, documents, and video frames natively. The context window stretches to one million tokens, roughly ten full novels. And the whole thing sits under a Modified MIT license that permits commercial use.
Independent evidence backs the capability claim. Artificial Analysis — the closest thing the AI field has to a neutral umpire — ranks K3 at roughly 80 out of 100 on its Intelligence Index, placing it #5 among 215 models worldwide. That puts it within three points of Claude Fable 5, a closed model that costs real money to use. No other open-weight model has reached that neighborhood.
The architecture story
The raw parameter count is the headline, but the engineering underneath deserves attention. K3 is built on two ideas Moonshot calls Kimi Delta Attention (KDA) and Attention Residuals. KDA is an efficient attention mechanism that scales better than standard approaches; Attention Residuals selectively retrieve information across the model’s depth rather than accumulating it uniformly. Together, Moonshot reports roughly a 2.5× improvement in scaling efficiency compared to K2.
What that means in practice: the model uses its enormous parameter budget more intelligently than a naive scale-up would. It also ships with native MXFP4 quantization — the weights are stored at 4-bit precision with 8-bit activations, and this compression was baked in during training rather than applied as an afterthought. That is why the model can run at all on “only” eight H100s instead of requiring an entire data center at full precision.
Why it is not #1 in this category
Here is the honest tension. Kimi K3 is the most capable open-weight model on Earth. It is also the least practical model in this category for most readers.
The MXFP4 weights total roughly 1.4 terabytes. The minimum experimental configuration Moonshot describes requires eight H100 80 GB GPUs — 640 gigabytes of VRAM, which is roughly $200,000 worth of hardware at current prices. Production serving wants 64 or more accelerators across multiple nodes connected by high-bandwidth interconnects. That is not a workstation. That is a small supercomputer.
Contrast that with GLM-5.2, the current #1 in this category. GLM-5.2 is a 744-billion-parameter model (about 40 billion active) that fits in roughly 241 gigabytes with aggressive 2-bit quantization — within reach of a Mac Studio with 256 GB of unified memory, or a dual-GPU workstation. It carries a clean MIT license. It has months of independent community validation, including a #1 ranking on Design Arena’s coding leaderboard.
K3 wins on raw intelligence, multimodal capability, and sheer scale. GLM-5.2 wins on everything that determines whether a normal person or small team can actually use it. For a category called “Local / Private AI,” that practical difference is decisive — which is why K3 enters at #2, not #1.
What K3 is genuinely good at
Setting aside the hardware question, the capability profile is impressive. On Moonshot’s first-party evaluations, K3 reaches FrontierSWE 81.2% (real software-engineering tasks on large repositories), Terminal-Bench 88.3 (command-line agent competence), and GPQA Diamond 93.5 (graduate-level science reasoning). On a kernel-optimization benchmark, Moonshot reports that K3 substantially outperformed GPT-5.6 Sol, GPT-5.5, and Opus 4.8 — though these are company-reported figures that await independent confirmation.
The native multimodal capability is the feature that most clearly separates K3 from GLM-5.2 in this category. GLM-5.2 is text-and-code only. K3 reads images, screenshots, charts, and video. For self-hosted workflows that involve visual input — parsing a PDF, debugging a user interface from a screenshot, analyzing a data visualization — K3 handles it natively without bolting on a separate vision model. That is a real architectural advantage for teams building multimodal pipelines behind their own firewall.
The deployment reality
If your organization already operates a GPU cluster — a research lab, a cloud company, an enterprise AI team — the deployment story is surprisingly mature for a day-old release. vLLM published a production-scale support preview on July 22, complete with KDA prefix-caching optimizations that Moonshot contributed back to the open-source community. SGLang, Docker, Together AI, and HuggingChat all offer immediate paths to serve the model. The tooling is not a barrier; the hardware is.
For everyone else, the Moonshot API offers the same model at $3 per million input tokens and $15 per million output tokens (with cached input at $0.30). That is a reasonable price for frontier-class work, but it does defeat the purpose of a “local AI” ranking: the data leaves your machine.
Known rough edges
Moonshot is admirably transparent about K3’s limitations in its own documentation. The model is sensitive to thinking-history mode — switching inference harnesses mid-session can destabilize output, which matters for teams that run multiple serving frameworks. It can also be excessively proactive, making autonomous decisions the user did not request. Moonshot recommends explicit constraints in system prompts or an AGENTS.md file to keep the model on task.
There is also a noticeable gap in user experience compared to polished closed products like Claude Fable 5 and GPT-5.6 Sol, as Moonshot itself acknowledges. The raw intelligence is there; the smoothness is not yet.
The bottom line
Kimi K3 is the model that proves the open-weight frontier has arrived. A downloadable brain that competes with the best closed models, reads images and video, and carries a commercial license is not a hypothetical anymore — it is a file on Hugging Face. The physics of running it (1.4 terabytes, eight H100s minimum) means most readers will admire it from afar, or reach it through an API rather than their own servers. But for the teams that have the infrastructure, and for everyone tracking where open AI is headed, K3 is the new ceiling — and the ceiling just moved up dramatically.