Ranked #2 Local / Private AI — Your Brain, Your Machine, Your Rules
Moonshot AI

Kimi K3

The first open-weight model that looks like a closed frontier brain. 2.8 trillion parameters of mixture-of-experts, native vision, a full million-token context, and a license that lets you run it commercially — all downloadable to a machine you control. The catch is the machine: it needs a datacenter, not a desk.

Updated July 28, 2026 Open WeightsModified MIT2.8T MoE
8.5out of 10
Official Website
Best for

The first open-weight model that looks like a closed frontier brain. 2.8 trillion parameters of mixture-of-experts, native vision, a full million-token context, and a license that lets you run it commercially — all downloadable to a machine you control. The catch is the machine: it needs a datacenter, not a desk.

Why It Wins

Largest open-weight model ever released. Artificial Analysis ranks it #5 globally (within 3 points of Claude Fable 5). Native multimodal vision and video understanding that no other open model in this category offers. Strong first-party coding scores — FrontierSWE 81.2, Terminal-Bench 88.3, DeepSWE 67.5. Modified MIT license permits commercial self-hosting with attribution. Day-0 deployment support from vLLM, SGLang, Docker, Together AI, and HuggingChat.

Watch out

The MXFP4 weights are roughly 1.4 terabytes. Experimental serving needs at least eight H100 80 GB GPUs; production wants 64 or more accelerators across multiple nodes. This is not a laptop, desktop, or single-workstation model. Most of the benchmark numbers are first-party — independent evaluations are still filling in after the July 27 drop. The custom license is not a clean MIT or Apache 2.0, and the model has known stability quirks around thinking history and over-eager autonomy.

01

What It Actually Is

For years, the open-weight community lived by a simple rule: you could have privacy, or you could have frontier intelligence, but not both at the same time. The best models you could download and run yourself were always a visible step behind the closed giants. Good enough for many tasks, but not the hard ones.

Kimi K3 is the model that makes that rule feel outdated.

Moonshot AI released the full weights on July 27, 2026, and the numbers are startling. 2.8 trillion parameters organized as a mixture-of-experts architecture — 896 experts, of which 16 fire on any given token (104 billion active). A built-in vision encoder called MoonViT-V2 lets the model read screenshots, diagrams, charts, documents, and video frames natively. The context window stretches to one million tokens, roughly ten full novels. And the whole thing sits under a Modified MIT license that permits commercial use.

Independent evidence backs the capability claim. Artificial Analysis — the closest thing the AI field has to a neutral umpire — ranks K3 at roughly 80 out of 100 on its Intelligence Index, placing it #5 among 215 models worldwide. That puts it within three points of Claude Fable 5, a closed model that costs real money to use. No other open-weight model has reached that neighborhood.

The architecture story

The raw parameter count is the headline, but the engineering underneath deserves attention. K3 is built on two ideas Moonshot calls Kimi Delta Attention (KDA) and Attention Residuals. KDA is an efficient attention mechanism that scales better than standard approaches; Attention Residuals selectively retrieve information across the model’s depth rather than accumulating it uniformly. Together, Moonshot reports roughly a 2.5× improvement in scaling efficiency compared to K2.

What that means in practice: the model uses its enormous parameter budget more intelligently than a naive scale-up would. It also ships with native MXFP4 quantization — the weights are stored at 4-bit precision with 8-bit activations, and this compression was baked in during training rather than applied as an afterthought. That is why the model can run at all on “only” eight H100s instead of requiring an entire data center at full precision.

Why it is not #1 in this category

Here is the honest tension. Kimi K3 is the most capable open-weight model on Earth. It is also the least practical model in this category for most readers.

The MXFP4 weights total roughly 1.4 terabytes. The minimum experimental configuration Moonshot describes requires eight H100 80 GB GPUs — 640 gigabytes of VRAM, which is roughly $200,000 worth of hardware at current prices. Production serving wants 64 or more accelerators across multiple nodes connected by high-bandwidth interconnects. That is not a workstation. That is a small supercomputer.

Contrast that with GLM-5.2, the current #1 in this category. GLM-5.2 is a 744-billion-parameter model (about 40 billion active) that fits in roughly 241 gigabytes with aggressive 2-bit quantization — within reach of a Mac Studio with 256 GB of unified memory, or a dual-GPU workstation. It carries a clean MIT license. It has months of independent community validation, including a #1 ranking on Design Arena’s coding leaderboard.

K3 wins on raw intelligence, multimodal capability, and sheer scale. GLM-5.2 wins on everything that determines whether a normal person or small team can actually use it. For a category called “Local / Private AI,” that practical difference is decisive — which is why K3 enters at #2, not #1.

What K3 is genuinely good at

Setting aside the hardware question, the capability profile is impressive. On Moonshot’s first-party evaluations, K3 reaches FrontierSWE 81.2% (real software-engineering tasks on large repositories), Terminal-Bench 88.3 (command-line agent competence), and GPQA Diamond 93.5 (graduate-level science reasoning). On a kernel-optimization benchmark, Moonshot reports that K3 substantially outperformed GPT-5.6 Sol, GPT-5.5, and Opus 4.8 — though these are company-reported figures that await independent confirmation.

The native multimodal capability is the feature that most clearly separates K3 from GLM-5.2 in this category. GLM-5.2 is text-and-code only. K3 reads images, screenshots, charts, and video. For self-hosted workflows that involve visual input — parsing a PDF, debugging a user interface from a screenshot, analyzing a data visualization — K3 handles it natively without bolting on a separate vision model. That is a real architectural advantage for teams building multimodal pipelines behind their own firewall.

The deployment reality

If your organization already operates a GPU cluster — a research lab, a cloud company, an enterprise AI team — the deployment story is surprisingly mature for a day-old release. vLLM published a production-scale support preview on July 22, complete with KDA prefix-caching optimizations that Moonshot contributed back to the open-source community. SGLang, Docker, Together AI, and HuggingChat all offer immediate paths to serve the model. The tooling is not a barrier; the hardware is.

For everyone else, the Moonshot API offers the same model at $3 per million input tokens and $15 per million output tokens (with cached input at $0.30). That is a reasonable price for frontier-class work, but it does defeat the purpose of a “local AI” ranking: the data leaves your machine.

Known rough edges

Moonshot is admirably transparent about K3’s limitations in its own documentation. The model is sensitive to thinking-history mode — switching inference harnesses mid-session can destabilize output, which matters for teams that run multiple serving frameworks. It can also be excessively proactive, making autonomous decisions the user did not request. Moonshot recommends explicit constraints in system prompts or an AGENTS.md file to keep the model on task.

There is also a noticeable gap in user experience compared to polished closed products like Claude Fable 5 and GPT-5.6 Sol, as Moonshot itself acknowledges. The raw intelligence is there; the smoothness is not yet.

The bottom line

Kimi K3 is the model that proves the open-weight frontier has arrived. A downloadable brain that competes with the best closed models, reads images and video, and carries a commercial license is not a hypothetical anymore — it is a file on Hugging Face. The physics of running it (1.4 terabytes, eight H100s minimum) means most readers will admire it from afar, or reach it through an API rather than their own servers. But for the teams that have the infrastructure, and for everyone tracking where open AI is headed, K3 is the new ceiling — and the ceiling just moved up dramatically.

02

Strengths and honest limitations

Key Strengths

  • The largest brain you can download: At 2.8 trillion total parameters (104 billion active per token, selecting 16 of 896 experts), Kimi K3 is the biggest open-weight model ever published. Artificial Analysis places it at roughly 80 out of 100 on its Intelligence Index — #5 among 215 ranked models, and within three points of Claude Fable 5. No other model you can self-host comes close to that independent standing.
  • Native vision, not just text: Unlike GLM-5.2 and most open coding models, K3 ships with a built-in vision encoder (MoonViT-V2, 401 million parameters). It reads screenshots, diagrams, charts, documents, and even video frames. For self-hosted workflows that involve visual input — UI debugging, document analysis, chart reading — this removes the need to chain a separate vision model.
  • Coding scores that match closed leaders: Moonshot’s first-party evaluations report FrontierSWE 81.2%, Terminal-Bench 88.3, and DeepSWE 67.5. On a kernel-optimization task, K3 substantially outperformed GPT-5.6 Sol, GPT-5.5, and Opus 4.8 in Moonshot’s comparison. These are official numbers, but the Artificial Analysis ranking independently confirms that K3 belongs in the frontier conversation.
  • A license that permits commercial use: The Modified MIT license allows businesses to self-host, fine-tune, distill, and embed K3 in commercial products with attribution. It is not a clean Apache 2.0 or standard MIT — training data and pipeline are not published — but for teams that need a defensible commercial path, the terms are workable where many frontier alternatives offer none.
  • Day-0 deployment infrastructure already exists: vLLM published a production-scale support preview on July 22, complete with KDA prefix-caching optimizations contributed back to the community. SGLang, Docker, Together AI, and HuggingChat all offer day-zero paths. If your team already operates a GPU cluster, the tooling to serve K3 is not months away — it shipped with the weights.

Honest Limitations

  • This is a datacenter model, not a local one: The MXFP4 weights total roughly 1.4 terabytes. The minimum experimental configuration is eight H100 80 GB GPUs (640 GB of VRAM), and Moonshot recommends supernodes with 64 or more accelerators for production. For comparison, GLM-5.2 — the #1 in this category — fits in about 241 GB and runs on a high-end Mac Studio. Most people reading a ’local AI’ guide cannot host K3 on hardware they already own.
  • Independent validation is still early: The weights dropped on July 27, 2026. Artificial Analysis has published its composite ranking, but the full independent benchmark suite — SWE-Bench, LiveBench, Arena Elo across diverse tasks — is still filling in. Most of the detailed scores in K3’s model card are first-party. Treat them as strong signals, not settled verdicts, until independent evaluators complete their passes.
  • The license is modified, not standard: The Modified MIT terms permit commercial use with attribution, but they are not the clean, restriction-free MIT or Apache 2.0 that GLM-5.2 and Gemma 4 carry. Training data is not released, and the exact modified terms deserve a careful read before building a commercial product on top of the weights.
  • Known stability quirks: Moonshot’s own documentation warns that K3 is sensitive to thinking-history mode — switching inference harnesses mid-session can destabilize output. The model can also be excessively proactive, making autonomous decisions that the user did not request. Moonshot recommends explicit constraints in system prompts or an AGENTS.md file. These are manageable but real, especially in automated pipelines.
  • For most local-AI buyers, GLM-5.2 remains the better pick: K3 is more capable on paper, but GLM-5.2 runs on hardware a serious individual or small team can actually buy, carries a clean MIT license, and has months of independent community validation behind it. K3 takes the capability crown; GLM-5.2 keeps the practical one. That is why K3 enters at #2, not #1.
03

Benchmark Snapshot

Artificial Analysis Intelligence Index — ~80 (#5 of 215)

The strongest independent signal available. K3 ranks #5 globally and sits within three points of Claude Fable 5 — the first open-weight model to reach that neighborhood. Composite score; individual task breakdowns are still being published.

FrontierSWE — 81.2% / Terminal-Bench 2.1 — 88.3

First-party software-engineering and terminal-agent benchmarks. FrontierSWE measures real repository tasks; Terminal-Bench measures command-line competence. Strong numbers, but await independent confirmation after the weights settle.

GPQA Diamond — 93.5

Graduate-level science and reasoning questions. Near the top of any public leaderboard — open or closed. Signals that K3's intelligence extends well beyond coding into general reasoning.

Architecture — 2.8T MoE / 104B active

896 experts with 16 selected per token. Kimi Delta Attention plus Attention Residuals deliver roughly 2.5× scaling efficiency over K2. Native MXFP4 weights and MXFP8 activations with quantization-aware training baked in from the SFT stage.

04

The Verdict

Kimi K3 is the most capable open-weight model you can download — and that sentence is now true rather than aspirational. A self-hostable brain that ranks #5 globally on Artificial Analysis, reads images and video, holds a million tokens of context, and carries a commercial-use license is a genuine milestone. But milestones do not erase physics. The 1.4-terabyte footprint and eight-H100 minimum put this model out of reach for everyone except teams that already operate GPU clusters. GLM-5.2 stays #1 in this category because it delivers near-frontier coding intelligence on hardware a person can buy, under a clean MIT license, with months of independent validation. K3 takes #2 as the ceiling-pusher: the model that proves the open-weight frontier has arrived, even if most readers will reach it through an API rather than their own servers. If you have the infrastructure — or if raw capability is the only variable — K3 is the new open-weight king. If you are choosing one model to actually run locally, start with GLM-5.2.

05

Frequently Asked Questions