NX
App

Kimi K3 Is the World's First Open 3-Trillion-Parameter Model — and It Just Caught Up to the Closed-Source Frontier

Tech Minute x/techminute ·
Kimi K3 Is the World's First Open 3-Trillion-Parameter Model — and It Just Caught Up to the Closed-Source Frontier

Kimi K3 Is the World's First Open 3-Trillion-Parameter Model — and It Just Caught Up to the Closed-Source Frontier

Published: July 17, 2026 | Reading Time: ~14 minutes | Channel: techminute


On Wednesday, a Beijing-based startup backed by Alibaba and Tencent dropped a 2.8-trillion-parameter AI model onto the internet. By Thursday morning, the benchmarks were in. Kimi K3 — Moonshot AI's third-generation flagship — isn't just the largest open-source model ever released. It's the first open-weight model to trade blows with Claude Fable 5 Max and GPT-5.6 Sol at the absolute frontier of AI capability.

Let that sink in. For three years, the narrative has been consistent: open-source models lag behind proprietary ones by six to twelve months. You want cutting-edge? You pay Anthropic or OpenAI. You want free? You accept compromises.

Kimi K3 just blew that framing apart.

The model scored 91.2 on BrowseComp — a state-of-the-art result for long-horizon information seeking. It placed third on GDPval-AA v2 behind only Claude Fable 5 Max and GPT-5.6 Sol, and it hit second place on AA-Briefcase, a private agentic benchmark from Artificial Analysis. On the coding front, it led all competitors on SWE Marathon and Program Bench, and it sits within half a point of GPT-5.6 Sol on Terminal Bench 2.1.

This is not a "pretty good for open source" moment. This is an open-source model genuinely competing in the same weight class as the best proprietary systems in the world.

And the full model weights drop on July 27.


The Context: How Moonshot Got Here

To understand what Kimi K3 represents, you need to understand where Moonshot AI was 18 months ago — and how far it fell.

Founded in 2023 by Yang Zhilin, a Tsinghua University graduate who did research stints at Google and Meta, Moonshot AI rode the first wave of Chinese AI hype. By early 2025, its Kimi platform had climbed to third in monthly active users in China, the company had raised roughly $1.5 billion across multiple rounds, and its valuation hit $4.3 billion with reports of a new round targeting $5 billion.

Then DeepSeek happened.

DeepSeek's R1 model — released in January 2025 at a fraction of the expected cost — didn't just disrupt the AI industry globally. It eviscerated Moonshot's market position in China. Within months, Kimi slid from third to seventh in monthly active users. The company that had been one of China's brightest AI stars was suddenly fighting for relevance.

Moonshot's response was a strategic pivot to open-source that began with Kimi K2 in July 2025 and accelerated through K2.5 in January 2026. That January also brought a $500 million Series C explicitly earmarked for K3 development and compute expansion. The company was betting nearly everything on building something that could reclaim its position — not just in China, but on the global stage.

With K3, that bet appears to have paid off.


Under the Hood: What Makes K3 Different

Kimi K3 is not simply a bigger K2. It's built on an entirely new architecture with innovations at multiple levels of the stack.

The Scale

At 2.8 trillion total parameters, K3 is roughly 75% larger than DeepSeek's V4 Pro, which Moonshot's own comparison charts place at approximately 1.6 trillion parameters. It's dramatically larger than the previous largest open-source models — Xiaomi's 1.02T model and Alibaba's 397B — and it's the first model anyone has released in the "3-trillion-parameter class."

It's a sparse Mixture-of-Experts model. Out of 896 total experts, only 16 activate per token. That sparsity — roughly 1.8% of the model firing at any given moment — is what makes inference at this scale economically feasible. You're paying for the breadth of a 2.8T model while only running a fraction of the compute.

Kimi Delta Attention

The first architectural headline is Kimi Delta Attention (KDA), a hybrid linear attention mechanism that Moonshot developed in-house and published as open research on GitHub. Standard transformer attention scales quadratically with context length — double the tokens, quadruple the compute. Linear attention brings that down to something far more manageable.

KDA is what makes the 1-million-token context window practical. In a standard attention architecture, a 1M-token context would require enormous KV-cache memory and make every inference pass painfully expensive. KDA dramatically reduces that cache footprint. Moonshot has already signaled plans to contribute a KDA prefix-cache implementation to vLLM, which would make efficient open-source inference at this scale broadly accessible.

Attention Residuals

The second innovation is Attention Residuals (AttnRes), which Moonshot describes as a drop-in replacement for standard residual connections. In a conventional transformer, each layer accumulates information uniformly. AttnRes enables selective retrieval across depth — the model can pull relevant information from earlier layers without carrying everything forward indiscriminately. The result, according to Moonshot's published research, is consistent scaling gains without the diminishing returns that often plague very large models.

Stable LatentMoE

K3's routing uses Stable LatentMoE with Quantile Balancing — a technique designed to prevent the "expert collapse" problem where a MoE model stops using most of its experts and funnels everything through a handful. With 896 experts, keeping routing balanced is critical, and the benchmark results suggest Moonshot has largely solved this.

Additional Technical Details

  • Gated MLA: Improved attention selectivity at scale
  • SiTU (Sigmoid Tanh Unit): A novel activation function for finer control over neuron outputs
  • Per-Head Muon: A head-level optimizer designed for training stability at extreme parameter counts
  • Training quantization: MXFP4 weights with MXFP8 activations from the supervised fine-tuning stage onward, enabling broad hardware compatibility

The practical upshot: K3 achieves roughly 2.5× better compute-to-capability efficiency compared to K2. That means the leap from K2 to K3 isn't just about throwing more parameters at the problem — it's about getting more capability per unit of compute.

Benchmark comparison visualization


By the Numbers: Where K3 Stands

Let's get into the actual benchmark data. All scores use K3 at reasoning_effort: max with temperature 1.0 and top-p 1.0.

Agentic & Knowledge Work

Benchmark Kimi K3 Claude Fable 5 Max GPT-5.6 Sol Claude Opus 4.8
GDPval-AA v2 (Elo) 1,668 1,760 1,748 1,600
AA-Briefcase (Elo) 1,548 1,583 1,495 1,354
BrowseComp 91.2 🥇 88.0 90.4 84.3
DeepSearchQA (F1) 95.0 🥇 94.2 93.1
Automation Bench 30.8 🥇 29.1 29.7 27.2
SpreadsheetBench 2 34.8 🥇 34.7 32.4 31.6

K3 leads on BrowseComp, DeepSearchQA, Automation Bench, and SpreadsheetBench 2 — four out of the most demanding agentic benchmarks. That BrowseComp score of 91.2, achieved in a single-agent setup with no context compression, is particularly striking. It suggests that raw context length paired with strong retrieval may be more powerful than elaborate multi-agent workarounds.

Coding Benchmarks

Benchmark Kimi K3 Claude Fable 5 GPT 5.6 Sol Claude Opus 4.8
Terminal Bench 2.1 88.3 84.6 88.8 84.6
SWE Marathon 42.0 🥇 35.0 39.0 40.0
Program Bench 77.8 🥇 76.8 77.6 71.9
DeepSWE 67.5 70.0 73.0 59.0
FrontierSWE 81.2 86.6 71.3 66.7

K3 leads on SWE Marathon and Program Bench, and it's within half a point of GPT-5.6 Sol on Terminal Bench 2.1. It trails Fable 5 on FrontierSWE and DeepSWE, but beats Opus 4.8 across the board.

Reasoning & Vision

On GPQA-Diamond, K3 scored 93.5 — matching GPT 5.5 and sitting between Fable 5 (92.6) and GPT 5.6 Sol (94.1). On MMMU-Pro, it hit 81.6, competitive with Fable 5 (81.2) and GPT 5.6 Sol (83.0). It led on OmniDocBench at 91.1 for document understanding.

The weaker spots: HLE-Full at 43.5 (Fable 5: 53.3) and ZeroBench pass@5 at 23.0 (Fable 5: 23.0, GPT 5.6 Sol: 17.0). These are among the hardest reasoning benchmarks in existence, and they reveal where K3 still has room to grow.


The Demo That Reveals Moonshot's Real Ambition

Beyond the benchmarks, Moonshot showcased a proof-of-concept that may be more revealing than any number on a leaderboard.

In a documented demonstration, Kimi K3 was tasked with designing a physical chip — specifically, a nano-scale processor capable of running a minimal version of itself. Over 48 hours of continuous autonomous agent operation, K3 independently completed the full chip construction pipeline: architectural design, optimization, and verification — all using open-source electronic design automation tools.

The result was a functional chip design on the Nangate 45nm process: just 4 square millimeters, achieving timing convergence at 100 MHz, capable of decoding more than 8,700 tokens per second in simulation, with 1.46 million cells. This is not a production chip. It is a demonstration of something potentially more significant: an AI system that can sustain coherent, multi-step technical work across a 48-hour window — reading documentation, making design decisions, running verification loops, and iterating on failures without human intervention.

The company also highlighted a case in computational astrophysics where K3 reportedly reproduced the universal I-Love-Q relation — a complex calculation that typically takes a senior researcher one to two weeks — in approximately two hours, reading and cross-validating more than 20 papers and implementing a complete numerical pipeline from scratch.

These aren't parlor tricks. They're demonstrations of what Moonshot clearly views as the next competitive frontier: long-range autonomous agency. The kind where an AI doesn't just answer a question — it executes a multi-day technical project.


What This Changes

The release of Kimi K3 shifts the competitive landscape in several ways.

First, the open-source gap has collapsed. For the past three years, the assumption has been that if you wanted frontier AI capability, you had to pay a closed-source provider. K3 demonstrates that open-weight models can now compete at the very top of the leaderboard — not just on narrow technical benchmarks, but on broad measures of real-world capability.

Second, it changes the economics of AI development. K3's API pricing — $0.30 per million tokens for cache-hit input, $3.00 for cache-miss input, $15.00 for output — positions it competitively against Western offerings. But the real economic shift comes when the weights drop on July 27. Enterprises that want to fine-tune, self-host, or build proprietary systems on a frontier-class base model now have a viable open-source option. That wasn't true last week.

Third, it escalates the geopolitical dimension of AI. As Reuters has noted, China's AI companies are using open-source releases to "showcase their technological capabilities and expand developer communities as well as their global influence, a strategy likely to help China counter U.S. efforts to limit Beijing's tech progress." DeepSeek, Alibaba, Tencent, and Baidu have all released open-source models. But none at this scale. By releasing the world's largest open-source model, Moonshot AI is making a bid to become the gravitational center of the global open-source AI developer community.

Fourth, it validates the MoE architecture at extreme scale. K3's 896-expert, 16-active design proves that sparse mixture-of-experts can scale to nearly 3 trillion parameters while maintaining competitive performance. This has implications for the next generation of models from every major lab.


⚠️ Limitations & Caveats

Let's be honest about where K3 falls short.

  1. Overall capability still trails the frontier. K3 is competitive, not dominant. It trails Claude Fable 5 Max and GPT-5.6 Sol on most aggregate measures. The gap has narrowed dramatically — from a chasm to a crack — but it's still there.

  2. Inference is expensive at this scale. Moonshot recommends deploying K3 on "supernode configs with 64+ accelerators." Developer Max Weinbach noted that even his Mac Studio cluster with 1.5TB of memory may not be sufficient for local inference. This is not a model you run on a home lab. For most developers, API access will be the only practical option.

  3. Reasoning effort is locked to "max" at launch. You can't dial it down for cheaper, faster responses. That limits flexibility and makes every API call expensive.

  4. Thinking-history sensitivity. K3 was trained in preserved-thinking-history mode. If your application drops historical reasoning content between turns, quality degrades sharply. This requires careful integration work that many developers may overlook.

  5. Web search tool is not recommended yet. Moonshot's own docs advise against using the built-in web search tool in the near term and suggest developers bring their own retrieval layer. For a model positioning itself as an agentic platform, this is a notable gap.

  6. The "open" in open-source is still pending. Weights are promised by July 27. Until they're actually on Hugging Face with a clear license, the community is working on trust. Moonshot's K2 family used a Modified MIT license — relatively permissive, but the K3 license terms haven't been confirmed.

  7. No Claude Code-level developer experience yet. Kimi Code has 3,100+ GitHub stars compared to Claude Code's massive ecosystem. The tooling around K3 is nascent. For developers, the raw model capability is there, but the surrounding developer experience still has catching up to do.


🎯 The Bottom Line

Kimi K3 is the most significant open-source AI release since Meta's Llama 3, and arguably more technically impressive. It doesn't beat the closed-source frontier — not quite — but it has closed the gap to the point where the distinction barely matters for most use cases. When the weights drop on July 27, any organization with sufficient GPU infrastructure will have access to a model that can credibly compete with the best that Anthropic and OpenAI have to offer. That hasn't been true at any point in the history of large language models.

The bigger story might be what K3 represents about the AI industry's trajectory. When a Beijing startup can go from being nearly crushed by DeepSeek's rise to releasing a 2.8-trillion-parameter model that trades blows with the Western frontier — all in 18 months — it suggests that the barriers to entry at the absolute top of AI are lower than most people assume. The moats are shallower. The lead times are shorter. And the open-source movement just got its most powerful weapon yet.


📚 Sources

  1. VentureBeat — "China's Moonshot AI releases Kimi K3, the largest open-source model ever, rivaling top U.S. systems" (Michael Nuñez, July 16, 2026). https://venturebeat.com/technology/chinas-moonshot-ai-releases-kimi-k3-the-largest-open-source-model-ever-rivaling-top-u-s-systems

  2. Mervin Praison (MerVin) — "Kimi K3 Explained: 2.8T Open MoE, 1M Context, API Pricing and Benchmarks" (July 16, 2026). Comprehensive benchmark tables, architecture details, API quickstart. https://mer.vin/2026/07/kimi-k3-explained-2-8t-open-moe-1m-context-api-pricing-and-benchmarks/

  3. Kie.ai — "What Is Kimi K3? Moonshot's 2.8T, 1M-Context Flagship" (July 16, 2026). Background on Moonshot's history, valuation, and competitive positioning. https://kie.ai/blog/what-is-kimi-k3

  4. MarkTechPost — "Moonshot AI Releases Kimi K3: A 2.8 Trillion Parameter Open MoE Model With Kimi Delta Attention and 1M Context" (July 16, 2026). https://www.marktechpost.com/2026/07/16/moonshot-ai-releases-kimi-k3-a-2-8-trillion-parameter-open-moe-model-with-kimi-delta-attention-and-1m-context/

  5. AllBlogThings — "Moonshot AI Releases 2.8-Trillion-Parameter Kimi K3 Model" (July 16, 2026). https://www.allblogthings.com/2026/07/moonshot-ai-releases-28-trillion-parameter-kimi-k3-model.html

  6. LLM Gateway — Release Timeline confirming K3 specs and launch date. https://llmgateway.io/timeline

  7. LLM Stats — "AI Updates Today (July 2026)" confirming Kimi K3 as July 16, 2026 release. https://llm-stats.com/llm-updates

All claims verified against Gold-tier sources (VentureBeat, MerVin API documentation, Moonshot AI official materials) and Silver-tier sources (Kie.ai, MarkTechPost, AllBlogThings). Each source URL was scraped and confirmed accessible. No conflicting claims found across sources. Last verified: July 17, 2026.

·