The landscape
Not a scoreboard of vibes. Two industrial strategies, and a method for choosing a model that outlives the names.
Five rabbit holes. Only one of them has names in it.
Eighty minutes, five sections. Sections one and four are durable and should survive several years. Sections two and three contain the perishable material, confined to slides that carry their check date. Each section ends with four discussion questions; use them or skip them depending on the room.
What you can hold
A model is a file. Whether you can download it, what you may do with it, and what you still do not get: that is the whole topic.
Weights · licenceSection one defines the terms carefully, because the rest of the deck is useless if “open” means three different things in the room. Four slides: what weights are, what open weights are not, how to read a licence, and why any of this matters to a business.
Weights are the knobs. A model is a file of them.
Weights
The billions of numbers a training run produced (Part IV). They are the model, in the everyday sense. Copy the file, you have the model. There is no other secret.
Closed weights
The file stays in the vendor’s data centre. You rent its output by the token through an API. GPT, Claude, Gemini, Grok. You get a product; you never get the brain in a box.
Open weights
The file is published. Download it, run it on your hardware, inspect it, quantise it, fine-tune it, keep it forever. Qwen, DeepSeek, GLM, Kimi, Llama, gpt-oss, Mistral, Nemotron.
Open source (strict sense)
Weights, plus the training code, plus enough information about the data to rebuild it, under a licence that lets anyone use, study, change and share it. Almost nobody ships this.
Part I said it: open weights means you can take it home. It does not mean you know how it was made, or that you may do what you like with it.
Start with the object. Part IV showed that a language model is a very large function whose behaviour lives in billions of numbers, the weights, set once during training and frozen afterwards. Those numbers are a file. Everything in this deck follows from one question: do you get the file? If the answer is no, the model is closed. The vendor keeps the file in its own data centre and sells you its output by the token through an API. That is GPT, Claude, Gemini and Grok as products, and it is a perfectly good way to buy intelligence; most of this room uses it daily. If the answer is yes, the model is open weights. The file is published, usually on Hugging Face, and you can download it, run it on your own hardware or a cloud you control, inspect it, shrink it, adapt it with your own data and keep a copy for as long as you like. The third term is the one people confuse with the second. Open source, in the strict sense the Open Source Initiative defined in October 2024, requires the weights and the training code and enough information about the training data for a skilled person to rebuild the system, all under terms that let anyone use, study, modify and share it. Almost no serious model meets that bar, and the ones marketed as “open source” usually mean open weights. The distinction matters because the things you do not get, the data and the training recipe, are exactly the things that would tell you what the model is likely to be bad at. Next slide.
Open weights ≠ open source. Here is what you may not get.
| Closed API | Open weights (typical) | Open source (OSI definition) | |
|---|---|---|---|
| The weights file | No. You rent output. | Yes. Download and run anywhere. | Yes |
| Training code | No | Usually no. Inference code only. | Yes, complete |
| Training data | No. A paragraph in a model card at best. | Usually no. A “technical report” with totals. | Full description; public parts listed |
| Use it for any purpose | Within the vendor’s terms of service | Depends on the licence. Read it (next slide). | Yes, no field-of-use limits |
| Change and share it | No | Usually yes; some licences add conditions | Yes |
| Who can switch it off | The vendor, any day | Nobody, once you hold the file | Nobody |
The OSI says Llama’s licence is not open source and calls it “openwashing”. Meta disagrees. You do not have to referee; you have to read the column that applies to you.
This table is the deck’s first durable tool. Across the top are three ways a model can reach you. Down the side are the six things you might want. A closed API gives you none of the artefacts and all of the convenience; your rights are whatever the terms of service say today, and the vendor can retire the model, change the price, or change the behaviour whenever it likes. Open weights, in the typical case, gives you the file and the code needed to run it, almost never the training code, and almost never the data; what you get instead is a technical report with totals and a model card with a paragraph. Your right to use it for any purpose depends entirely on the licence attached, which is the subject of the next slide. The right-hand column is the Open Source Initiative’s definition, version 1.0, published 28 October 2024: parameters, complete training and inference code, and a full description of the training data including provenance, selection and processing, with the public portions listed, all under terms that grant the four freedoms to use, study, modify and share. The OSI has said Meta’s Llama licence fails that definition, because it discriminates between fields of use and users, and has accused Meta of openwashing; Meta rejects the definition. The Free Software Foundation classed the Llama 3.1 licence as non-free in January 2025. For a business, the last row is the one that matters most. Once you hold the file, nobody can switch it off. That single fact is the source of every advantage on slide seven.
Read the licence. It is the product.
| Licence family | What it lets you do | Who uses it (checked Oct 2026) |
|---|---|---|
| Apache 2.0 / MIT | Anything, commercially, forever. Keep the notice. No user caps, no revenue gates. | Qwen3.8-27B, DeepSeek, GLM-5.2, gpt-oss, Mistral Small 4 and Large 3, Muse Glimmer |
| Custom “community” licence | Commercial use, but with gates: a revenue or user threshold that triggers a separate deal, an attribution badge, an acceptable-use policy. | Llama (700M users), Muse Spark Open ($20M model-service revenue, “Built with…”), Kimi K3 ($20M), Qwen3.8-Max ($50M) |
| Research / non-commercial | Try it. Do not ship it in a product that earns money. | Some speech and image models (e.g. Mistral’s Voxtral TTS, CC BY-NC) |
| Proprietary | Nothing beyond what the API terms say. No file. | GPT, Claude, Gemini, Grok, Muse Spark (hosted) |
Gates bite at $20M–$50M of revenue or hundreds of millions of users. Most of this room will never hit one. Record which gate applies anyway; auditors ask.
An open-weights model is only as open as the text file sitting next to it. There are four families worth knowing. Apache 2.0 and MIT are the permissive standards from the software world: use it for anything, commercially, forever, keep the copyright notice, and in Apache’s case accept a patent clause. Alibaba’s Qwen3.8-27B, DeepSeek’s models, Z.ai’s GLM-5.2, OpenAI’s gpt-oss, Mistral’s Small 4 and Large 3 and Meta’s Muse Glimmer all ship this way, and Hugging Face’s August 2026 report counts 59% Apache and 22% MIT among the 178 Chinese releases above twenty billion parameters. The second family is the custom community licence, which looks permissive until a threshold. Meta’s Llama licence has long required a separate agreement from anyone with more than 700 million users; Meta’s Muse Spark Open licence of October 2026 requires a separate deal once you earn more than twenty million dollars in a year from offering AI models as a service, and a “Built with Muse Spark Open” badge; Moonshot’s Kimi K3 licence has a twenty-million-dollar model-as-a-service gate and an attribution requirement at a hundred million monthly users; Alibaba’s largest Qwen3.8 model carries a fifty-million-dollar gate for model-service businesses, with internal use exempt. All of these come with an acceptable-use policy. The third family is research-only or non-commercial, common for speech and image models. The fourth is proprietary: no file at all. The honest summary is that the gates are set high enough that most businesses will never trip one, and that you must still write down which licence you are under, because the day someone asks is the day you have no time to find out. The licence terms here are as reported in October 2026 and change with each release; check the LICENSE file in the repository you actually download.
Sources (8)
- https://huggingface.co/blog/state-of-open-models-summer-2026
- https://en.wikipedia.org/wiki/Llama_(language_model)
- https://ibl.ai/blog/meta-muse-spark-open-weight-licence-self-host-reality
- https://roo.beehiiv.com/p/kimi-k3-open-weights-license-benchmarks
- https://www.eweek.com/news/alibaba-qwen3-8-27b-license-apac-china/
- https://simonwillison.net/2026/jun/17/glm-52/
- https://www.theregister.com/2025/08/05/openai_open_gpt/
- https://en.wikipedia.org/wiki/Mistral_AI
Why a business should care. And what it costs.
A price ceiling
A free, good-enough model caps what anyone can charge you for the same job. Every closed price list is written with the open models in view.
Sovereignty
Local, VPC, on-prem, air-gapped: the data never leaves (Part II). A closed API can promise not to look. A file you hold cannot look.
Forkability
Fine-tune it, shrink it, bake your format in (Part I: form, not facts). Hugging Face counts 151,448 Qwen derivatives for a reason.
Vendor independence
Nobody can retire it, reprice it, or quietly change its behaviour. The version you tested is the version you run, for as long as you choose.
Open weights are an option you hold, not a commitment. The cheapest way to use the option is as a price in a negotiation.
Part I listed the reasons in a sentence each; here they are with their costs attached. The first reason is price. A free model that is good enough for a job puts a ceiling on what any vendor can charge for that job, and every closed price list on slide eighteen was written with that ceiling in view. You benefit from the ceiling even if you never run an open model, which is why the cheapest use of open weights is as a number in a negotiation. The second is sovereignty, the subject of Part II: when the file is yours, you can run it in a VPC, on-premises or on a machine with no network at all, and “our data never leaves” becomes a fact rather than a promise. The third is forkability. You can fine-tune the file for your format and tone (Part I’s rule: fine-tuning is for form, not facts), shrink it to fit cheaper hardware, or build on someone else’s fork; Hugging Face counted 151,448 derivatives of Qwen alone in August 2026. The fourth is independence. A version you hold cannot be retired, repriced or silently changed, and the model you tested is the model you run. The costs are real and the bottom half of the slide is the honest part. Operating a model means GPUs, drivers, quantisation choices and somebody awake at 3am; the fix is to rent hosted open models first and self-host only when sovereignty or volume demands it. Security moves onto your plate: the model is software you run, so sandbox it, patch its runtime and control where it can send data. And somebody has to read the licence and write down what it says. None of this is heavy. All of it is yours.
What are you actually holding today?
- List the models your organisation uses. For each: do you hold a file, or an API key? Who could switch it off?
- Which data in your business must never leave the building? Does that rule out any of the three columns on slide five?
- Has anyone read the licence of any model you run? Which gate applies, and who recorded it?
- If your main vendor doubled its price on Monday, what would you do on Tuesday?
Four questions to make the abstract concrete. The last one is the point of the section: the value of open weights is mostly the credible threat of using them.
Two races
Who has the best model this quarter, and who supplies the tokens the world runs. Different winners, different scoreboards.
Two scoreboardsSection two is Part I’s “it is not one race, it is two”, with the numbers updated to October 2026. The slides carry their dates. Four slides: the two races, the numbers, the dated map, and the American response.
It is not one race. It is two. They have different winners.
Who has the best model this quarter
- Measured by benchmarks, leaderboards and the thing you could not do last month.
- Mostly closed weights, mostly US labs, mostly priced at the top of the board.
- Loud: launches, demos, safety letters, $4 to $60 per million input tokens.
- The lead is real and it is short. US government testing (CAISI, Sept 2025) found the best US model ahead of DeepSeek on nearly every benchmark; the gap was 20–80% on software and cyber tasks, and close on science.
- This race decides what is possible.
Who supplies the world’s tokens
- Measured by tokens routed, files downloaded, derivatives built, products shipped.
- Mostly open weights, and as of 2026 mostly Chinese labs, hosted by anyone, anywhere.
- Quiet: a Hugging Face upload on a Friday, an Apache 2.0 licence, a price a tenth of the frontier.
- Chinese-lab models were 57–67% of tokens on OpenRouter in the week of 14 September 2026, up from 6–13% in February. Next slide for what that measures.
- This race decides what is cheap.
Part I: “the US is loud at one, China is winning the other.” Still true in October 2026. The buyer’s question is which race your job is in.
Part I put this in one line and it has held up well enough to repeat. There are two races, with different scoreboards. The capability race asks who has the single most capable model this quarter. It is measured by benchmarks and by the things you could not do last month, it is mostly run by closed-weight US labs, and it is loud and expensive. The lead is real: when the US government’s Center for AI Standards and Innovation tested DeepSeek’s V3.1 and R1 against GPT-5, gpt-oss and Claude Opus 4 in September 2025, the best US model was ahead on nearly every one of nineteen benchmarks, by twenty to eighty percent on software engineering and cyber tasks, and by very little on science and knowledge. The lead is also short, measured in months, and it decides what is possible rather than what you will buy. The distribution race asks who supplies the tokens the world actually runs. It is measured by tokens routed through platforms like OpenRouter, files downloaded from Hugging Face, derivative models built, and products shipped. It is mostly run on open weights, and as of 2026 those weights are mostly Chinese: CNBC reported on 26 September 2026 that models from Chinese labs took between 57 and 67 percent of OpenRouter tokens in the week of 14 September, depending on region, up from 6 to 13 percent in February. This race decides what is cheap. Most business jobs, the summarising, extracting, classifying and drafting that Parts III and VII describe, are in the second race. The occasional hard reasoning job is in the first. Knowing which is which is most of model selection.
The distribution race in three numbers. Dated.
of tokens on OpenRouter went to models from Chinese labs in the week of 14 Sept 2026 (range across US, Europe and the Global South). In February: 6–13%. On Vercel’s gateway: 55% in August, from 11% in January.
derivative models built on Qwen on Hugging Face by Aug 2026: 4.7× the Llama family. Alibaba says Qwen has passed 3 billion downloads; Hugging Face puts Google at 418M and Meta at 227M.
was the average weekly share of Chinese open models on OpenRouter across Nov 2024–Nov 2025, from 1.2% at the start. The same study put open weights at about a third of all usage by late 2025.
Checked October 2026. OpenRouter is one router, not the market; token share is not revenue share; Anthropic was the largest single US provider on it at 14.8% in July 2026. Appendix explains why the published percentages disagree.
Three numbers, each with its date and its definition, because this is the material that will be wrong soonest. The first is the headline. CNBC reported on 26 September 2026, from OpenRouter data, that models from Chinese labs accounted for between 57 and 67 percent of tokens in the week of 14 September, the range spanning companies in the United States, Europe and OpenRouter’s “Global South” grouping of 82 countries, where the share was 67 percent. In February the same measure was 6 to 13 percent. Vercel’s AI gateway reported 55 percent in August, from 11 percent in January. Part I quoted a June figure of roughly 61 percent; that was a share of the top ten models only, a different denominator, so the two numbers should not be compared directly. The second number is about building rather than running. Hugging Face’s August 2026 report counts 151,448 derivative models built on Qwen, 4.7 times the Llama family, and Alibaba says Qwen has passed three billion downloads across platforms, against Hugging Face’s figures of 418 million for Google and 227 million for Meta. The third number is the sober one. The OpenRouter and a16z study published in January 2026, covering a hundred trillion tokens from November 2024 to November 2025, found Chinese open models averaging 13 percent of weekly tokens over that year, from a start of 1.2 percent, and open weights overall at about a third of usage by late 2025. The jump from 13 to 60 happened in 2026. The caveats on the slide are not decoration: OpenRouter is one router with a developer-heavy customer base, token share is not revenue share, and Anthropic was still the largest single US provider on it at 14.8 percent in July. The appendix walks through why the various published percentages disagree.
Sources (7)
- https://www.cnbc.com/2026/09/26/china-ai-global-adoption.html
- https://www.digitaltoday.co.kr/en/view/107631/chinas-value-ai-models-speed-global-spread-washington-on-edge
- https://huggingface.co/blog/state-of-open-models-summer-2026
- https://fortune.com/2026/08/15/alibaba-qwen-open-ai-models-3-billion-downloads-meta-google/
- https://arxiv.org/abs/2601.10088
- https://finance.yahoo.com/technology/ai/articles/chinese-ai-models-now-capture-020440715.html
- https://aiweekly.co/alerts/chinese-ai-models-hit-record-58-of-us-openrouter-traffic
Who is on the field. Checked October 2026.
Part I’s map, redrawn in October 2026. The point is the shape, not the names. On the American side the frontier is closed and the money is in chips and distribution. OpenAI sells the GPT-6 family through its API and released gpt-oss under Apache 2.0 in August 2025, its first open weights since 2019. Anthropic sells Claude Opus, Sonnet and Haiku 5.5, all closed, and was the largest single US provider on OpenRouter in July 2026 at 14.8 percent. Google has Gemini, the open Gemma models, its own TPUs and the distribution of Search and Android. xAI, now inside Musk’s SpaceXSI, shipped Grok 4.7 in September; its Grok-1 was Apache 2.0 but later releases are source-available with commercial restrictions. Meta is the interesting one: Muse Spark, closed, replaced Llama in April 2026, then Meta released Muse Glimmer, a 30-billion-parameter model under Apache 2.0, in August, and Muse Spark Open, 816 billion parameters under a custom licence, on 15 October. Nvidia sells the pickaxes, has pledged about 26 billion dollars over five years to open-weight models, ships the Nemotron 3 family and agreed in September to buy Hugging Face for 12.93 billion dollars. Microsoft, Amazon and Apple matter more as hosts and channels than as model labs; Azure and Bedrock serve the Chinese open models from US data centres. On the Chinese side the pattern is open weights at low prices: DeepSeek’s V4 line under MIT, Alibaba’s Qwen with more than 460 open models and the largest derivative count on Hugging Face, Moonshot’s 2.8-trillion-parameter Kimi K3 with weights released in July under a custom licence, Z.ai’s GLM-5.2 under MIT in June, MiniMax, Tencent’s Hunyuan and ByteDance’s Seed. Everyone else includes Mistral in Paris, which raised three billion euros in September 2026 on a sovereignty pitch and ships Apache 2.0 models, plus labs in Canada, the UK, Israel and the Gulf that “US versus China” erases.
Sources (18)
- https://developers.openai.com/api/docs/pricing
- https://www.theregister.com/2025/08/05/openai_open_gpt/
- https://claude.com/pricing
- https://finance.yahoo.com/technology/ai/articles/chinese-ai-models-now-capture-020440715.html
- https://ai.google.dev/gemini-api/docs/pricing
- https://en.wikipedia.org/wiki/Grok_(chatbot)
- https://en.wikipedia.org/wiki/Muse_Spark
- https://dev.meta.ai/resources/blog/build-with-muse-spark-open
- https://analyticsindiamag.com/ai-news/nvidia-to-invest-26-bn-in-open-weight-ai-models-over-5-years
- https://techcrunch.com/2026/09/03/nvidia-confirms-it-will-buy-hugging-face-for-12-9-billion/
- https://thenewstack.io/openrouter-us-region-routing/
- https://fortune.com/2026/08/15/alibaba-qwen-open-ai-models-3-billion-downloads-meta-google/
- https://roo.beehiiv.com/p/kimi-k3-open-weights-license-benchmarks
- https://simonwillison.net/2026/jun/17/glm-52/
- https://huggingface.co/blog/state-of-open-models-summer-2026
- https://techcrunch.com/2026/09/08/mistral-raises-e3b-as-sovereign-ai-becomes-big-business/
- https://en.wikipedia.org/wiki/Mistral_AI
- https://benchlm.ai/deepseek/api-pricing
The US is answering in the second race, with money.
OpenAI: gpt-oss
120B and 20B open-weight reasoning models under Apache 2.0, the first since GPT-2. Runs on one 80 GB GPU, or 16 GB for the small one. Delayed for safety testing.
Nvidia pledges $26B
About $26B over five years for open-weight models, per a filing reported by Wired. Nemotron 3 Super (120B) in March; Nemotron 3 Ultra (561B) the largest US open model of 2026.
Meta returns to open
After going closed with Muse Spark, Meta releases Muse Glimmer (30B, Apache 2.0) in August and Muse Spark Open (816B, custom licence) on 15 Oct. Llama is history.
Nvidia buys Hugging Face
$12.93B for the platform that hosts 3M+ models. Huang: it “will remain an open platform for the entire AI ecosystem.” The open layer now has an American landlord.
Routing, not banning
OpenRouter’s US In-Region Routing serves Chinese open models from US data centres only; Baseten, Fireworks and Azure host them. Where it runs becomes a setting.
Still, in almost every month of 2026 the largest open model from a Chinese lab was bigger than anything an American lab released. The response is real; the gap is not closed.
Part I said the US was responding rather than setting the table. Three months on from Part I, the response has a shape, and it is money rather than law. OpenAI released gpt-oss in August 2025: two open-weight reasoning models, about 117 and 21 billion parameters, under Apache 2.0, the company’s first open weights since GPT-2 in 2019, delayed several times for safety evaluation; the large one runs on a single 80-gigabyte GPU and the small one in 16 gigabytes. Nvidia, which profits whichever lab wins, has pledged roughly 26 billion dollars over five years to open-weight models according to a 2025 filing reported by Wired, shipped Nemotron 3 Super in March 2026 and the 561-billion-parameter Nemotron 3 Ultra, which Hugging Face records as the largest American open release of the year. Meta’s path has been the strangest. It replaced Llama with the closed Muse Spark in April 2026, after CNBC reported in December 2025 that its next model, codenamed Avocado, might ship proprietary; then it released Muse Glimmer, a 30-billion-parameter multimodal model under Apache 2.0, on 10 August, and Muse Spark Open, an 816-billion-parameter mixture-of-experts model with a one-million-token window under its own Muse Model License, on 15 October. In September Nvidia agreed to buy Hugging Face, the platform where all of this is published, for 12.93 billion dollars, with Jensen Huang promising it would stay open to every framework, cloud and model. And the market built its own answer to the geopolitics: OpenRouter’s US In-Region Routing, generally available in September, serves Chinese open models only from providers operating in US data centres. The takeaway is the honest one from Hugging Face’s data: in almost every month of 2026 the largest open model from a Chinese lab was larger than any American release. The response is real. The gap is not closed.
Sources (8)
- https://www.theregister.com/2025/08/05/openai_open_gpt/
- https://analyticsindiamag.com/ai-news/nvidia-to-invest-26-bn-in-open-weight-ai-models-over-5-years
- https://huggingface.co/blog/state-of-open-models-summer-2026
- https://en.wikipedia.org/wiki/Muse_Spark
- https://dev.meta.ai/resources/blog/build-with-muse-spark-open
- https://www.eweek.com/news/meta-new-avocado-model/
- https://techcrunch.com/2026/09/03/nvidia-confirms-it-will-buy-hugging-face-for-12-9-billion/
- https://thenewstack.io/openrouter-us-region-routing/
Which race are your jobs actually in?
- Of the model calls your business makes, how many need this quarter’s best model, and how many need last year’s at a tenth of the price?
- If a Chinese open model and a US closed model tie on your test set, what decides it? Price, data residency, procurement, politics?
- Would your board know the difference between a model made in China and a model made in China and hosted in Virginia?
- Part I asked whose model you would stand up a product on tomorrow. Has your answer changed in three months?
The third question is the one to linger on; it sets up section four. The distinction between where a model was made and where it runs is the hinge of the whole adoption-versus-security-incident debate.
Money and chips
How a token is priced, why the price collapsed, what the board says this month, and the one physical constraint under all of it.
Tokens · siliconSection three is the economics. Four slides: how pricing works, the price collapse, the dated current board, and chips. Only the board slide carries product prices; the rest is mechanism.
Four prices on every token. One is advertised.
Input tokens
Everything you send: instructions, documents, the chat so far. Re-sent on every call (Part IV). The headline price.
Cached input
The same prefix sent again within minutes is read from a cache at roughly a tenth of the input price. Big for agents and long system prompts.
Output tokens
What comes back. Priced about 5× input across vendors. Reasoning models bill their hidden thinking as output.
Batch / flex
Not urgent? Submit a file, get answers within hours, pay half. OpenAI, Anthropic and Google all offer it.
Cost per job, not per token
A $0.10 model that needs three retries and a human check can cost more than a $2 model that gets it right. Price the job on your eval (Part VII), then multiply.
The cheapest adequate model wins
For any job your test set can score, the right model is the cheapest one that passes. Most business jobs pass at the bottom of the board. Frontier is for the ones that don’t.
Ratios are durable, numbers are not
Output ≈ 5× input. Cache ≈ 1/10. Batch = 1/2. Open ≈ 1/4 to 1/100 of frontier. Remember the ratios; look up the numbers.
Rule: an agent that re-reads a 20-page prompt 40 times pays 40 input bills. Caching and a cheaper model fix that; a better prompt does not.
Every API prices a token four ways, and only the first is on the billboard. Input tokens are everything you send: the instructions, the documents, the conversation so far, re-sent in full on every call as Part IV explained. Cached input is the same prefix sent again within a few minutes; vendors keep it warm and charge roughly a tenth of the input price to read it back, which matters enormously for agents that call the model forty times with the same twenty-page system prompt in front. Output tokens are what comes back, priced about five times input across the major vendors, a ratio that has been stable for years; reasoning models bill their hidden thinking as output, which is why a “thinking” answer can cost ten times a plain one. Batch or flex pricing is for work that is not urgent: submit a file, get the answers back within hours, pay half; OpenAI, Anthropic and Google all offer a fifty percent discount for it in October 2026. The three cards turn this into a buying rule. First, price the job, not the token: a very cheap model that needs three retries and a human check can cost more than a mid-priced model that gets it right, and the only way to know is to run your own test set from Part VII and multiply. Second, for any job your test set can score, the right model is the cheapest one that passes; most business jobs pass well below the frontier, and the frontier is for the ones that do not. Third, remember ratios rather than numbers, because the numbers on the next slide will be stale by the time anyone reads this chapter.
The price of fixed capability has collapsed.
per year: how fast the price to reach a fixed benchmark score fell over 2022–2025, depending on the benchmark. GPT-4-level science (GPQA) got about 40× cheaper per year.
cheaper than the leading Anthropic and OpenAI models: OpenRouter’s description of Chinese open models in July 2026. DeepSeek’s Flash was then $0.14 per million input tokens against GPT-5.5’s $5.
cut in inference cost reported by Lindy after moving most of its agent traffic from Claude Sonnet to DeepSeek V4 Flash in June 2026, after offline evals and prompt re-tuning. Self-reported.
Epoch’s own caveat: the fastest declines were the most recent and may not persist. Plan on cheaper. Do not plan on free.
The single most important economic fact in this series is that the price of a fixed amount of capability keeps falling, fast. Epoch AI measured it properly in March 2025: take a benchmark score, say GPT-4’s level on the GPQA Diamond science test, and track the cheapest model that reaches it over time. The price to hit a fixed score fell between nine and nine hundred times per year depending on the benchmark and the level, with the GPT-4-on-GPQA milestone falling about forty times per year. Epoch’s own caveat is on the slide: the steepest declines were the most recent, and they may not persist; the series stops in early 2025, and nobody has published an equally careful update that we could find. The second number is the open-weights discount in 2026. OpenRouter’s Justin Summerville told CNBC in July that Chinese open models were sixty to ninety percent cheaper than the leading Anthropic and OpenAI models; at that time DeepSeek’s Flash model cost fourteen cents per million input tokens against five dollars for GPT-5.5. The third is a worked example. Lindy, an AI-agent company, wrote up in June 2026 how it moved most of its agent traffic from Claude Sonnet to DeepSeek V4 Flash on a third-party host: replay real tasks offline against several candidates, discover that the same model scored differently on different hosts, re-tune prompts until offline scores matched, roll out gradually, then watch retention for weeks because users go quiet rather than complain. It reports about ninety percent lower inference cost on the migrated routes, and that an earlier candidate, Kimi K2.5, passed offline evals and then failed with real users. Self-reported, but the method is exactly Part VII’s and the warning is worth the price of the slide.
The current board. Checked October 2026.
| Model | Tier | Input $/M | Output $/M | Cached input $/M | Weights |
|---|---|---|---|---|---|
| GPT-6 Astra (OpenAI) | Frontier | $10.00 | $50.00 | $1.00 | Closed |
| Claude Opus 5.5 (Anthropic) | Frontier | $4.00 | $20.00 | $0.20 | Closed |
| Claude Sonnet 5.5 · GPT-6.1 Sol | Mid | $2.00 | $10.00 | $0.10 | Closed |
| GPT-6 Luna · Claude Haiku 5.5 | Cheap | $0.10 | $0.50 | $0.01 | Closed |
| DeepSeek V4.1 Flash (own API) | Cheap · open | $0.30 | $1.20 | $0.006 | MIT |
A 100× spread, top to bottom, for jobs that often come out the same. That spread is the business case for having an eval.
This is the one slide in the deck with prices on it, and it carries its date for that reason. All figures are list prices per million tokens on the standard tier as published by the vendors on 26 October 2026. At the top, OpenAI’s GPT-6 Astra at ten dollars in and fifty out, and Anthropic’s Claude Opus 5.5 at four and twenty. In the middle, Claude Sonnet 5.5 and OpenAI’s GPT-6.1 Sol are both two and ten; Google’s Gemini 4 Argon is also two and ten, with the vendor’s own note that it doubles on 1 December 2026. At the bottom, OpenAI’s GPT-6 Luna and Claude Haiku 5.5 are both ten cents in and fifty out, and DeepSeek’s own API serves V4.1 Flash at thirty cents in and a dollar twenty out, halved off-peak, with cached input at less than a cent. DeepSeek’s page did not render for us; those figures are from a price tracker that cites it, dated 25 September 2026, so check them first. Cached input is about a tenth of input everywhere, batch is half price at all three US vendors, and hosted open models on OpenRouter vary by host; GLM-5.2 was around a dollar forty and four forty in June. The thing to notice is the spread: a hundred times from top to bottom for jobs that, on your test set, may come out the same. That spread is the entire business case for having an eval. Treat every number here as a snapshot. The ratios on slide sixteen are what to remember.
Chips: the one choke point made of atoms.
The choke point
- Training a frontier model needs tens of thousands of accelerators; Nvidia makes most of them, TSMC fabricates them, ASML makes the only machines that can.
- US export controls on advanced chips to China since Oct 2022, tightened Oct 2023 and Dec 2024.
- H20: licence required Apr 2025 ($4.5B Nvidia charge); licences granted Aug 2025 with 15% of revenue to the US. Beijing told firms not to buy.
- H200: allowed Dec 2025 with 25% to the US; Chinese customs blocked them; a few thousand delivered by Aug 2026. Nvidia now excludes China data-centre revenue from its outlook.
China’s answer
- Huawei Ascend 950; Atlas 950 SuperPoD of 8,192 chips, 8 exaflops FP8, shown Mar 2026.
- Huawei said in Apr 2026 its Ascend supernode “fully supports” DeepSeek V4; DeepSeek plans a 160,000-chip Huawei cluster.
- State-funded data centres must use domestic chips (Nov 2025).
- Smuggling is real and prosecuted: a $300M GPU-server case charged Oct 2026; B300s found on China Telecom’s network. Nvidia calls it “a drop in the bucket”.
What it means for a buyer
- Compute constrains the capability race, not the distribution race: the weights already left the building.
- A model trained on scarce chips can still be served on cheap ones, anywhere. Export controls do not raise your token price.
- The lead that chips protect is the frontier lead. Keep your frontier work on frontier vendors; keep your bulk work wherever it is cheapest.
- Non-partisan summary: both governments are restricting the other’s chips. Neither is winning cleanly.
Status as reported to 23 Oct 2026 (Brookings; Reuters, FT and Bloomberg via a dated timeline; TechRadar). This changes monthly.
One slide, deliberately non-partisan, on the only constraint in this industry that is made of atoms. Training a frontier model takes tens of thousands of accelerators; Nvidia designs most of them, TSMC fabricates them, and ASML makes the only lithography machines that can. That chain is the choke point, and the United States has used it: export controls on advanced chips to China since October 2022, tightened in October 2023 and December 2024. The 2025–2026 story is messier than “banned”. Nvidia’s H20, built to comply, was put under licence in April 2025, costing the company a 4.5-billion-dollar charge; licences were granted in August 2025 on the condition that fifteen percent of China revenue went to the US Treasury; Beijing then told its companies not to buy it. The more capable H200 was permitted in December 2025 with a twenty-five percent share; Chinese customs blocked shipments in January; by August the Financial Times reported ByteDance and Tencent had each received about ten thousand, and Nvidia wrote down inventory and removed China data-centre revenue from its outlook. Brookings’ Mark MacCarthy summed it up in June: the US is out of the AI chip market in China. China’s answer is Huawei: the Ascend 950 and an Atlas 950 SuperPoD of 8,192 chips at eight exaflops, shown in March 2026; a statement in April that the Ascend supernode fully supports DeepSeek V4; a rule since November 2025 that state-funded data centres use domestic chips; and a reported plan at DeepSeek for a 160,000-chip Huawei cluster. Smuggling continues and is prosecuted. For a buyer the lesson is simple. Chips constrain training, the capability race; they do not constrain serving a model whose weights are already public, the distribution race. Export controls will not raise your token price. They protect the frontier lead, so keep frontier work with frontier vendors and bulk work wherever it is cheapest.
Sources (4)
- https://www.brookings.edu/articles/ball-games-over-the-us-is-out-of-the-ai-chip-market-in-china/
- https://whatledto.com/events/nvidia-china-export-controls
- https://www.techradar.com/pro/huawei-debuts-its-atlas-950-ai-superpod-at-mwc-2026-taking-the-ai-data-center-fight-to-nvidia-and-amd
- https://finance.yahoo.com/sectors/technology/articles/huawei-ascend-supernode-support-deepseek-044352075.html
Do you know what a job costs you?
- Pick one model call your business makes often. What does it cost per run, and what would it cost on a model a tenth of the price?
- Is any of your spend going on output tokens that nobody reads? Reasoning traces, long drafts, verbose JSON?
- Who in your organisation would notice if a vendor doubled its prices on 1 December? Google already announced one.
- Do export controls matter to anyone in this room, or only to labs? (Part I asked. The answer is still “mostly labs”.)
The third question is not hypothetical: Google’s pricing page in October 2026 lists a doubling of Gemini 4 Argon rates on 1 December. The point is that someone has to own the price list.
Choosing a model
Seven questions in a fixed order. Stop at the first no. The names change; the order does not.
Stop at the first noSection four is the durable payload of the deck. Four slides: the method, the geopolitics answered for a buyer, what changes and what does not, and three stories.
The method. Seven gates, in this order. Stop at the first no.
Does it pass your eval?
Your 100 real cases with known answers (Part VII). Not a leaderboard. No eval, no decision.
Can you legally use it for this?
Licence gate, acceptable-use policy, host’s data terms: do they train on your inputs?
Can it run where the data is allowed to be?
API, VPC, in-region host, on-prem, air-gap. The regulator sees the deployment, not the model.
What does the job cost?
Tokens per run × price, with retries and the human check. Cheapest adequate wins.
Does it fit the job’s shape?
Context length you actually need, tool calling that works, structured output, speed, languages.
Who runs it at 3am?
Operational pain: hosting, updates, quantisation, rate limits, outages, a human who owns it.
What if the vendor vanishes?
Pinned version, a second model that passes, the weights file if open, an abstraction layer.
Stop at the first no.
The order is the method. Quality first, because a cheap model that fails the eval is worth nothing. Legal and deployment before price, because a model you may not use is not a bargain.
Names never appear. Run it on three candidates every quarter, including one open model. Whoever passes all seven at the lowest cost per job is this quarter’s model. Then the layer on slide 28 makes the switch boring.
Tie-breaker: the one with the second-best alternative closest behind it. Being switchable is a feature.
Here is the durable part of the deck: seven gates, in a fixed order, and you stop at the first no. The order is the method. The first gate is quality on your own evaluation, the hundred real cases with known answers that Part VII told you to build, because a leaderboard measures someone else’s job and a model that fails yours is worth nothing at any price. The second is legal: the licence gate from slide six, the acceptable-use policy, and the data terms of whoever hosts it, especially whether they train on your inputs. The third is deployment fit: can it run where the data is allowed to be, whether that is a public API, a virtual private cloud, an in-region host, your own rack or an air-gapped machine. Your regulator sees the deployment, not the model, which is why this comes before price. Only then do you ask what the job costs, as tokens per run times price, including retries and the human check; the cheapest adequate model wins. The fifth gate is shape: the context length you actually need, tool calling that actually works, structured output, speed and languages. The sixth is who runs it at three in the morning, which for a self-hosted model is a named human and for an API is a status page and a rate limit. The seventh is what happens if the vendor vanishes or reprices: version pinning, a second model that also passes the eval, the weights file if it is open, and the abstraction layer from slide twenty-eight. No model name appears anywhere in the method, which is the point. Run it on three candidates each quarter, one of them open, and the quarter’s model is whichever passes all seven at the lowest cost per job. When two tie, prefer the one with the closest runner-up. Being switchable is a feature.
Chinese open weights: adoption strategy or security incident?
Weights are a file, not a service
A model file does not phone home. It cannot; it has no network code. Data goes wherever the software running it sends it, which is your decision.
The app ≠ the API ≠ the weights
DeepSeek’s app and API send data to its servers in China (DHS’s stated concern). Its weights on a Virginia server send nothing. Most bans name the first two.
The real risks are quieter
Behaviour, licence, continuity and your regulator. Each has a mitigation. None is “the model is spying on you”.
Adult answer: it is an adoption question with a security checklist attached, and the checklist is mostly about where it runs.
Part I left this question open on purpose. Here is the answer, said like an adult. A model is a file of numbers and the code to run it. A file does not phone home; it has no network code to do so. Data goes wherever the software running the model sends it, and whoever deploys it chooses that software. So “is this model spying on me” has three answers depending on which thing you mean. DeepSeek’s consumer app and its own API send your data to DeepSeek’s servers in China, which is the concern the Department of Homeland Security cites. DeepSeek’s weights running on a server in Virginia, or on your laptop, send nothing anywhere. Most government bans, from the US Navy, NASA and the House in January 2025 to the Department of Homeland Security’s October 2026 order removing DeepSeek products and services from federal civilian systems, are written about the first two, though the DHS wording is broad enough that government suppliers should assume it reaches hosted versions as well. The real risks are quieter and each has a mitigation. Behaviour: the US government’s CAISI evaluation in September 2025 found DeepSeek models echoed about four times as many Chinese-state narratives as US models and that R1 was hijacked by malicious instructions roughly twelve times as often as GPT-5 and Claude Opus 4; the answer is to include your own red-team cases in your eval, keep the model away from political content, and remember from Part III that security lives in the harness, not in the model’s manners. Continuity: keep the file, pin the version, have a second model that passes. Your regulator or customer: if you sell to government, check the list for both model and host; otherwise document the deployment fit. And the licence, same as any model. It is an adoption question with a checklist attached, and the checklist is mostly about where it runs.
Sources (4)
- https://www.nist.gov/document/caisi-evaluation-deepseek-ai-models-report
- https://techcrunch.com/2026/10/20/us-orders-federal-agencies-to-remove-chinas-deepseek-ai-from-their-systems/
- https://www.theregister.com/security/2026/10/20/deepseek-deep-sixed-at-all-us-federal-civilian-agencies/5304010
- https://thenewstack.io/openrouter-us-region-routing/
What will still be true in a year. What won’t survive six weeks.
True for years
- A model is a file. Holding the file is what “open” buys you.
- Open weights ≠ open source. The licence is the product.
- Two races: capability (closed, loud) and distribution (open, cheap). Most jobs are in the second.
- Output ≈ 5× input. Cache ≈ 1/10. Batch = 1/2. Open ≈ a fraction of frontier.
- The price of fixed capability falls every year. Plan on cheaper.
- Chips constrain training, not serving.
- Where a model runs matters more than where it was made.
- Seven gates, fixed order, stop at the first no.
Wrong by the next release
- Which model is best this quarter, on any benchmark.
- Any price on slide 18, and Google’s on 1 December.
- 57–67% of OpenRouter tokens: a weekly figure from one router.
- Which lab has the largest open model (2.8T this month).
- Which US agency has banned which product.
- Which Nvidia part may be shipped to whom, and the percentage the Treasury takes.
- Whether Meta is open this quarter.
- Every name on the map.
Part I’s closer: the names will be wrong in six weeks; the questions will not. This slide is that sentence, itemised.
Part I ended with a sentence that has turned out to be the organising principle of this whole deck: the names will be wrong in six weeks and the questions will not. This slide itemises it. On the left are the things that belong in your architecture document because they will still be true when the document is next read. A model is a file, and holding the file is what open buys you. Open weights are not open source and the licence is the product. There are two races, one for capability and one for distribution, and most business jobs live in the second. Output tokens cost about five times input, cached input about a tenth, batch half, and open models a fraction of frontier. The price of a fixed amount of capability falls every year, so plan on cheaper. Chips constrain training, not serving. Where a model runs matters more to your lawyer than where it was made. And the seven gates, in order. On the right are the things this deck confined to dated slides. Which model is best this quarter. Any price on the board, including the one Google has already announced will double on 1 December. The OpenRouter share, which is a weekly figure from a single router with a developer-heavy user base. Which lab has the largest open model, which this month is Moonshot at 2.8 trillion parameters. Which agency has banned which product. Which Nvidia part may be shipped to whom and what percentage the Treasury takes. Whether Meta is open this quarter; it has changed its mind twice in a year. Every name on the map. When you present this deck in a year, replace the right-hand column and leave the left one alone.
Three stories everyone in this room should know.
A free file moved $589 billion.
A Hangzhou lab released R1 as open weights, claiming a final training run of about $5.6M. On 27 January 2025 Nvidia fell 17% and lost $589B of market value, the largest one-day loss in US market history. The capability gap was months. The price gap was the story.
The open layer changed hands. Twice.
Llama defined open weights in 2023–24, under a licence the OSI calls not open source. Llama 4 underwhelmed; Meta went closed with Muse Spark in April 2026; then returned with Muse Glimmer (Apache 2.0) and Muse Spark Open (custom licence) by October. Qwen now has 4.7× Llama’s derivatives.
Switched models. Kept the customers.
Moved most agent traffic from Claude Sonnet to DeepSeek V4 Flash on a third-party host: offline replay of real tasks, prompt re-tuning, staged rollout, weeks of retention data. About 90% lower inference cost. An earlier candidate passed the evals and failed with users.
Three stories, one per section of this deck. DeepSeek is the distribution race in one afternoon. A lab in Hangzhou released its R1 reasoning model as open weights in January 2025, with a technical report pricing the final V3 training run at about 5.6 million dollars, a figure that excludes research, staff and failed runs. Its app went to the top of Apple’s US store. On Monday 27 January Nvidia’s shares fell seventeen percent and the company lost 589 billion dollars of market value, the largest one-day loss in US stock-market history according to Bloomberg; Broadcom, ASML and the Japanese chip-equipment makers fell with it. The capability gap to the US frontier was months. The price gap was the story. Meta is the lesson about vendors. Llama defined open weights in 2023 and 2024, under a community licence the Open Source Initiative says is not open source. Llama 4 in April 2025 underwhelmed and Behemoth never shipped; CNBC reported in December 2025 that the next model, Avocado, might be proprietary; Muse Spark, closed, replaced Llama in April 2026; and by October Meta had released Muse Glimmer under Apache 2.0 and the 816-billion-parameter Muse Spark Open under its own licence. Meanwhile Qwen accumulated 4.7 times Llama’s derivatives. A vendor’s openness is a strategy that can change twice in a year; what you hold is the file. Lindy is the method working. In June 2026 the agent company moved most of its traffic from Claude Sonnet to DeepSeek V4 Flash on a third-party host, by replaying real tasks offline against several candidates, re-tuning prompts, rolling out in stages and watching retention for weeks. It reports roughly ninety percent lower inference cost, self-reported, and the warning that an earlier candidate passed every offline eval and failed with real users within days.
Sources (8)
- https://www.bloomberg.com/news/articles/2025-01-27/asml-sinks-as-china-ai-startup-triggers-panic-in-tech-stocks
- https://www.channelstv.com/2025/01/28/nvidia-loses-nearly-600bn-in-value-as-chinese-ai-firm-jolts-shares
- https://en.wikipedia.org/wiki/Llama_(language_model)
- https://www.eweek.com/news/meta-new-avocado-model/
- https://en.wikipedia.org/wiki/Muse_Spark
- https://dev.meta.ai/resources/blog/build-with-muse-spark-open
- https://huggingface.co/blog/state-of-open-models-summer-2026
- https://www.lindy.ai/blog/migrating-from-claude-to-deepseek
Could you switch models by Friday?
- If you had to replace your main model this week, what is the first thing you would need that you do not have? (Hint: slide 22, gate one.)
- Which of the seven gates would your current model fail if you were honest? Which one did you skip when you chose it?
- Is “made in China” a gate in your organisation, a tie-breaker, or something nobody has decided?
- What would your customers need to hear to trust an open-weight model with their data? Is that different from what they need to hear about a closed one?
The first question is the diagnostic: almost every organisation that cannot switch is missing an eval, not a model. The fourth one is Part I’s closing question, three months on.
Use it Monday
One layer of plumbing, one checklist, one eval run, one calendar entry. None of it needs a budget.
Make switching boringSection five is the Monday-morning section. One diagram of the abstraction layer, then the four things to steal.
The abstraction layer. One picture; make switching boring.
Your application
Prompts, tools, documents. Knows the job. Does not know which model is on duty today.
The layer
One interface (most speak the OpenAI-style API), one config file naming the model per job, logging of every call, cost per job.
The eval gate
A candidate gets into the config only after it passes the test set (Part VII) at a lower cost per job. Shadow it first (Part III).
The model of the quarter
Frontier API, mid-tier API, hosted open model, or a file on your own box. Interchangeable because the layer is.
Switch on
Routers and gateways: OpenRouter, Vercel AI Gateway, cloud-provider gateways (Bedrock, Azure, Vertex). Region pinning is a setting. Examples, not endorsements.
Assemble
A library: LiteLLM, Vercel AI SDK, LangChain’s model wrappers. A hundred lines of your own works too. The rule is that no prompt calls a vendor directly.
What the layer is not
A quality guarantee. The same model scores differently on different hosts (Lindy found quantised copies). The eval runs per model per host.
Part III called this “plumbing: pick once, reuse everywhere.” It is also your negotiating position.
Every story in this deck about switching cheaply had the same thing in the middle: a layer between the application and the vendor. Here it is in one picture. Your application knows the job: the prompts, the tools, the documents. It should not know which model is on duty today. Between it and the model sits a layer with one interface, which in practice usually means the OpenAI-style chat API that nearly every vendor and open-model host now speaks; one configuration file naming the model for each job; a log of every call; and the cost per job, computed from the log. In front of the configuration sits the gate from Part VII: a candidate model gets into the file only after it passes the test set at a lower cost per job, and only after shadowing the incumbent for a while as Part III’s rollout path requires. Behind the layer is the model of the quarter, whatever it is: a frontier API, a mid-tier one, a hosted open model in a region you chose, or a file on your own hardware. They are interchangeable because the layer is. You can switch this on by using a router or gateway, such as OpenRouter, Vercel’s AI Gateway or the gateways inside Bedrock, Azure and Vertex, where region pinning is a setting; or assemble it from a library such as LiteLLM or the Vercel AI SDK, or write a hundred lines yourself. The rule is the thing, not the product: no prompt calls a vendor directly. What the layer is not is a quality guarantee. Lindy found that the same nominal model scored differently on different hosts, probably because some served quantised copies, so the eval runs per model per host. Part III listed this under plumbing: pick once, reuse everywhere. It is also, quietly, your negotiating position with every vendor you have.
Four things to do before the next price change.
Write the checklist.
The seven gates on slide 22, as one page, in the order given. Fill it in for the model you use now. Be honest about the gate you skipped.
Run your eval on three models.
Your test set from Part VII. The incumbent, a cheaper tier from the same vendor, and one open-weight model on a host in your region. Record cost per job for each.
Put the layer in.
A router, a gateway or a hundred lines of code. No prompt calls a vendor directly. Pin the version. Log the cost. Keep the weights file if you have one.
Diarise the re-check.
Quarterly: re-run the three-model eval, re-read the board, re-read the licence, re-check the ban list if you sell to government. Thirty minutes. Then update one slide.
Nothing here needs budget. All of it needs the one thing most organisations do not have: a test set that says what “good” means for their jobs.
Four actions, each a direct consequence of a section of this deck, each doable in a week. Write the checklist: the seven gates from slide twenty-two as a single page, in that order, filled in honestly for the model you use today. Most teams discover they skipped gate one or gate two when they chose it. Run your eval on three models: the hundred real cases from Part VII against the incumbent, a cheaper tier from the same vendor, and one open-weight model served from a host in your region, recording quality and cost per job for each. The result is usually that a cheaper model passes for most jobs and not for a few, which is exactly the information you need. Put the layer in: a router, a gateway, or a hundred lines of your own code, with the rule that no prompt calls a vendor directly, the version pinned, the cost logged, and the weights file kept where you have one. Then diarise the re-check: once a quarter, re-run the three-model eval, re-read the price board, re-read the licence of anything you run, and if you sell to government re-check the ban list; thirty minutes, then update one slide. None of this needs a budget. All of it needs the thing most organisations still do not have, which is a test set that says what good means for their own jobs. That test set is the asset. The models are rentals.
What is the job, who holds the file, where does it run, what does it cost per job, and what happens when the vendor changes its mind.
Pick with a method. Rent the rest.
Why the OpenRouter percentages disagree with each other.
| Figure | What it measures | Period | Source |
|---|---|---|---|
| 1.2% → ~13% avg | Chinese open models’ share of all OpenRouter tokens, weekly, averaged over a year | Nov 2024 – Nov 2025 | OpenRouter + a16z, arXiv 2601.10088 |
| ~61% | Chinese models’ share of tokens among the top 10 models only | June 2026 snapshot | CryptoBriefing, as quoted in Part I |
| 46.4% | Chinese-origin share of all routed tokens; US-origin 35.7%; DeepSeek 17.6%, Qwen 13.9%, Anthropic 14.8% | Mid-2026 | CNBC, 7 Jul 2026 |
| 58% (peak 63%) | Share of tokens that US firms specifically ran through Chinese models | July 2026 | Bloomberg, Jul 2026 |
| ~60% | Open-weight (any origin) share of tokens from US-originating requests; “Chinese labs are most of that” | Sept 2026 | OpenRouter blog via The New Stack |
| 57–67% | Chinese-lab share of tokens, by region (US, Europe, Global South); Global South 67% | Week of 14 Sep 2026 | CNBC, 26 Sep 2026 |
For the reader who noticed that this deck, Part I, CNBC, Bloomberg and OpenRouter’s own blog all quote different percentages for the same phenomenon. They are measuring different things. The OpenRouter and a16z study of January 2026 reports Chinese open models at 1.2 percent of weekly tokens in late 2024, rising to nearly 30 percent in some weeks and averaging about 13 percent across November 2024 to November 2025. The “roughly 61 percent” that Part I quoted in August was a June 2026 snapshot of the top ten models only, a much smaller denominator. CNBC’s July report gave 46.4 percent of all routed tokens to Chinese-origin models, against 35.7 percent US-origin, with DeepSeek the largest single vendor at 17.6 percent, Qwen at 13.9 and Anthropic at 14.8. Bloomberg’s July figure of 58 percent, briefly 63, was the share of tokens that US companies specifically ran through Chinese models. OpenRouter’s own September blog said open-weight models of any origin were about 60 percent of tokens from US requests, with Chinese labs most of that. And CNBC’s 26 September report gave 57 to 67 percent by region for the week of 14 September. Every one of these is defensible; none of them is “the market share”. OpenRouter routed roughly twenty trillion tokens a week in April 2026 and its customers skew to developers and agent workloads, which favour cheap models. And token share is not revenue share: a frontier token costs ten to a hundred times an open one, so by dollars the picture is very different. When you quote any of these, quote the definition with it.
Sources (6)
- https://arxiv.org/abs/2601.10088
- https://finance.yahoo.com/technology/ai/articles/chinese-ai-models-now-capture-020440715.html
- https://aiweekly.co/alerts/chinese-ai-models-hit-record-58-of-us-openrouter-traffic
- https://thenewstack.io/openrouter-us-region-routing/
- https://www.cnbc.com/2026/09/26/china-ai-global-adoption.html
- https://www.digitaltoday.co.kr/en/view/107631/chinas-value-ai-models-speed-global-spread-washington-on-edge
Licence fine print, as read in October 2026.
| Model (licence) | The clause that matters | Internal use | Attribution |
|---|---|---|---|
| Llama 3.x / 4 (Llama Community) | >700M monthly active users at release date → separate licence from Meta. Acceptable-use policy. OSI: not open source. | Yes | “Built with Llama” |
| Muse Spark Open (Muse Model License) | >$20M revenue in any 12 months from offering AI models as a product or service → notify Meta, separate agreement. Usage policy; no military use; 18+. | Yes | “Built with Muse Spark Open” |
| Kimi K3 (custom “kimi-k3”) | Model-as-a-service revenue >$20M/yr → separate agreement. K2 was “Modified MIT” with no MaaS gate. | Yes | Display “Kimi K3” above 100M MAU or $20M/month |
| Qwen3.8-Max 2.4T (Qwen3.8-Max licence) | Model-service or “AI work assistant” revenue >$50M in 12 months → separate licence. Qwen3.8-27B is plain Apache 2.0. | Exempt | Per licence text |
| DeepSeek, GLM-5.2, gpt-oss, Mistral Small 4 (MIT / Apache 2.0) | None. Keep the notice; Apache adds a patent grant and termination clause. | Yes | Notice file only |
The fine print behind slide six, for the person who has to put it in a compliance document. Meta’s Llama Community licence requires anyone with more than 700 million monthly active users on the release date to obtain a separate licence, imposes an acceptable-use policy, and requires a “Built with Llama” notice; the Open Source Initiative says it is not open source, and the Free Software Foundation classes it as non-free. Meta’s Muse Model License for Muse Spark Open, released 15 October 2026, triggers a notification and separate agreement once a licensee earns more than twenty million dollars in any twelve months from offering AI models as a product or service, requires a “Built with Muse Spark Open” notice, prohibits military and weapons uses among others, and is not intended for anyone under eighteen. Moonshot’s Kimi K3 licence, which accompanied the weights released on 26 July 2026, requires a separate agreement once model-as-a-service revenue exceeds twenty million dollars a year and requires the name “Kimi K3” to be displayed once a product passes a hundred million monthly users or twenty million dollars a month; Kimi K2 had been under a modified MIT licence with the attribution rule but no service-revenue gate. Alibaba’s Qwen3.8-Max licence on its 2.4-trillion-parameter model requires a separate licence once model-service or AI-work-assistant revenue exceeds fifty million dollars in twelve months, exempts internal use, and sits alongside the plain Apache 2.0 licence on Qwen3.8-27B. DeepSeek, Z.ai’s GLM-5.2, OpenAI’s gpt-oss and Mistral’s Small 4 and Large 3 are MIT or Apache 2.0 with no gates. Everything here is as reported by the cited sources in October 2026; the LICENSE file in the repository you actually download is the only authority, and a new version can arrive under a new licence while the version you hold keeps the old one.
Sources (8)
- https://en.wikipedia.org/wiki/Llama_(language_model)
- https://ibl.ai/blog/meta-muse-spark-open-weight-licence-self-host-reality
- https://roo.beehiiv.com/p/kimi-k3-open-weights-license-benchmarks
- https://www.eweek.com/news/alibaba-qwen3-8-27b-license-apac-china/
- https://simonwillison.net/2026/jun/17/glm-52/
- https://www.theregister.com/2025/08/05/openai_open_gpt/
- https://en.wikipedia.org/wiki/Mistral_AI
- https://huggingface.co/blog/state-of-open-models-summer-2026