Mozilla's latest State of Open Source AI report, published on September 15, reveals that the performance gap between open-weights AI models from Chinese companies and closed frontier models from US firms has closed to just 4.4 months.
The report highlights how Moonshot AI’s Kimi K3 achieves a composite AI performance score just three points behind Anthropic’s Fable 5 closed model, all while costing 30 percent of the latter.
The report notes that open-weights models allow anyone to download the main model components and run them on their own computers, though developers typically withhold vital information such as training data, the data pipeline, and training code.
By contrast, US tech companies like Anthropic and OpenAI mostly offer closed frontier models that keep everything proprietary, requiring customers to pay more for access.
"[A Closed model] earns its premium in a few places: expert professional work, high-intensity retrieval, and long context," said Raffi Krikorian, chief technology officer at Mozilla. "We see the decision to pay for closed [models] as workload-specific rather than organization-specific."
Organizations still pay for closed frontier models because they work out of the box and come bundled with "compliance packaging, support, and accountability," whereas many organizations lack the staff to run open-weights models well, Krikorian explained.
The steadily narrowing performance gap between open and closed frontier models, coupled with the cost-effectiveness of open models, is now widely recognized by many companies.
For example, delivery company DoorDash has been using Kimi for routine work while reserving Fable for more difficult tasks that would normally take human experts longer to complete. Unsurprisingly, this has accelerated the use of open models since Mozilla’s inaugural State of Open Source AI report was published on July 14.
Source: arstechnica
