This is precisely why I expect that Chinese open models are going to win in the long run. The capability difference isn't dramatic in the grand scheme of things, but the fact that you can run your own is a huge selling point. Even if you rent an open model from a Chinese company, you can switch to on prem if they decided to yank access or change terms in the way you don't like. It might be a pain, but it wouldn't be existential. On the other hand, if you become dependent on a closed model and it gets yanked then you're in a world of hurt.
And infrastructure dominance is really the big picture here. Chinese models are going to become the standard setters because they're going to be what people are using. That means more research, more tooling, and a whole ecosystem developing around them.
After this action, I have no doubt that this administration will try to ban Chinese models. Of course, doing so will be futile, we'll figure out ways to get around it, but now I'm pretty sure they're going to try.
I'm waiting for that to happen as well since the price difference makes it very difficult for companies like Anthropic and OpenAI to compete. And we already have precedent for this with stuff like EVs, phones, and so on. As soon as Chinese companies start making a product that's more popular, they get banned on some national security pretext.
The tricky part with banning Chinese models is that they're open. It'll be easy to ban access to service providers, but preventing people from running these models on prem is going to be really tough. Like are they going to go after Cursor for example given that their model is based on Kimi?
I very much agree it's going to be a futile endeavour in the end. It kind of reminds me of the time Microsoft tried to get Linux and open source banned when Linux started encroaching on Windows server market. This is going to end the same way.
I'm going to guess they'll go after sites like Huggingface that host downloads. I suspect we'll be torrenting Chinese models in the not-too-distant future. Or we'll have to geo-spoof with VPN to download from other countries.
It is almost certain that the CCP will impose constraints on access to their models at some point too. But Trump is doing it to extort cash from Anthropic, and China will be doing it to leverage political and economic concessions.
Remember that there are degrees of banning. Slower tokens, dumber models, token caps, KYC for each model consumer, hurting specific companies that are not capitulating in a deal with a Chinese company, etc.
A big difference with open models is that anybody can run and tune them any way they like. The real difference in philosophy is that Americans companies treat the model as the product, while Chinese companies see models at infrastructure you build products on top of. You amortize the cost of deploying it at scale by sharing knowledge and iterating quickly to bring the cost down.
I see absolutely no reason why CPC would choose to kneecap themselves the way the USG just did. Keeping open access to the models means that the whole world will be using Chinese based AI stack going forward. Only a government run by absolute imbeciles would do what the US did.
Even if everyone uses Chinese open weight models at somw point, how do you make money creating them?
This is just typical Chinese behavior. Flood the market with cheap or free stuff and wait for your competitors to die off. Then you have a monopoly. (Maybe you were implying that would happen, dunno)
I mean you could ask the exact same question about other foundational tech like Linux. And the real question here is what stops Americans companies from producing things cheaply and at scale the way Chinese companies do. You frame it as some nefarious tactic, but the reality is that they're just more efficient and American companies are unable to compete with that.
The Chinese government grossly subsidized many industries to undercut their competitors and form monopolies, such as solar panels, electric cars, battery cells, and steel and aluminum manufacturing, not to mention rare earths. Yes, they are more efficient, I don't disagree with you there.
But they aren't making any money releasing open weight models, and no, I don't believe they are like Linus Torvalds with some grand vision of free as is freedom AI models, but rather doing more of the same.
The US government has also grossly subsidized many industries. Tesla literally wouldn't exist without subsidies. However, the whole premise behind capitalism and markets was that this system was inherently more efficient than state planning. Now we see that narrative is false because China's planned system is winning across the board.
And that's the beauty of a planned system, you don't have to focus solely on short term profit there. If Chinese government sees this tech as foundational, which they do, they can just keep pouring money into it because it provides general benefits for the country.
This is exactly what happened with high speed rail incidentally. People in the west kept talking about how unprofitable it is, while China understood that creating this infrastructure would create a huge economic boost for the country by allowing goods and people to move more easily. Sure enough, China continued to invest in high speed rail, and now a lot of regions that used to be hard to get to are wired into the economy, and China is seeing substantial development in these regions.
Yes, I agree. I'm not saying China is bad doing this, it's just this is what they are doing IMO.
Spending huge amounts of money to gain a foothold in AI because it helps their country is not a bad thing at all.
But my point is that the day that the USA's AI industry collapses in on itself, Chinese companies are going to also stop open sourcing their models, too.
It may sound like I'm kicking China for this, I'm not. It's just a practical take. You can't make money spending 10s or 100s of millions of dollars just to then give away everything for free and expect to make money long term. Do you agree?
I actually expect they will keep making the models open and we'll likely converge on one or two alternatives because there's really not much difference between them at the end of the day. Everybody curating their own model is a huge duplication of effort with no clear benefit. There's a reason everybody doesn't roll their own operating systems for example.
It all comes back to what I said earlier. If you treat the model as the product, then it makes sense to keep it closed. You have some secret sauce that nobody else has, and you sell it. But the reality is that nobody has a magic formula that's significantly better than what other people can figure out. You might get an advantage for a few months tops, and then other models start catching up.
And this creates involution where you just have a race to the bottom where nobody makes any money. On the other hand, if you treat models as infrastructure, and everybody contributes to the same pool of knowledge, then you amortize the cost of making a better model. The money comes from actual products that can genuinely differentiate themselves. Companies are going to seek niches they can dominate where they do a specific thing really well. That's a much more realistic path towards long term sustainability.
And that's why I expect models are going to become infrastructure akin to Linux in the long run. They're just not where profit is.
The difference is that making Linux doesn't require a lot of money to do. Most of it is written by people for free in their spare time. They do it because they like to solve complex puzzles and be recognized within the opensource community.
OTOH, training a model requires a lot of hardware and energy to do, and the money has to come from somewhere.
Do you think that China's government is going to pay for it and release it openly to the world for the purpose of goodwill towards China, or some other reason? What would it be? Or would some other groups do it?
Linux gets a lot of funding and corporate development done actually. And training models is also getting cheaper every year. There are also projects like Petals which allow you to train models in a distributed fashion https://github.com/bigscience-workshop/petals
And yeah, I do think China's government is going to continue subsidizing this tech because this tech is being used all over the place in China now. Meanwhile, the models aren't developed by the government, they're developed by individual countries that get subsidies. As I've explained above, converging on common infrastructure is going to save resources for all these companies. And continuing to work in the open with the rest of the world means getting the benefit of having a global community of researchers helping advance this tech forward.
It's not just altruism or clout. American companies working on closed models have to foot the bill for all the research, and they're limited to the brainpower within the company. And they're competing with Chinese which have much bigger research community contributing to developing their models.
If the model itself is not the product, then American companies find themselves in a situation where they're spending a ton of resources on something that's not their core business.
And infrastructure dominance is really the big picture here. Chinese models are going to become the standard setters because they're going to be what people are using. That means more research, more tooling, and a whole ecosystem developing around them.
And that was already starting to happen even before this fiasco with Chinese models now being the most used ones globally. https://www.indiatoday.in/amp/technology/features/story/clau...