Chinese companies are heavily incentivized to use Chinese chips instead of American since Trump blocked trade with China.
China used to parallel import the chips they needed, and even repackage them with more onboard RAM, making more powerful Nvidia solutions available in China than in the rest of the world.
But Trumps behavior towards China made the Chinese government decide to limit the use of American technologies for AI.
There was a point where Nvidia exports to China was basically at a standstill, because China forbade the purchase of a new cut down Nvidia chip made for the Chinese market to circumvent American trade restrictions.China is building their own complete stack now, replacing everything with Chinese technologies, right from the AI chips to the entire AI software framework.
So not only does Nvidia and other American companies lose hardware sales, the entire stack will be threatened with a Chinese alternative, that will likely compete with American options on the international market in the future. If Cuda loses its current dominance, it will be easier for competitors to take marketshare from Nvidia.
Hopefully this will be good for consumers worldwide.
I dont know how much of this is sensationalist peddle, but there’s a barely disguised advert for entrepreneurs by a YouTube channel called Statrys that mentions China’s plan to destroy the competition by doing what a dictatorship not held back by bureaucracy does best; investing fucktons of money into the industries. Link
IDK about destroying the competition, but investing a fuckton of money on education research and infrastructure is what they’ve done for 50 years, originally to catch up, now to gain technological independence from USA limiting their access to technologies like AASML despite it’s a Dutch company, and even limiting their ability to use TSMC manufacturing despite it’s a Taiwanese company.
There is no doubt that to achieve a self sustained economy, China needs to be competitive in ALL areas, otherwise USA will use it to hold them back.
Been using Qwen 3.x for a while now for local LLM with search capability. The 3.5 and 3.6 ones are great and run very fast.
Qwen is already the standard for actual pros as far as I can tell.
It’s only the standard for people who self host their llms and don’t have $500k to throw at hardware for GLM-5.1 or similar models.
I have qwen3.6:27b on my local hardware and it’s way better than I expected. I’m excited for the rest of the 3.6 line as it comes out, if they can keep up that quality.
This story is also a nothing burger. Generally, yes, Nvidia will suffer once chinas stack catches up (soon). By then whatever bubble we are in will have normalized one way or the other.
In terms of actually deploying this model, it doesn’t matter what hardware you’re using. VLLM supports almost everything with SIMD-type hardware instructions.
More competition will make everyone happy except Nvidia shareholders.
Gemma4:26b is also worth trying. I find it runs much faster on my hardware.
Edit: Qwen3.6:35B might be the sweet spot. It’s bigger than the 27B, but actually more lightweight when running. TIL the 27B is not a MoE model; it’s a dense model. The 35B is a MoE model with only 3B active params.
So far, I think Qwen3.6:35B might be giving me better results than Gemma4:26B. It’s a bit slower than Gemma4:26B, but definitely faster than Qwen3.6:27B.
Hopefully this will be good for consumers worldwide.
Until America decides to tariff anyone using Chinese technology.
It’ll be good for consumers worldwide. America is not the whole world.
I, for example, am in Canada. We’ve established a bunch of very nice trade deals with China recently, we’re going to end up with access to a bunch of Chinese products that Americans can’t get due to their self-imposed trade war with China.
I think they mean that the US would put trade pressure on countries doing any tech trade with China, not specifically preventing it punishing American companies from using Chinese chips.
Unfortunately the United States is still a big economy regardless of their politics and Manny is right that the US would throw their weight behind anti China policies to the detriment of other nations.
How successful such a move would be is up to debate.
The US is already trying to throw its economic weight around bullying Canada, and we’ve already settled in to an effective economic defensive posture. Those trade deals with China are actually part of it, previously we were supporting various American initiatives to tariff China but the Americans tore up a bunch of agreements with us so we responded in kind. It’s unfortunate but they started it and we’re prepared to hold our own.
USA is already losing the tariff war as it undermines the American economy, and hasn’t helped their trade deficits much.
When EU finally decides to put tariffs on American services, because USA continue with their shenanigans, then USA will have a trade deficit for real.
Because the trade deficit on goods is vastly outweighed by the surplus on services.
Even if they have a deficit, it is basically free, because they can pay for it with dollars they print themselves, because the USD is the global reserve currency.
But Trump is ruining that too, since “liberation day” where Trump introduced his tariffs, the use of the USD as a global reserve currency has dropped, some claim by up to 30%All USA is doing is undermine the power they used to have. Everybody threatened by USA are in talks with each other to increase cooperation.
EU, Canada, Australia, UK, Japan, are making deals to cooperate around USA including on military.
The Gulf countries are now negotiating with China on economy, which will potentially be the end of the petro dollar. And they are looking to Europe especially Ukraine for defense equipment to replace American equipment.
South American countries have been working with China for years, and USA subsidizing Argentina will not change that.USA is making themselves irrelevant, the Iran war has shown their military is a paper tiger, that cannot protect their allies, and they are pulling key defense equipment out of Japan and South Korea to aid in the Iran war. Making all allies unsure of the value of cooperating with USA. Japan participating in the EU SAFE program is an extremely clear indicator of that.
So whatever USA decides, will have very little bearing on the rest of the world. Because for USA, the train has already left the station, the ship has sailed. The world has lost patience with USA, and are now only idling in their relations with USA, while they all seek to strengthen other relations, for both financial stability and military safety.
What’s left unsaid is the software architecture is extremely interesting, and efficient.
Ironically, the Nvidia embargo was the best thing to ever happen to the Chinese labs (which Nvidia tried to tell the US govt). It forced them to get thrifty, unlike US labs which (allegedly) fill some GPU farms with busywork for the appearance of high utilization.
Whatever finally kills CUDA I favor.
Sad trombone.
It almost feels like the Trump administration is trying to help Chinese companies at this point.
You can run it on CPU alone. Not surprising they’re building their own AI ecosystem
It’s still matrix multiplication. Running it on a general purpose CPU is inefficient.
Not at scale. Even on the new architecture, one really needs some kind of accelerator to make it economical for servers.
Bitnet-like models might change the calculus, but no major trainer had tried that yet.
Yes, you can run it at scale. Which is why it uses Huawei hardware.
You can run it on anything, scaled or not
Just not power/cost efficiently on CPU only, is what I meant. CPUs don’t have the compute for batching (running generation requests in parallel). You need an accelerator, like Huawei’s, to be economical.
It’s fine for local inference, of course.
A whole ecosystem that can run on any hardware, efficiently or not, is a whole ecosystem developed for the Chinese market
…I mean, yeah? It’s obviously developed for the Chinese market.
But that’s theoretical, for now. No CPU backend I can find supports DSV4, and DeepSeek hasn’t contributed anything yet.
Yeah, I’d expect KTransformers to add support eventually, especially considering their existing support for previous DeepSeek models. One of the tricky parts is that backends need both FP8 and MXFP4 support. As far as I’m aware no inference engine supports both on CPU at the moment (llama.cpp added fp4 support recently, but doesn’t have fp8, while kt-kernel doesn’t support fp4 yet).
Not to speak of the new attention scheme and the (IIRC) MLP changes.
I’m very much looking forward to ik_llama.cpp implementing it. I don’t think I can quite fit Flash on my rig (hence no Ktransformers for me) but a little quantization of the sparse layers, and it’d be perfect.
Nope! You don’t know what you’re talking about. At all. But you can have fun running a 1.6 trillion parameter model on CPU at basically 0 tokens per second at scale, MoE or not.
You’ve proved my point that you don’t know what you’re talking about by blindly linking to the git repo. Couldn’t find any source that supports your claim? I wonder why.
Sure you can serve one request at a time to one patient user at a slow token per second rate, which makes running locally viable, but there is no RAM that has the bandwidth to run this model at scale. Even flash would be incredibly slow on CPU with multiple requests. You’d need the high bandwidth of VRAM and to run across multiple GPUs in a scalable way, it requires extremely high bandwidth interconnects between GPUs.
Thank you for proving my point. It can be run on a cpu
“It’s slow, it’s inefficient” it still runs
It’s a foundational model just like R1 was.
Yes, you can run it at scale.
at scale
Shift those goalposts! We went from “at scale” to “it still runs”
I mean, sure. You could also run it by drawing marks in sand. It doesn’t make any sense to do either, though.
China is so far ahead of the United States in manufacturing and technology that the United States will never be able to catch up.
Any new technology instantly gets turned into some new boogeyman instead of being embraced. Works out great for China when western people become luddite at a very critical window of opportunity from emerging technology. You’d almost think China has a strong ability to flood western sites with propaganda.
Those are two completely different contexts. Every new technology in the west is usually meant to restrict existing freedoms while in China they never historically had said freedoms, so to them it’s just an improvement in productivity while to us is not as much of an improvement at the cost of completely usurping the existing rights that made the west great
Is your argument that Chinese government is not using technology to restrict freedoms?
How is that being upvoted
I would say that decades of western Hollywood has primed the population to mistrust any new technology and only see potential dystopian ends in exchange for entertainment. Combined with China spreading propaganda to encourage those views in western nations. Sites like lemmy and Facebook are heavily used as generators to spread mistrust.
Your premise makes no sense. Vhina abdolutely uses these technologies to restrict freedoms (so does the us).
United States was so ahead of China even 20 years ago, China was obviously never able to keep up, until it did, and then it was obvious that China was always going to overcome US, and now it’s obvious that this configuration is forever.
Something new will be always has been obvious in 20 years time.











