456 points by firloop 8 days ago | 198 comments | View on ycombinator
flowerlad 7 days ago |
x313 7 days ago |
I have no idea whether this is legit or not (there's no link to any code), I'm mentioning this because all the comments here are assuming truth without verifying the contents.
GenerWork 7 days ago |
martinwright 7 days ago |
I think the frontier models are definitely in a healthy dynamic where it seems the near-but-not-quite performance of open-weight models are what is pushing the most innovation and price competition from OpenAI, Anthropic and co
loneboat 7 days ago |
From my (very cursory, naive, layman's) glance at the summary, they're identifying and tracing some characteristics that specific hardware imparts into a model's initialized weights. But then concluding that this indicates the models were also "trained on" that same hardware.
But is that a valid assumption? Is it possible that a model was initialized on one system configuration, while the bulk of the training was performed on another?
In fact, it would seem reasonable for the "okay, I'm setting up this new model on my workstation, prepping it for training next month" pipeline step to be far removed from the "okay, now deploy the [initialized, but not yet trained] model across our giant fleet of beefy training machines".
int32_64 7 days ago |
There will be a black market of renting IDs to KYC and gain access to the chips, and then the hosts will monitor their servers for what is being trained, it will be a cat and mouse game.
We are headed for an increasingly unfree computation landscape and the politicians are going to make demands that will be hard to deliver.
basiccalendar74 7 days ago |
The 2nd option is perfectly legal and allowed by US government.
cadamsdotcom 8 days ago |
Black & grey market devices marked up many times cost buyers heavily, while still suppressing motivation to develop sovereignty.
If nvidia selling to China tolerated for the realpolitik and gets undone by incoming powers to create an appearance of change, is it really the right thing to do? Is it the smart thing to do?
It's an interesting thought experiment, though, we will probably never know.
culi 7 days ago |
Yeah makes sense. They are in transition. This article doesn't really tell us anything new (or interesting). There's nothing wrong w Chinese labs using GPUs that are already in the country. An export ban just means reduced import of new GPUs
saidnooneever 8 days ago |
stratos123 7 days ago |
This doesn't really call the overall results of the report in the question (the strongest finding is the perfectly matching weights for dead-weight rows which weren't touched by an optimizer at all), but it does suggest that the explanation in the twitter thread[2] of how this works is way too simplistic. Are the patterns in question somehow "special" and not erasable even with muon?
[1] https://docs.modula.systems/examples/weight-erasure/
[2] https://twitter.com/willdepue/status/2120992457630326841
coldtea 4 days ago |
octoberfranklin 7 days ago |
treebeard901 7 days ago |
Numerlor 6 days ago |
Alien1Being 7 days ago |
"Western AI models using GPUs export controlled by China"
The decline of the USA and the West has been precipitous.
yumraj 7 days ago |
But, could the fingerprints be due to distillation from Blackwell trained models rather than training?
nittanymount 5 days ago |
> We recovered no signature from DeepSeek-V4.1-Flash (after an exhaustive search),
DS v4.1 is the latest version, no signature found in this model.
sam0x17 7 days ago |
mark_l_watson 7 days ago |
US businesses need two things:
1. access to the very best frontier models for hard problems
2. good enough open models from China, the US (I like poolside.ai, but lots of good choices), and even other countries like France that make smaller investments in Digital Sovereignty.
If the ‘super rich fucks’ in the US who have been making risky AI bets succeed in convincing the US government to curtail the use of small efficient models for easier problems, that will just hurt our economy.
JohnsonZou 7 days ago |
netvarun 7 days ago |
I get that the geopolitical angle is sensitive, especially with the backdrop of today's big news - but I thought this was a really well-researched technical deep dive, right up HN's alley. (TIL: you could fingerprint gpu hardware just from an llm weights!)
nullc 7 days ago |
And these were completely openly disclosed as headline properties of the software: https://github.com/deepseek-ai/DeepInfer/tree/main/#performa...
No one found it remarkable a couple weeks ago, ... but now the fact that DS is using blackwell is apparently some super secret requiring clever RNG init stats???
lynguist 7 days ago |
Which means, in future, we maybe cannot expect such large capability increases.
brcmthrowaway 7 days ago |
Cameri 8 days ago |
demo4567 4 days ago |
K0balt 3 days ago |
It’s perfectly legal to use Nvidia GPUs to train Chinese models. It’s called cloud compute, maybe the author heard of it?
This seems like a Jensen hit piece to me, making it seem like shady Nvidia practices are responsible for Chinese models.
GPU pearl clutching is ensuring that the USA loses the market in the long term. Robotics = local models. Robots will outnumber humans in 30 years. We are making sure that China throws their full ability into catching up their fab technology, and they have logistical and ecosystem advantages that the USA and Europe can never hope to match, not to mention the power production.
We’d be much better off if they kept buying our GPUs and couldn’t justify the enormous investment to catch up their fabs.
syngrog66 5 days ago |
piokoch 7 days ago |
Only Anthropic was stupid enough to let be caught red-handed but get away with some ridiculously low penalty.
elonfboy 7 days ago |
glennfiedler 7 days ago |
flakiness 7 days ago |
sandos 7 days ago |
"Specially configured AMD hardware, which is also restricted from export to China, is the only alternative we have identified; we have excluded it for DeepSeek-V4-Flash"
This sounds as if they are using something VERY fuzzy to "match" things, and if they are ALSO matching against completely different hardware which this makes it sounds like.... then I dont know if this means anything.
gmerc 5 days ago |
htrp 7 days ago |
yogthos 7 days ago |
rubberstamp 7 days ago |
*conditions apply
ftchd 7 days ago |
duty_lines 6 days ago |
Two other mechanics people miss: releasing controlled technology to a foreign national is itself a "deemed export", so staffing matters as much as shipping; and the control lists are keyed to ECCN, not to marketing names, so the classification question is per-part-number and per-performance-threshold, not per-product-line.
None of that makes enforcement easy across borders — the jurisdiction argument above is exactly why the extraterritorial reach fights keep landing in the same place: the US can reach the item and the US-person nexus far more reliably than it can reach a foreign reseller's intent.
apishare_api 7 days ago |
black_13 5 days ago |
exabrial 8 days ago |
fibonacci112358 8 days ago |
“In facilities across the region, Megaspeed rents Nvidia chips to Chinese tech giants such as Alibaba, an arrangement that does not violate current US export control regulations.” See [1].
[1] https://www.atlanticcouncil.org/dispatches/beyond-the-spy-sc...