277 points by simianwords 3 days ago | 411 comments | View on ycombinator
layer8 3 days ago |
fruitl00p 3 days ago |
Chance-Device 3 days ago |
Here the worry is the social structures of mathematics are eroded such that fewer humans become able to do the work and less well, similarly to how juniors are being recruited less in software engineering, breaking the ladder and leading to fewer seniors in the years to come.
The answer to this really depends strongly on what AI can actually accomplish, but I’ll assume the maximal case and say that AI can do everything economically necessary, and further even those things just desired, such that human labour isn’t required for anything that anyone wants in a practical sense.
Here, we don’t need a human understanding of mathematics to give people a perfect standard of living. We also don’t need humans involved with anything else.
Everything therefore becomes a hobby or a game. People do things because they enjoy them for their own sake, or because they are endeavours used as vehicles to socialise and enjoy others’ company, or because a shared social belief exists and is cultivated such that doing such and such a thing confers social status.
And I think that’s more or less it. I predict we may see some fairly strange sorts of things, such as games where the team structure looks like the descendant of a company org and they compete in an artificial economy. Likewise we may see gamified versions of universities and academia. All of these would be “tamed” such that the rougher parts of the experiences were sanded off.
Sort of like how we evolved in an ancestral environment, and we have certain drives and expectations driven by that environment even though they no longer matter for survival. Our social structures may be derived similarly from those of today, even after they have ceased to serve a real purpose, but changed and repurposed to give meaning and community.
ceejayoz 3 days ago |
edit: Link changed; it was https://terrytao.wordpress.com/2026/09/17/why-i-didnt-sign-t....
koliber 2 days ago |
My wife cooks to produce a meal and feed our family. The journey is a necessary evil to achieve a goal.
We are aware of this difference in style and have learned to appreciate what each has to offer. At the same time, we sometimes annoy each other in the kitchen.
There is an analogy here to what this essay says.
modeless 2 days ago |
This seems like the crux of the argument to me, and I agree.
> my worry is not that we would be unable to [digest the mathematical results from the AIs], but rather that the social structures that currently support this digestion process will be destroyed and not adequately replaced.
A valid concern! And one we will all face soon enough, as AI continues to automate parts of jobs that were once manual.
cmplxconjugate 3 days ago |
poszlem 3 days ago |
Funny. Reminds me of programmers who like to program, and programmers who like programming because it lets them build things. The first group hates AI, the second loves it.
gnramires 2 days ago |
I think offline exams already work pretty well for this, although I think they do tend to favour a bit much a specific kind of student, so other types of exams could be mixed in, like the proposed digestions of Tao et al, maybe giving a lecture and have a student/professional panel give it a pass/fail, and so on (just throwing a few ideas!).
At least, as far as I can tell this is the urgent matter, along with convincing students that being a mathematician is still a valid choice, and funding agencies that mathematicians should still be funded. That last point is where I think the general public should speak in support of keeping funding, I am not sure at what level. I know there are many other issues in society, like people with food insecurity or just hunger in many parts of the world, preventable disease, etc., but I think it's worthwhile to keep professional mathematics (not sure at what level?) because of how much our complex society benefits if not relies on it still.
piker 3 days ago |
This is easy to me. Truth should be the North Star. If there is a fundamental truth that can be found via mathematics, then the shortest route to that truth should be preferred. While LLMs are definitely capable of solving problems in search of truth, I agree with Tao that instant "true/false" results threaten to short-circuit the traditional avenues we have used to escape local minima in the search for truth. Their products may be the junk food that provides immediate satiation in exchange for long-term health. Perhaps it's wrong, though.
threethirtytwo 2 days ago |
These theorems DO benefit humanity but are largely unseen. You ask the LLM to make you an app. The LLM makes the app and utilizes entire languages, theories and processes made by discoveries that you as a human are not a privvy to. It all goes into the this body of knowledge only decipherable by AI.
This is the future AS long as current trendlines stay the same. As long as progress keeps going at the rate it currently is going. This is the best predictor.
Personally, and I have no evidence for this though, I think we'll hit another barrier and AI will stop making progress for about a couple decades or so. So humanity still has some time to have fun before something gets over the hump.
dist-epoch 3 days ago |
shripadt 1 day ago |
This makes sense to me - intuitively, there is a lot more good mathematics to be done than humans are currently able to produce, so focusing human labor freed from production on verification of AI-produced results instead is more valuable now.
YeGoblynQueenne 1 day ago |
Is that really the case? The cost to OpenAI for the Navier-Stokes problem has been estimated in the millions of dollars, anything between 6 and 40 million depending on who you ask. Now, I know that OpenAI has a lot of money stashed under the mattress but we have to remember that they by no means had any guarantee that the money they spent would actually solve the problem. In fact, they have probably burned similar amounts of money for many other problems that we have never heard anything about, for the simple reason that their super-secret in-house special models didn't solve them.
What I'm saying is that you need to think of the monetary constraints to solving major open problems in maths etc. If it costs millions of dollars a pop for a shot in the dark that has a small chance to succeed, that's not something that's sustainable. Letting the users take on some of that cost by burning through their own token budget so that they can claim to solve a problem that "has stumped mathematicians for 80 years" and the like, can make reduce the cost a bit but by how much? Remember that OpenAI had 10,000 agents running for 88 hours on Navier-Stokes. Who, outside of AI companies, has that many tokens? What power user is going to spend thousands of millions to try and solve the Millennium Prize problems?
So, really, maybe mathematicians who are looking forward to a new era of AI-generated results that advance mathematics may end up being disappointed. AI companies are not charities, they do not really care about mathematics and they aren't doing things that they don't think will bring them more money, somehow. And when did solving mathematical problems bring anyone any money?
swyx 2 days ago |
Trusteando 3 days ago |
jdw64 3 days ago |
Before arguing whether mathematics must strictly be done by humans, there are different motivations at play. Some people love the sense of solidarity within the community that forms during the process. Those excluded from that community might resent it, while others just purely want to solve problems.
Many things are being discussed, but looking at the overarching narrative, it seems that AI's true function isn't necessarily opening new horizons of specific knowledge, but rather excelling at 'serializing' topics that have been heavily fragmented until now.
In that sense, the concern is that because AI is solving the very problems needed to cultivate mathematicians internally, the stepping stones required for human growth are disappearing.
However, on the other hand, as the world and industries become increasingly complex and hyper-specialized, you could also argue that AI is the exact tool needed to unify this fragmentation across academia and industry. It is a highly complex dilemma.
From the perspective of researchers and the mathematical community, those 'problems for growth' must remain. But conversely, AI has the distinct ability to serialize siloed disciplines. Usually, when you go to graduate school, you often hear professors say that even within the exact same major, they cannot understand each other if their sub-specialties differ.
layer8 3 days ago |
This is the main issue, and while I fully agree with that value sentiment, the referenced letter failed to provide convincing arguments for why mathematicians should widely receive funding for merely understanding things, and how competition for postdoc and tenure positions would work.
waynecochran 2 days ago |
hellojomp 3 days ago |
This is the state of affairs today and how everyday people will talk about it.
Almondsetat 3 days ago |
Now, if an LLM proves a theorem, it's like discovering a new mountain and knowing what its peak looks like. Does that mean the problem is finished? No, we still need climbers to actually do the work and advance the field with human understanding.
undefined 2 days ago |
undefined 3 days ago |
singularity2001 3 days ago |
elisbce 2 days ago |
undefined 3 days ago |
asdfman123 3 days ago |
There's definitely the possibility that in just a few years, human mathematicians will largely become irrelevant in the face of extremely capable models.
I don't like it, I think there are a lot of bad side effects to it, but I think it's important to face that possibility.
claiir 3 days ago |
bubblegumcrisis 2 days ago |
Uber comes in, destroys competition using venture capital, promises a utopia for drivers and riders - then - when the time is right, they use the hollowed landscape to charge more and control the market.
Maybe, it's not so smart to trust tech psychopaths when they say everything will "be better when we take over."
2341aF 3 days ago |
unified101 3 days ago |
whattheheckheck 2 days ago |
31ahg167 3 days ago |
Few of them mention research theft, none of them mentions concentration of capital and resources.
The fact that Gowers quotes Tsimerman (OpenAI employee) says it all. A couple of mathematicians are determined to bulldoze forward with AI, and I suspect Tao will also continue after the meek concern letter and the cleverly worded guest posts that are subliminal ads for AI.
jgord 2 days ago |
However, math and science and engineering and biology/medicine have profound implications - those useful parts of that 'culture' - which we call 'technology' - extend human lifespan, healthspan, prosperity, safety.
The main practical value of investing in maintaining a population of math artisans is that they are/were needed as part of a well-trained science community needed to discover and develop new useful technology.
I think its a rational view to say LLM generated "AI-math" is a net positive if and only if, it results in _more_ high quality "human-math". By human math I mean well digested math residing in human minds, being discussed between humans and being actively re-discovered by humans, including a pool of new human student devotees.
A very bad outcome is where we lose the next generation of scientists/lawyers/mathematicians/engineers/doctors/researchers/authors because we let the AI do it all. In this dark future we outsource all our 'thinking', and avoid the years long training of grappling with hard-to-understand aspects of reality. All our culture is sucked into the event horizon of an AI black box.
AI could be a new renaissance of human math- and science- culture, or it could be the death of it.
AI isnt going away, the financial incentives and high current economic inequality, geopolitics guarantee that it will proceed as fast as possible.
AI has given us the structure of nearly every protein, which may well solve Alzheimers and cancers. AI may well find a solution to stable plasma for nuclear fusion, unlocking vast cheap energy and help us humans halt global warming.
So, how do we make sure that the economic windfalls of AI are reinvested back into human-culture, funding more human-math and human science .. resulting in a deeper pool of well educated scientists, engineers and researchers ?
I don't think that will happen by default - we are likely to have an AI-assisted dumbing-down rather than an AI enabled age of enlightenment.
Most of the general public are happy enough not to learn any math - when it doesn't make you much money and university is such a debt burden anyway. School and university students can just get the LLM to do their assignments. Why should they pay tax to fund science at universities when the cost of living is so high, and the LLMs can do all the research anyway ?
I think part of the solution is a policy to tax the windfalls of AI to mitigate the downsides of AI.
Governments should have taxed the carbon polluters and used those funds to mitigate climate change effects and research new forms of clean energy, but didnt.
We should tax LLM/AI profits and use that to fund science research - not just research to mitigate the effects of runaway AI, but to fund general science and math research and teaching, to guarantee that there is a net increase in human-math and human-science.
It is a cautionary tale that fewer students know their times-tables by heart, because a cheap calculator can do that ... but it gives me some hope that there are still people enjoying playing chess, even though chess programs are super-human.
samatman 2 days ago |
For those of you who haver never slid a slide rule, here's the part that makes this anecdote make sense: they're a mechanical logarithm, this allows one to do multiplication as addition, but there's a catch: you have to know the "characteristic", that is, the order of magnitude of the result. The slide rule won't tell you that.
They argued that this requirement leads to an intuitive grasp of magnitudes, which is of real benefit to the discipline.
And they were correct. However, engineering is, by all appearances, doing just fine.
Where they erred, and it was a natural mistake to make, is in assuming that pedagogy must recapitulate phylogeny. That engineers should start with the slide rule, just like the profession did, and then graduate to the calculator, just like their professors did.
But this is wrong. It makes the slide rule an impediment: a known-to-be-obsolete object, standing between the student and graduating to the device he or she knows, full well, is what will be used for the rest of his or her career.
Instead, teach the concepts and the foundation with the modern tools. Then, senior year, in addition to the thesis project, teach "OG" engineering: slide rules, graph paper, mechanical pencils. Along with the thesis, which should stretch all the skills already mastered to their limit, require a feat of engineering which is within the student's capability, but: no CAD, no calculators.
This would actually work. This gives them an opportunity to find out what they're missing, build some of that order-of-magnitude intuition, really solidify what a "sketch" in CAD is all about, all of it: and understand that any force multiplier can be a crutch, if you let it.
I've been just delighted with what I can accomplish in "centaur mode" with LLM agent assistance. I've made real progress on longstanding research topics. But to do so, it's essential to never let them be a substitute for one's own understanding. They turn out to be really good at explaining difficult passages in research papers!
My gloss on what's happened with LLMs in mathematics (understand, I am not a mathematician), is that we're discovering that solving conjectures is just not that important. Not the first time this has happened: simplifying and manipulating algebraic equations was very important, and then, it wasn't.
Making conjectures, that's where the action is. Always has been. No one thinks that solving an Erdős conjecture puts one in the same rank as Erdős Pal, because it doesn't.
When the first mainframe computers came along, there was a brief flurry of conjectures, some of them longstanding, which were either proven or disproven by brute exhaustive search. What's happening now is different in magnitude, and even in kind: but more in magnitude than in kind.
It wouldn't be fitting to be glib about the disruptive effect this is having, and perhaps (although I don't think so) we'll cross some threshold at which it doesn't even make sense to contemplate humans doing authentic intellectual labor. That would be bad. If you think that's on the horizon, you're right to be upset about it; I don't, but I won't try and persuade you otherwise, because the point is far from obvious, and both of us are predicting the future, which is known to be a risky business.
The "publish or perish problem" which this new development surfaces is not new to this development. The entire concept is well past its sell-by date, and while mathematics is perhaps the intellectual pursuit least corrupted by the dog-and-pony show, it is and has been undignified, inhumane, and always to some degree dishonest. Time to come up with something better.
calf 3 days ago |
That said, I think there is an articulable concern about the recent AI events as it may threaten human's autonomy and relation to science and mathematics. Just not one premised on that. What's interesting is seeing different academics having predictable reactions, for example Sabine Hossenfelder is more politically libertarian so in this case she said DGAF about human mathematicians at all. Scott Aaronson is another interesting example, he wrote a blog post a couple days ago as well.
akarnam37 2 days ago |
axionbraid 3 days ago |
undefined 3 days ago |
gleezard 3 days ago |
londons_explore 3 days ago |
21asdffdsa12 3 days ago |
carabiner 2 days ago |
GPerson 3 days ago |
> AI offers the potential of enhancing and accelerating genuine mathematical study and understanding. Mathematics as a profession will need to adapt to these changes in several ways. However, whether these changes ultimately benefit the field or have a destructive effect will in large part be determined by the decisions of the humans in control of this new technology.
This is the main issue, and while I fully agree with that value sentiment, the Fields medallists’ letter failed to provide convincing arguments for why mathematicians should widely receive funding for merely understanding things, and how competition for postdoc and tenure positions would work under these circumstances.