It's interesting that this piece stands well enough if you replace mathematics with probably any other intellectual profession, including software development or pretty much anything else.
And, I lie to anyone who asks me why I’m a mathematician.
It is much easier to claim “I love learning the laws of life,”
while literally handwaving, than it is for me to flashback to
the twenty or so pivotal moments that lead to me walking out
of Gainesville with a PhD in Arithmetic Geometry.
Since “normal” people mostly don't understand what the software development job is about, handwaving in response to regular questions: “what do you do at work?”, “what do you like about your job?” – is pretty normal. I think that most of us have some prepared answers ready to use.
Mathematics is the thing you try to understand, don’t,
get frustrated about, and then do.
Just like the software development. I truly believe that the only people who can survive a software job are those who can tolerate the constant feeling of frustration caused by things not working or breaking for random reasons, and persevere in this environment to do the things you need to do.
I feel like the number is higher for software work where I'm at, and lower for every other profession. Scary when you think that your doctor is in it for the money
You can be a software developer without any formal training and without any licensure. Not so for an MD.
It's going to attract more people who have the mentality of artists or musicians, i.e. people who do it for the love of the craft and as a creative outlet.
A PhD in Arithmetic Geometry and a publication in a top tier journal is hardly mediocre in and of itself, as far the author is concerned. The equivalent for a software engineer is probably a leading AI engineer, with a strong publication count. I think a lot of people who are not mediocre are unaware of what mediocrity actually is. Yeah if you're only in the top .1% and comparing yourself to the literal best in the world, you will feel mediocre in that sense . A mid mathematician maybe publication in worse journals, teaching community college.
> We're all frustration addicts. We just want to bang our heads against problems we don't yet know how to solve.
I've been tapering off AI lately. I think I've realized that conquering the struggle is the fun part, and accomplishments just don't hit the same if AI is smoothing over every friction and cordoning off all the pitfalls and rabbit-holes.
> My physicist friend once asked me what the point of doing research was if someone like Terence Tao could have figured out everything in my dissertation in a tenth of the time. I answered by pointing out that Terence Tao didn’t. Terence Tao did not find a small open problem posited by my advisor and publish a bite sized result making incremental progress. He has only so much time and so many other fish to fry.
This reminds me of a post I saw recently, although I can't remember the platform. It said something along the lines of assessing the limits of AI by finding the dumbest questions it can't solve. I think that pairs well as an additional way to view meaning through one's work.
The linked post points out constrained attention as a way to bring meaning to novel work that no one else took on. With AI, this can still be applied to compute.
I'm just wondering if there are a class of problems that humans, at least in the short-term, where humans need to be in the loop to solve more efficiently.
> what the point of doing research was if someone like Terence Tao could have figured out everything
A similar question is now being asked: what is the point of doing research, etc. if something like AI can figure out everything?
The question betrays the parochial way in which many people think about knowledge. For them, knowledge is merely an instrument or an effect. It does not occur to them that knowing is a valuable thing in itself, that understanding is valuable and desirable. Yes, some knowledge has merely practical value, but theoretical knowledge is primarily sought for its own sake, because we desire to know reality.
So, even if Terrence Tao, an AI agent, or who or whatever arrives at some bit of new knowledge, it doesn't benefit you as a knowing subject unless you understand it yourself and make it your own.
Really enjoyed reading your perspective. I am a recent math PhD graduate, and I also find it both exciting and terrifying to see what AI is doing to the field of math.
Hobbies aren’t as fun when you have an overbearing friend who constantly shows off how much more they know and how quickly they can switch to talking about anything you want but in greater depth than you.
I do not have a single hobby where I'm very far beyond the median hobby-haver in skill (that is to say: if you took all other humans who share my hobby, I'm likely somewhere near median for all of them). This may put me in top whatever percentile among all humans, since most humans don't share my hobbies and so are terrible at those things, but there are enough humans out there, and enough humans who share my hobbies, that I have always known that there are people who are vastly better at them than I am. Now yes, if I was constantly being followed around by one of the top 10 hobby-havers, pointing out to me all the mistakes or sub-optimal decisions I was making, that would indeed be annoying and reduce my enjoyment in the hobby. But why do you expect AI to be like this? I would love if I had one of those top 10 hobby-havers on call to answer every one of my (often inane) questions with infinite patience (and who would only talk about the hobby when I specifically initiated the topic). I'm already under no illusions that I'm the best, but it's now easier than it has ever been (for some hobbies, I expect others to join them over time) to get better at them....if one so desires.
I have some bad news for the non-mediocre mathematics. Given it another year or two or so and there won't be much need for non-mediocre mathematics either. Instead everyone will have on call a near magic mathematician who can push the state of the art for their needs.
Math is actually a perfect fit for AI because it is possible to express everything in terms of written language and you can write formal verifications of things. It is just a set of abstract rules, perfect for a computer.
And remember computer science was initially a sub-discipline of mathematics. So after Claude/Codex conquer writing code, it makes sense to move on to mathematics.
Whenever there is a breaking AI-generated proof, it's the job of actual leading mathematicians to formalize/check it . Laypeople are not checking or writing these AI-assisted proofs. Even when Lean is used, it's mathematicians writing these proofs and checking if the formalization was done right. Terrance Tao's career trajectory has reached new highs due to AI. He's more relevant than ever. This is the exact opposite of Ai making mathematicians obsolete.
> Terrance Tao's career trajectory has reached new highs due to AI.
Given he is uniquely brilliant, he is likely one of the very last mathematicians to be rendered obsolete for his skills. But AI is pretty unstoppable here, so I would give me maybe another year compared to pretty much all the just really good / great mathematicians.
To the credit of the original commenter, that is why they said "give it one or two years". _Right now_ we need the experts to formalize/check. They're saying they think LLMs will reach a point in the near future where that won't be necessary.
I’m not sure about this. Anthropic’s AI constructed complex structures on S^6 and wrote a 108 page paper about it, and a few days later there was already a 250k line lean program claiming to verify it.
honestly curious question: do you expect this to remain true? If so, for how long? I can think of two potential reasons why it might not stay true.
1. The very best humans remain able to understand/check the proofs, but we go for so long with every proof checking out that society more broadly just decides to trust. We are already doing that with human mathematicians. I can't verify what Terence Tao tells me is correct, I just trust that it is because he (and other human mathematicians) tell me it is. How many proofs/years of them checking out before we reach this point? I don't know, but history suggests that eventually, humans might keep checking, but they will do so only as a hobby. For any purpose that actually matters, we will just start to trust and use it.
2. The proofs that AI comes up with become too difficult/complex for even the very best human mathematicians to understand, and our options become to either trust or to not use at all.
Obviously it's possible that neither of these happens if AI capabilities stall out not too far beyond where we are now, but if they keep progressing at the current rates for another few years, I expect at least one, and maybe both, to eventually come to pass.
> do you expect this to remain true? If so, for how long?
For the foreseeable future. Left to their own devices current LLMs kinda wander off into outsider art territory. They aren’t grounded in the real world and they need that feedback loop to stay within the category of relevant ideas. I haven’t seen anyone working on fixing that.
Regarding 1, the same is true of every other scientific field. Verifying some tidbit of knowledge for yourself as an individual isn’t optimally useful in all circumstances.
Regarding 2, if the proof isn’t understandable then it probably isn’t useful. Many people today work in the hypothetical world where the Riemann Hypothesis is true, and many work in the hypothetical world where it is false. If it takes decades to validate that some horrifically complex AI proof of either fork is true, people will probably continue working on the other fork just in case.
For software development, normal people will just assume it's money and probably not even ask...
It's going to attract more people who have the mentality of artists or musicians, i.e. people who do it for the love of the craft and as a creative outlet.
Don't jinx it. We are extremely lucky in this regard, and it actually looks like a rare exception.
but as one of the nearby professors is famous for saying: "C students gotta go somewhere."
( and since this is HN - he didn't mean the programming language :D )
I prefer to say "I liked a girl" (because it's the truth)
It kinda is (sadly) because unlike engineering there aren't thousands of postdoc jobs in arithmetic geometry.
And ofc in a year because of AI all math PhDs will be mediocre by definition.
I've been tapering off AI lately. I think I've realized that conquering the struggle is the fun part, and accomplishments just don't hit the same if AI is smoothing over every friction and cordoning off all the pitfalls and rabbit-holes.
This reminds me of a post I saw recently, although I can't remember the platform. It said something along the lines of assessing the limits of AI by finding the dumbest questions it can't solve. I think that pairs well as an additional way to view meaning through one's work.
The linked post points out constrained attention as a way to bring meaning to novel work that no one else took on. With AI, this can still be applied to compute.
I'm just wondering if there are a class of problems that humans, at least in the short-term, where humans need to be in the loop to solve more efficiently.
https://www.gatesnotes.com/a-turbulent-ai-era-and-critical-c...
A similar question is now being asked: what is the point of doing research, etc. if something like AI can figure out everything?
The question betrays the parochial way in which many people think about knowledge. For them, knowledge is merely an instrument or an effect. It does not occur to them that knowing is a valuable thing in itself, that understanding is valuable and desirable. Yes, some knowledge has merely practical value, but theoretical knowledge is primarily sought for its own sake, because we desire to know reality.
So, even if Terrence Tao, an AI agent, or who or whatever arrives at some bit of new knowledge, it doesn't benefit you as a knowing subject unless you understand it yourself and make it your own.
https://terrytao.wordpress.com/career-advice/does-one-have-t...
Math is actually a perfect fit for AI because it is possible to express everything in terms of written language and you can write formal verifications of things. It is just a set of abstract rules, perfect for a computer.
And remember computer science was initially a sub-discipline of mathematics. So after Claude/Codex conquer writing code, it makes sense to move on to mathematics.
Given he is uniquely brilliant, he is likely one of the very last mathematicians to be rendered obsolete for his skills. But AI is pretty unstoppable here, so I would give me maybe another year compared to pretty much all the just really good / great mathematicians.
I guess it could be AI turtles checking and summarizing all the way down, but is that any more credible than a single AI checking it? I doubt it.
1. The very best humans remain able to understand/check the proofs, but we go for so long with every proof checking out that society more broadly just decides to trust. We are already doing that with human mathematicians. I can't verify what Terence Tao tells me is correct, I just trust that it is because he (and other human mathematicians) tell me it is. How many proofs/years of them checking out before we reach this point? I don't know, but history suggests that eventually, humans might keep checking, but they will do so only as a hobby. For any purpose that actually matters, we will just start to trust and use it.
2. The proofs that AI comes up with become too difficult/complex for even the very best human mathematicians to understand, and our options become to either trust or to not use at all.
Obviously it's possible that neither of these happens if AI capabilities stall out not too far beyond where we are now, but if they keep progressing at the current rates for another few years, I expect at least one, and maybe both, to eventually come to pass.
For the foreseeable future. Left to their own devices current LLMs kinda wander off into outsider art territory. They aren’t grounded in the real world and they need that feedback loop to stay within the category of relevant ideas. I haven’t seen anyone working on fixing that.
Regarding 1, the same is true of every other scientific field. Verifying some tidbit of knowledge for yourself as an individual isn’t optimally useful in all circumstances.
Regarding 2, if the proof isn’t understandable then it probably isn’t useful. Many people today work in the hypothetical world where the Riemann Hypothesis is true, and many work in the hypothetical world where it is false. If it takes decades to validate that some horrifically complex AI proof of either fork is true, people will probably continue working on the other fork just in case.