What sort of maths are LLMs good at?(gowers.wordpress.com)
259 points by ColinWright 9 days ago | 156 comments
tl;dr: Following OpenAI's announcement of ten major math/CS results solved by LLMs, Timothy Gowers observes that most headline successes involve finding (counter)examples rather than proving theorems, and explores why. He argues this likely isn't because LLMs favor existential statements, but because their strengths—broad knowledge and rapid brute-force search—suit certain example-finding strategies (off-the-shelf checks, just-do-it constructions, probabilistic/generic arguments). Humans may retain an edge on problems requiring a "nose" for pruning deep search trees toward surprising, conceptual proofs—though Gowers expects LLMs to close this gap soon.
HN Discussion:
  • LLM strength is essentially test-time scaling and random sampling of plausible candidates
  • Agrees with Gowers' criterion that novel, beautiful proofs will signal true LLM math ability
  • ~Focus on famous open problems is sociologically driven and may not reflect real math progress
  • LLMs likely struggle with domains like concurrency and temporal logic requiring careful reasoning
  • Questions Gowers' claim about lack of result flood, citing recent anecdotal LLM math progress