Letters
Formal Verification Meets Unverifiable Judgement: Don’t Overgeneralize from Progress in Math and Code — The Hardest AI Problems Still Require More Work
The gulf between LLM performance on verifiable tasks vs. unverifiable tasks that require judgement is larger than most people realize.