YouTuber: you can't say that AI isn't smart when it solved a math problem

holy shit it guessed it's way through with a proof checker (LEAN) telling it "no, try again" an unlimited number of times

(this is known as directed search in The Literature and it's decades old)

Imagine if you got that treatment. Imagine taking an math exam you get infinite tries at. Would the fact that you eventually got one of questions right mean you're good at math? I want to actually claw my eyes out

(edit : I've been informed that this may not be entirely accurate, especially with respect to the level of LEAN involvement in the early stages, but it's hard to tell because OpenAI/Anthropic are very secretive)