Every time I test and LLM solution and am pleased with how well it works, and I look at the code and it looks reasonable, it’s a lie. It may work, and even look okay, but unless the change was minuscule it’s always doing weird things when I look closely. By the time I’m done fixing the code I could have done it significantly faster myself.
Edit: in case anyone is wondering I only ever use frontier models (the anthropic and openAI ones), I have unlimited access to them from work and mandates to use them.