Incidentally that’s why I don’t let it go crazy on anything without tests. Shit, it could rerun the test 10 times if it needs to, I don’t really care what the intermediate steps are, just that the end result is correct and it isn’t polluting my codebase with 7 line comments and docstrings for helper methods that are simpler than left-pad. If it then successfully fixes a difficult-to-find (but often easy to fix) bug that stems from changes to a large upstream codebase 9 times out of 10, then as far as I’m concerned, the accuracy of the tool I’m using is 90%. Don’t much care if the underlying model’s accuracy is technically only 50% or maybe even less. Still haven’t found a definitive solution for the claudespeak comments. They’re annoying and no matter how and how many times I tell it to stop adding them, it will fucking not.
Which is ALSO why I think asking a chatbot for advice on anything you’re not knowledgeable about yourself is a horrible idea.