Since none of the tech companies "red teams" seem to actually red team their own shit and leave them riddled with trivially exploitable bugs, I wonder if I could get a job being an actual red teamer who hates the product and tries to break it with malice. How do you get that kind of job. Like everyone else I have listened in envy to the pentester episodes of darknet diaries and I want that for me.

The reason I can say with 100% confidence that coding is not solved ans I am not actually just a doomer getting left behind is because I actually look at the output, and if the code gods were actually writing code that was so good we can't comprehend it, then I would not be averaging two or three 0-click account or full-fleet takeover vectors a day as a total scrub.

On the other side, i assume they are all also doing full auto LLM pentesting, so that also clearly doesn't work. It might be able to brute force its way into some esoteric memory allocation bug with access to the source code, but like how 99% of security is just telling people not to write their passwords on a sticky note on the monitor not high-tech exploits, most of the bugs I am finding are things that an LLM would never imagine are an attack vector because they are so silly and shouldn't be possible. When I have sent the meta models, Claude, and open weight models to go bughunting, even directing them straight towards something i just confirmed to see if they find it,, they get waylaid by ambient strings that say how things should work, or fall back to trained patterns of how things in the shape of what they are looking at normally work. They often don't even try doing things like "just call super-secure-secret-vault" because they assume they can't. The LLMs are good for stuff like first pass RE, but can't really chain together an attack when part of the chain involves "imagine this thing is shittier than the shittiest possible thing you could imagine and you can just press the god mode button"

@jonny Of course they can't do that, they can't imagine anything. You're anthropomorphising them! Too much time around them even as a hater gives you the AI psychosis and you start thinking about them like a being that can make assumptions.

@tael
Please interpret my use of "imagine" as "produce the corresponding text" and I am using language as a system of metaphor and shorthand rather than affirming the literal meaning of every word uncritically.