I will say, there’s plenty of arguments against AI but one I’m not convinced on is “what if AI goes rogue” (in its current incarnation)
There is a major misunderstanding of how truly complex they are. I’ve tried the newest models. They’re… not that sophisticated. Nowhere near AGI for sure.
Existing AI systems have no thoughts, no intrinsic goals, no feelings, no desires. They just take text and emit a stream of text based on a sophisticated model.
If “AI goes rogue” then it was programmed to go rogue, and a person did that. Someone commanded it to do something and somewhere along the line it was trained to do exploits. Regrettably, people in fact do go rogue and they actually don’t need AI to do that. ChatGPT doesn’t commit mass sabotage. In this case, a real person commits mass sabotage using a system to do it.
This is like saying conficker was a computer going rogue. The computer did not “go rogue.” It was an exploit.
