@mattblaze yes, models are human controlled for sure, but whenever I think about the killing problem I’m not sure how else you could solve it aside from programming ethics into the model. There are just too many ways to kill 😂

You could, of course, limit access to all the killing things but then you’re left with no internet access and so on — too many limitations to be of use, probably 🤷

In any case, every “rogue” agent attack involved a sandbox breakout. Building the sandbox is not easy.

@kumarvibe Software correctness and safety isn’t easy. Who told you it was?

But the killing problem can be solved. My word processor can’t kill anyone (Although maybe it could raise my blood pressure by deleting files at an inopportune moment).

Perhaps if you aren’t sure what a piece of software might do, you shouldn’t let it control lethal capabilities?

@mattblaze @kumarvibe I have sixty years in the software industry and I endorse this statement.

Greed is what’s pushing this forward.

@holdenweb oh hey Steve, good to see you on here. Big respect for all your work in the Python community.

@mattblaze unlike word processors, it would only take a minute for a “rogue” agent to break out of its sandbox and trick Donald Trump into annihilating the planet with nukes. I am not sure how one would fix that problem aside from training agents on ethics.

And, yes, it’s fueled by greed but Pandora’s box is open. There is no going back.