posted in Technology
More than 400 scientists demand AI models be cut off from the internet immediately and demand a more secure sandboxing for AI models
cross-posted from: https://feddit.online/c/tech@piefed.world/p/2029056/406-scientists-demand-ai-models-be-cut-off-from-the-internet-immediately-and-demand-a-m
ai-security-letter.org/
Replying to @Beep@feddit.online
This is stupid. Open-weight models that can largely do what the OpenAI/Anthropic models did are already out in the wild.
Do these people not understand that you can’t put the cat back in the bag?
Replying to @NoLemurs@lemmy.world
It’s not at all stupid, because there’s no such thing as a “rogue agent,” only rogue users of AI. With proper airgapping, there’s no such thing as a “rogue agent.”
Replying to @lIlIlIlIlIlIl@lemmy.world
I must be missing something, because you’re getting a bunch of upvotes. I don’t disagree with anything you said, but it feels like a total non-sequitur to what I was saying.
Yes - proper air-gapping is a good idea. But asking the big AI labs to air gap is kind of pointless. Liability already gives them legal incentives to avoid incidents. If that didn’t stop them, a letter signed by a bunch of academics sure won’t. More importantly, open-weight models capable of doing all the things that we’re concerned about are already in the hands of bad actors around the world.
This letter is asking us to lock the front door of the house when the back wall is missing.
Replying to @NoLemurs@lemmy.world
Liability already gives them legal incentives to avoid incidents.
That’s quite optimistic, especially since there’s almost no enforcement of liability.
… open-weight models capable of doing all the things that we’re concerned about are already in the hands of bad actors around the world.
Computational resources are the limiting factor. AI companies have resources which no independent actor could ever dream of, which makes them far more dangerous to the general public. A chihuahua with an attitude problem can only do so much damage. A Great Dane with an attitude problem is a threat no one can afford to ignore.