posted in Technology
More than 400 scientists demand AI models be cut off from the internet immediately and demand a more secure sandboxing for AI models
cross-posted from: https://feddit.online/c/tech@piefed.world/p/2029056/406-scientists-demand-ai-models-be-cut-off-from-the-internet-immediately-and-demand-a-m
ai-security-letter.org/
Replying to @Beep@feddit.online
This is stupid. Open-weight models that can largely do what the OpenAI/Anthropic models did are already out in the wild.
Do these people not understand that you can’t put the cat back in the bag?
Replying to @NoLemurs@lemmy.world
You think scammers in Africa/India are capable of running a local open weight model equivalent to the performance of a cloud frontier model?
Replying to @magnue@lemmy.world
The ones in Russia definitely are. They don’t have to be local models - you run them in the cloud like anyone else.
The idea that the frontier labs have LLMs with special capabilities that make them dramatically better than the top open-weight models is largely marketing.
The reality is that most systems are poorly secured, and LLMs make exploiting vulnerabilities fast, cheap, and easy. What would have taken a trained security researcher weeks before can be done by a much less skilled attacker with an LLM in a few hours.
Replying to @NoLemurs@lemmy.world
This is correct. We can thrash all we want about slop and hallucinations, but from a defensive posture position, the models only need to be right some of the time and they still constitute a threat.
Knowing it sucks and pretending it doesn’t exist are two different things.
the models only need to be right some of the time and they still constitute a threat.
Right!?!
And with how cheap and fast they are to run, they don’t have to be right that often as long as a separate run can verify/validate claims. In a lot of ways what the LLMs do should probably be thought of as just a very sophisticated sort of brute force approach. You’re effectively just searching the space of combinations of known vulnerabilities. It doesn’t require particular cleverness, just an encyclopedic knowledge, a reasonable way to prune the search space, and the ability to put in the compute time.