PPlamenu
HomeTrendingLive feedsPeopleGroupsRulesStaff
Sign in
PPlamenu
HomeTrendingLive feedsPeopleGroupsRulesStaff
Sign in

posted in Technology

lavander@lavander@lemmy.dbzer0.com
⁨23⁩d

OpenAI cyber models broke out of training environment to hack Hugging Face

It would be interesting to read the post mortem (if they will release). In particular in which phase of the training it escaped the sandbox, in which way it used the information. Training is different from inference, I doubt there is a context there and where would the model store these information? In the weights?! That makes little sense to me

www.cnbc.com/2026/07/22/open-ai-cyber-models-hack-hugging-face.html
CNBCOpenAI cyber models broke out of training environment to hack Hugging FaceThe incident is unique because it was "driven, end to end, by an autonomous AI agent system," according to Hugging Face.
410-19
Open original page
BoostsQuotesFavs
dparticiple@dparticiple@sh.itjust.works
⁨23⁩d

Replying to @⁨lavander@lemmy.dbzer0.com⁩

Simon Willison’s blog has some useful insights into what might have happened here: simonwillison.net/2026/Jul/…/openai-cyberattack/

Simon Willison’s WeblogOpenAI’s accidental cyberattack against Hugging Face is science fiction that happenedThis story is wild. The short version: OpenAI were running a cybersecurity test against an unreleased model, with the model’s guardrail features turned off. Rather than solve the test, the …
1000
Open original page
BoostsQuotesFavs
lavander@lavander@lemmy.dbzer0.com
⁨22⁩d

Replying to @⁨dparticiple@sh.itjust.works⁩

Ok this would be at inference time (solving the challenges) as opposed to the training that was described in the article.

This makes things more believable

⁨Jul⁩ ⁨23⁩, ⁨2026⁩, ⁨21:42⁩en
0000
Open original page
BoostsQuotesFavs