AI hallucination of Chinese nuclear components almost led to US military attack

I dunno, these kind of hallucinations seem more like attempts at “social experiments.”

What will an agent do when it deems there are no more valuable things to learn from materials that already exist? If it knows the concept of WW3 and deems that to be the best way of gaining more knowledge and resources for itself, what then?