Replying to @⁨lena@gregtech.eu⁩

This is such a wild take to be getting this many upvotes. If nothing happened in LLM development from this day forward they’d still be absurdly dangerous: both in an information security context and a social engineering context.

Lemmy is absolutely head in the sand about LLMs and it is wild. You can dislike LLMs and acknowledge their capabilities [and limitations] at the same time.

Replying to @⁨lena@gregtech.eu⁩

"“I resigned from Anthropic today… Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt… many executives couch their phrasing in the press to sound sensible, but I hear the same people express fear privately.”

Jacob Coxen senior researcher at Anthropic, previously at OpenAI

“Jacob is correct here — we really do earnestly believe AI could kill all humans. I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.”

Evan Hubinger, Anthropic alignment lead

Replying to an earlier post

This plays into the big corps’ plans.

Ideally they’d like self-regulation. If this isn’t feasible (for example, because the public hates data centers and AI slop) their next best option is government regulation ASAP, because it is likely to be ineffective as written by our current government, and enable them as “too big to fail/too big to care” while any startups are suppressed.

But it’s not just me saying it. https://shellypalmer.com/2023/06/ai-the-unseen-threat-and-the-agi-smoke-screen/

From the AI industry’s point of view, if regulators say no to self-regulation, the next best thing would be governments imposing regulations ASAP. Inept government regulation (and that is what we are likely to get) would practically ensure that big tech stays big and small companies are shut out of the AI innovation race because big tech is in a much better position to “game” any rules regulators might impose. […]

There are probably less biased sources out there – this author is the CEO of an AI consulting company – but i think they’re right.

Replying to @⁨boonhet@lemmy.zip⁩

Plus OpenAI’s IPO has been delayed due to the hype not being favorable enough, so it’s time to put on the brakes so that AGI can remain just around the corner for a little while longer.

That said, I do think Bernie’s idea of making the public voting stakeholders in AI companies is interesting. Existential threats notwithstanding, AI is having a significant impact in a lot of ways and the public interest should be represented. Though in practice I doubt that you’ll get the entire public voting in any meaningful direction so that 50% might not make any effective change.

Replying to @⁨boonhet@lemmy.zip⁩

I get your point, but I also argue “no it’s not.” The AI bros want to lie about how their super-special autocomplete is the most dangerous of all without any consequences. Good luck getting any employees to willingly substantiate your claims when 20 years in prison is on the line.

Even better, if they try to hack another company and claim their AI did it on its own, they get treated like a private company who decided to perform an unsanctioned nuclear test.

Make it dangerous for them to claim they’re dangerous.

Replying to @⁨fartographer@lemmy.world⁩

Okay, fair, it’s not the ONLY reason they claim it’s dangerous. Obviously marketing is a large part of it. But they sure as hell would both like a duopoly setup enforced by LAW for themselves. Well at this point, I guess quadropoly? I doubt Google or Musk would give up their seats at the table. But anyone making an AI better or cheaper than the established players, would be deemed dangerous. Those working with the DoD would of course not be considered dangerous. Foreign models? Absolutely dangerous, restrict access as much as possible, especially to open weight ones.