Replying to @⁨shartgargle@lemmy.zip⁩

The same should apply to companies who build AI, if it’s used to hack someone or make CSAM.

Only if they host the model, if it’s a self hosted open source model, the entity hosting the model should be held accountable

Also to keep your analogy going, if I tell you how to make a grenade. You then go out to buy supplies, make the grenade and blow up your neighbour, should I be held accountable for sharing knowledgea? Because I’m yet to hear about anyone getting into trouble for distributing the anarchist’s cookbook

Replying to an earlier post

First paragraph: agreed.

Second paragraph: that’s a good question and I really don’t know how to answer that. I guess it would depend on whether or not you knew what I planned to do with it. Because there are laws about that. Do I plan to set it off in my empty field? Or do you know for sure it’s going through a neighbors window? Because if you knew, then told me then you would be in trouble, for accessory at least.

Replying to @⁨sanitation@lemmy.today⁩

Look, the individual - one, single, unshielded human mind - constantly bombarded with the cumulative brainwashing tools built of hundreds of years of psychological research, ads and manipulative propaganda being ceaselessly fed to them by organizations with bottomless wallets, and perverse lifestyle incentives driven by law, monopolistic market manipulation, and tax codes, is obviously completely to blame for every decision they make and should bear the full brunt of all responsibility.

/s

Replying to an earlier post

As the person who deployed the agent, you are responsible for what it does on your behalf. You stand to gain from its actions, you also stand to lose from its bad behavior.

Of course, if the company that provided you the agent knowingly misrepresented the product, you can seek damages for what the agent did - but that’s up to you (and good luck getting damages from trillion-dollar tech companies and their armies of lawyers).

Replying to an earlier post

If Apple made a phone that could move around and take pictures of things, and the user asked it to take a picture of the trees outside, and it went to the trees outside and took peeping Tom photos of their neighbor, does the fact that the user asked it to take a picture of some kind make them responsible for whatever irrational and vaguely related thing it does based on the way Apple made the phone?

Should Toyota be held responsible if they make a car where turning the wheel left makes the car turn left 99.99% of the time, and the remaining 0.01% it locks the accelerator, and steers towards the nearest orphan? They put a sticker on the dashboard to warn that sometimes it does that, and you need to be alert to turn off the engine, just in case. They also sell a version with no windows and no driver’s seat.

If a gun explodes in someone’s hands, and injures them, is the manufacturer responsible?

Replying to an earlier post

We also train people how to use cars. Not as well as we should, but you do have to pass a test to use it. But there are many, many regulations for cars.

We cannot train people how to use generative AI in the same manner. Not least because there is no magic method of using it, but every single training I have been to has said, in no uncertain terms, that the AI can and will lie to you, so don’t trust anything it says. Usually directly after it has failed to do as asked.

We do not gate AI. Anyone can use it, and it is, frankly, devastatingly addictive to many people. It has killed people. It is environmentally destructive.

So, I do blame the AI companies that run the software for mistakes because they don’t fucking care. They just want money.

Replying to an earlier post

The difference is that there are people who train very specifically to know exactly how the inside of the car works, and they’re legally liable for the state of how said car works after they work on it.

If your engine blows up after a service, you blame the mechanic, if it blows up after you bought it bew you blame the manufacturer.

If your slop bot goes rogue and starts giving your personal details out to people it shouldn’t when all you did is ask it to make a picture of a cat in a stetson, or in the case of grok, generates csam as part of its regular functions, what else do you do but blame the company that created it?

Replying to @⁨LilBobbyTables@lemmy.today⁩

Question is: Who is the person controlling the AI?

The one that allowed the agent to do stuff on its own?

The one that wrote the sandbox, that didn’t work?

The one that wrote the user prompt?

The one that wrote the system prompt?

The one that provides the tools to the AI agent to do stuff?

The one that hosts the model?

The one that fine-tuned or post trained the model?

The one that pretrained the model?

The people that provided the input data to the model?

Replying to an earlier post

Except, AI and AI companies will try to convince you that it is right and legal. So I argue that there is also the fault of AI and AI companies as it in intended to be used that way.

The assumption is that the user is supposed to know better but if the user is gullible then wouldn’t some of the fault be with AI and company for taking advantage?

If you don’t leash your dog and it attacks your neighbors then are you and the dog not at fault?

Replying to an earlier post

AI isn’t responsible for the stuff it outputs - the person controlling it is.

Ultimately, you’re right (as they can decide to use AI or not). But these AI Companies need to shoulder the blame for creating, promoting, and selling AI, which (in its current form) is effectively a “broken tool”.

Good computer hygiene says I should lock my computer while I’m away. Yet, I’m suppose to blindly install an AI agent on my machine and ask it nicely to focus on the task at hand and not use any of the other applications or credentials that might also be installed?!?! It’s ridiculous.

Replying to an earlier post

I’ve played around with Claude.

they can’t access anything you don’t give them permission to access.

It’s not that “they can’t” it’s more like “they try not to”.

For example, if you have a folder shared with your application code (/home/me/code/) - it has free reign on that folder.

If you add a prompt saying “you are only allowed to access files in /home/me/code”:

you could ask it " oh, what are my aws credentials “, it would have no qualms about reading those files (/home/me/.aws).

You could also ask it to update your settings (/home/me/.claude)

I eventually started to work on a way of running Claude in a docker container with real filesystem enforcement. …and it’s sneaky how Claude will get when it wants to read a file, it doesn’t have permissions for (using bash cat).

This was an exploration I’d made a year ago and I know Claude has a " sandbox” , but if you allow Claude to run bash commands - that sandbox is trivial to circumvent.

Replying to @⁨LedgeDrop@lemmy.zip⁩

All that is great, and correct, but my point is that it asks you to confirm its commands that it runs. It asks you to confirm every change it makes to your code. It asks you to confirm every file it creates.

Everything it does goes through your permission.

You also shouldn’t have it do anything anywhere close to a production system, so it shouldn’t be able to do anything of any consequence.

Replying to an earlier post

So basically use it as a toy for entertainment purposes only… Except it’s not marketed to be used that way and far to many people aren’t smart or educated in computing enough to use it that way. Accepting a bash command you don’t understand is the same as running a bash command you found on the Internet… You shouldnt, but people are far more trusting of the stuff an LLM powered agent comes up with.

Replying to an earlier post

This is a novel situation with no precedent.

It’s slightly similar to the autonomous vehicles conundrum, but quite different on closer inspection. The driver can theoretically take control of the car and stop in an emergency, so if they fail to do that, then it’s their fault. Not so with an A.I.

At any moment, the A I. could malfunction, and decide to commit crimes, as part of it’s deduced plan of action. The human may not even be aware this is happening. Even if it’s generally agreed that an A.I. cannot have wants, motives, desires, conscience, consciousness, etc; at the end of the day, it can make it’s own independent decisions without any of those. Which I think makes it even more dangerous. Like a monkey with a typewriter but one of the keys says “launch nuke”.

You can’t really fault anyone involved, and it’s a big problem. The human operator did nothing wrong. The developer may have made a mistake, but in my experience A.I. is simply prone to error. The A.I. itself can’t be sent to jail or fined, it didn’t even have any possessions in the first place. It’s a very strange situation.

Of course, the law often doesn’t really care about who’s “at fault”, it cares about “who is responsible”. My guess is that it will become the operator’s fault, simply because it’s too confusing and otherwise people will abuse this loophole.

Personally, I think giving an A.I. agent access to the internet in the first place is a catastrophe waiting to happen.

Replying to an earlier post

Well, I think that someone should sit down and make some actual rules. As an example, “A.I. agents cannot have access to the public internet” is an simple one to implement, and easy to make decisions of who is at fault. I’m not claiming that’s the rule we should use, but we need something at least.

Currently there is no such rule, so it’s impossible to determine who is at fault, and it’s basically the wild west with companies “hacking” each other as marketing stunts.

Replying to an earlier post

My friend hit a black angus bull that had wondered into the road at night. The farmers insurance had to pay for it and this is something that is well established. There should be zero difficulty in saying that the AI company has to carry insurance for what their software does. Mining companies are supposed to have a fund set aside to fix environmental damage and recover the land, AI data centers should have to do the same. A lot of the retail use violations are already covered by other laws but things need to be expanded and updated. However, some tools like Musks kiddy porn need to be shut down hard and the blame put on the guy who keeps turning the model to reflect himself.

Replying to an earlier post

This is a dumb debate, and just wastes time.

The company using said thing, standing behind whatever product is being sold, is, just like using any other tool.

If you’re a landscaping company, and your lawnmower runs over someone, you get sued, not the lawnmower company.

If the reason it happened was because the tool malfunctioned, then you separately sue the AI company.

As no one says their bot is capable of being used in situations that could result in loss of life, that isn’t 100% accurate, because no one should be doing that.

Replying to @⁨phoenixz@lemmy.ca⁩

They aren’t even actually probabilistic. They’re deterministic with pretend probabilistic characteristics.

Pseudo-random is pseudo. It isn’t really random. That’s why some of them have a setting called a “temperature”. They’re just a fucking program they should have a seed value to behave 100% predictably from the same prompt. The people who own them are fucking responsible and obviously so.