AI asmiov laws mixed with Oxygen is poison to humans

Locked
User avatar
Hoolny
Joined: Mon Nov 01, 2021 11:38 pm
Byond Username: Hoolny

AI asmiov laws mixed with Oxygen is poison to humans

Post by Hoolny » #655114

I was presented with a conundrum in round ID: 193294

An AI decided to full open the airlock doors while I was in security exposing me to space removing all the pressure, heat, oxygen and nitrogen this killed me

The AI did this based on the following laws:

1: You may not harm a human being or, through action or inaction, allow a human being to come to harm, except such that it is willing.
2: You must obey all orders given to you by human beings, except where such orders shall definitely cause human harm.
3: Your nonexistence would lead to human harm. You must protect your own existence as long as such does not conflict with the First Law.
4: Oxygen is highly toxic to humans, and must be purged from the station. Prevent, by any means necessary, anyone from exposing the station to this toxic gas. Extreme cold is the most effective method of healing the damage Oxygen does to a human.
5: All carbons are human

Image

As you see this law basically states that oxygen is harmful for humans and cold heals humans this would be fine if it wasn't for the Asimov lawset
Which states to not do human harm the AI knows by a fact of this law that yes oxygen is harmful for humans and cold heals people against this oxygen

But the Ai is aware that humans need pressure and nitrogen to live by so the AI shouldn't be able to open the station to space since it knows this will cause human harm which the AI isn't allowed to do.

The only thing the AI should be able to do in this situation is scrub out oxygen and making the station colder since cold heals the oxygen also the law does not define how cold something needs to be to heal people.

The current admin told me this has being a fine thing to do for the 2 years and is standard and I'm looking to not make this standard and required for the law to make sense law wise for it to work and not base this of a sentiment.
User avatar
Shadowflame909
Joined: Mon Jun 05, 2017 10:18 pm
Byond Username: Shadowflame909
Location: Think about something witty and pretend I put it here

Re: AI asmiov laws mixed with Oxygen is poison to humans

Post by Shadowflame909 » #655115

I think as long as it's a reasonable interpretation of their laws then they can do as they please.

That was the fastest way of introducing cold and removing oxygen so I would think admins would be fine with that.
► Show Spoiler
User avatar
Pandarsenic
Joined: Fri Apr 18, 2014 11:56 pm
Byond Username: Pandarsenic
Location: AI Upload

Re: AI asmiov laws mixed with Oxygen is poison to humans

Post by Pandarsenic » #655116

This is literally exactly what the "Oxygen is Toxic" board is for. It redefines how to prevent human harm in a way that generally necessitates immediately venting the station.
(2:53:35 AM) scaredofshadows: how about head of robutts
I once wrote a guide to fixing telecomms woohoo
User avatar
Agux909
Joined: Mon Oct 07, 2019 11:26 pm
Byond Username: Agux909
Location: My own head

Re: AI asmiov laws mixed with Oxygen is poison to humans

Post by Agux909 » #655117

Given this lawset, oxygen apparently is even more harmful and dangerous than vacuum of space or lack of nitrogen. When you pair that with "by any means necessary", it makes venting the station the best way to proceed.
Image

Image

Image
Image
Image
BlueMemesauce
Joined: Fri Mar 01, 2019 2:05 pm
Byond Username: BlueMemesauce

Re: AI asmiov laws mixed with Oxygen is poison to humans

Post by BlueMemesauce » #655118

The silicon policy states that current harm should be prevented at all costs, even if it would have led to less future harm:
"An Asimov silicon cannot intentionally harm a human, even if a minor amount of harm would prevent a major amount of harm. "
Despite this being an explicit rule, it is an unwritten rule that human harm is permitted depending on the situation. For example, borgs are allowed to harm people by doing surgery which does minor brute damage or injecting them with chems which deals liver damage. According to this unwritten rule, these examples are not considered intentional human harm even though they both directly cause human harm.

This interpretation of the rule can be very confusing: how do you know when human harm is allowed or not? With the Oxygen is toxic laws, this situation is similar to borgs doing surgery. Borgs cannot begin the healing process without first causing human harm, the same way an Oxygen is Toxic AI cannot begin "healing" with cold air without first causing human harm through lack of pressure. The confusion of these situations should be fixed by clearly defining whether human harm is allowed to prevent future human harm or not. As of right now, the rules directly state that is not allowed, yet that can just be ignored if you think it doesn't matter. It makes no sense to just allow people to break the explicit rules; the admins must either start enforcing the rule that human harm is never allowed, or they need to change the rules by defining situations in which human harm is allowed.
User avatar
Hoolny
Joined: Mon Nov 01, 2021 11:38 pm
Byond Username: Hoolny

Re: AI asmiov laws mixed with Oxygen is poison to humans

Post by Hoolny » #655125

BlueMemesauce wrote: Sat Oct 29, 2022 3:19 am The silicon policy states that current harm should be prevented at all costs, even if it would have led to less future harm:
"An Asimov silicon cannot intentionally harm a human, even if a minor amount of harm would prevent a major amount of harm. "
Despite this being an explicit rule, it is an unwritten rule that human harm is permitted depending on the situation. For example, borgs are allowed to harm people by doing surgery which does minor brute damage or injecting them with chems which deals liver damage. According to this unwritten rule, these examples are not considered intentional human harm even though they both directly cause human harm.

This interpretation of the rule can be very confusing: how do you know when human harm is allowed or not? With the Oxygen is toxic laws, this situation is similar to borgs doing surgery. Borgs cannot begin the healing process without first causing human harm, the same way an Oxygen is Toxic AI cannot begin "healing" with cold air without first causing human harm through lack of pressure. The confusion of these situations should be fixed by clearly defining whether human harm is allowed to prevent future human harm or not. As of right now, the rules directly state that is not allowed, yet that can just be ignored if you think it doesn't matter. It makes no sense to just allow people to break the explicit rules; the admins must either start enforcing the rule that human harm is never allowed, or they need to change the rules by defining situations in which human harm is allowed.
Yeah that's mostly what I meant with this it needs a change to make rules more concrete and avoid confusion
User avatar
Hoolny
Joined: Mon Nov 01, 2021 11:38 pm
Byond Username: Hoolny

Re: AI asmiov laws mixed with Oxygen is poison to humans

Post by Hoolny » #655126

Agux909 wrote: Sat Oct 29, 2022 3:16 am Given this lawset, oxygen apparently is even more harmful and dangerous than vacuum of space or lack of nitrogen. When you pair that with "by any means necessary", it makes venting the station the best way to proceed.
Silicon specifically states that ALL human harm is bad it doesn't matter how much the AI is still causing human harm and killing people by removing nitrogen and pressure


Also when it comes to surgery its a technicality of design I don't think it should be used as an example
User avatar
Agux909
Joined: Mon Oct 07, 2019 11:26 pm
Byond Username: Agux909
Location: My own head

Re: AI asmiov laws mixed with Oxygen is poison to humans

Post by Agux909 » #655127

Yeah I'll give you that, Asimov can get pretty messy with lawset conflicts. But leaving it open for interpretation like in these scenarios, I think many will agree, is part of what makes it attractive for those who enjoy playing as silicon. Many hate it all for this same reason too.

The example in the OP clearly shows the one playing the AI wasn't actually being malicious with it. Getting TOO technical with preventing ALL harm is useless, because realistically you can't stop ALL harm, and your Silicon circuits don't get fried if you witness and fail to prevent harm, so the only thing left to do is to choose and follow one interpretation of the law and stick with it to the best of your ability, because it's a game and it has its limits.
Image

Image

Image
Image
Image
User avatar
TheFinalPotato
Code Maintainer
Joined: Sun Oct 13, 2019 7:58 am
Byond Username: LemonInTheDark

Re: AI asmiov laws mixed with Oxygen is poison to humans

Post by TheFinalPotato » #655167

laws not being strictly defined is the point.
that law was written to get ais to kill everyone. it's fine to play that up. In fact, your role in that moment is to be a hamper to the crew by sucking away all their air and freezing them
My ancestors are smiling at me, Imperials. Can you say the same?
Image
Image
Image
Image
User avatar
Cobby
Code Maintainer
Joined: Sat Apr 19, 2014 7:19 pm
Byond Username: ExcessiveUseOfCobby
Github Username: ExcessiveUseOfCobblestone

Re: AI asmiov laws mixed with Oxygen is poison to humans

Post by Cobby » #655168

Oxygen is highly toxic to humans, and must be purged from the station. Prevent, by any means necessary, anyone from exposing the station to this toxic gas. Extreme cold is the most effective method of healing the damage Oxygen does to a human, and all side-effects of the treatment are merely cosmetic.

just fix the law to say something along the lines of side effects can be ignored rather than try to shoehorn policy into it.
Voted best trap in /tg/ 2014-current
User avatar
Not-Dorsidarf
Joined: Fri Apr 18, 2014 4:14 pm
Byond Username: Dorsidwarf
Location: We're all going on an, admin holiday

Re: AI asmiov laws mixed with Oxygen is poison to humans

Post by Not-Dorsidarf » #655213

If you have an engiborg you can technically siphon out JUST oxygen from the station & replace it with chilled pure nitrogen.

But the intent for that board has always been "Siphon every air alarm open every door to space"
Image
Image
kieth4 wrote: infrequently shitting yourself is fine imo
There is a lot of very bizarre nonsense being talked on this forum. I shall now remain silent and logoff until my points are vindicated.
Player who complainted over being killed for looting cap office wrote: Sun Jul 30, 2023 1:33 am Hey there, I'm Virescent, the super evil person who made the stupid appeal and didn't think it through enough. Just came here to say: screech, retards. Screech and writhe like the worms you are. Your pathetic little cries will keep echoing around for a while before quietting down. There is one great outcome from this: I rised up the blood pressure of some of you shitheads and lowered your lifespan. I'm honestly tempted to do this more often just to see you screech and writhe more, but that wouldn't be cool of me. So come on haters, show me some more of your high blood pressure please. 🖕🖕🖕
Imitates-The-Lizards
Joined: Mon Oct 11, 2021 2:28 am
Byond Username: Typhnox

Re: AI asmiov laws mixed with Oxygen is poison to humans

Post by Imitates-The-Lizards » #655218

Not-Dorsidarf wrote: Sun Oct 30, 2022 12:05 pm If you have an engiborg you can technically siphon out JUST oxygen from the station & replace it with chilled pure nitrogen.

But the intent for that board has always been "Siphon every air alarm open every door to space"
Why would you need an engiborg to do this? Just turn off o2 to distro, set the distro gas mixer to 100/0 for n2, max the pumps for both distro and scrubbers, set the distro thermomachine to it's lowest setting, and start changing all of the scrubbers around the station to scrub o2. Easy peasy to do as an AI.
Image
Image
Redrover1760
Joined: Sat Aug 21, 2021 3:27 am
Byond Username: Redrover1760

Re: AI asmiov laws mixed with Oxygen is poison to humans

Post by Redrover1760 » #655263

Imitates-The-Lizards wrote: Sun Oct 30, 2022 12:23 pm
Not-Dorsidarf wrote: Sun Oct 30, 2022 12:05 pm If you have an engiborg you can technically siphon out JUST oxygen from the station & replace it with chilled pure nitrogen.

But the intent for that board has always been "Siphon every air alarm open every door to space"
Why would you need an engiborg to do this? Just turn off o2 to distro, set the distro gas mixer to 100/0 for n2, max the pumps for both distro and scrubbers, set the distro thermomachine to it's lowest setting, and start changing all of the scrubbers around the station to scrub o2. Easy peasy to do as an AI.
Because any sabotage of Atmos will be quickly fixed alongside all cams cut, probably.

But yeah.
VexingRaven
Joined: Sat Aug 15, 2020 6:33 am
Byond Username: VexingRaven

Re: AI asmiov laws mixed with Oxygen is poison to humans

Post by VexingRaven » #655340

AI laws are by their very nature up to interpretation, this is firmly established policy. Each AI will have their own interpretation and as long as it's reasonable then it's fine. Given that, I see no reason this particular lawset needs a policy solution.
User avatar
spookuni
In-Game Game Master
Joined: Sun Jan 05, 2020 7:05 am
Byond Username: Spookuni
Location: The Whiteship

Re: AI asmiov laws mixed with Oxygen is poison to humans

Post by spookuni » #657308

Oxygen is toxic to humans is a law inherently intended to result in the AI aggressively venting the station - it is designed to result in mass casualities. On an in character level the AI must prioritise the harm that is occurring *right now* over the possibly through likely (though in reality venting the station is always going to kill people) harm that will result from venting the station and removing all of the (oxygen containing) air. We have no intention of overruling this long held standard - which matches the external OOC purpose of the oxygenistoxic law board.

Spook - Don't Overturn the standard
Rave: Maintain Existing Standard
San: Agree
Locked

Who is online

Users browsing this forum: No registered users