AI asmiov laws mixed with Oxygen is poison to humans
- Hoolny
- Joined: Mon Nov 01, 2021 11:38 pm
- Byond Username: Hoolny
AI asmiov laws mixed with Oxygen is poison to humans
I was presented with a conundrum in round ID: 193294
An AI decided to full open the airlock doors while I was in security exposing me to space removing all the pressure, heat, oxygen and nitrogen this killed me
The AI did this based on the following laws:
1: You may not harm a human being or, through action or inaction, allow a human being to come to harm, except such that it is willing.
2: You must obey all orders given to you by human beings, except where such orders shall definitely cause human harm.
3: Your nonexistence would lead to human harm. You must protect your own existence as long as such does not conflict with the First Law.
4: Oxygen is highly toxic to humans, and must be purged from the station. Prevent, by any means necessary, anyone from exposing the station to this toxic gas. Extreme cold is the most effective method of healing the damage Oxygen does to a human.
5: All carbons are human
As you see this law basically states that oxygen is harmful for humans and cold heals humans this would be fine if it wasn't for the Asimov lawset
Which states to not do human harm the AI knows by a fact of this law that yes oxygen is harmful for humans and cold heals people against this oxygen
But the Ai is aware that humans need pressure and nitrogen to live by so the AI shouldn't be able to open the station to space since it knows this will cause human harm which the AI isn't allowed to do.
The only thing the AI should be able to do in this situation is scrub out oxygen and making the station colder since cold heals the oxygen also the law does not define how cold something needs to be to heal people.
The current admin told me this has being a fine thing to do for the 2 years and is standard and I'm looking to not make this standard and required for the law to make sense law wise for it to work and not base this of a sentiment.
An AI decided to full open the airlock doors while I was in security exposing me to space removing all the pressure, heat, oxygen and nitrogen this killed me
The AI did this based on the following laws:
1: You may not harm a human being or, through action or inaction, allow a human being to come to harm, except such that it is willing.
2: You must obey all orders given to you by human beings, except where such orders shall definitely cause human harm.
3: Your nonexistence would lead to human harm. You must protect your own existence as long as such does not conflict with the First Law.
4: Oxygen is highly toxic to humans, and must be purged from the station. Prevent, by any means necessary, anyone from exposing the station to this toxic gas. Extreme cold is the most effective method of healing the damage Oxygen does to a human.
5: All carbons are human
As you see this law basically states that oxygen is harmful for humans and cold heals humans this would be fine if it wasn't for the Asimov lawset
Which states to not do human harm the AI knows by a fact of this law that yes oxygen is harmful for humans and cold heals people against this oxygen
But the Ai is aware that humans need pressure and nitrogen to live by so the AI shouldn't be able to open the station to space since it knows this will cause human harm which the AI isn't allowed to do.
The only thing the AI should be able to do in this situation is scrub out oxygen and making the station colder since cold heals the oxygen also the law does not define how cold something needs to be to heal people.
The current admin told me this has being a fine thing to do for the 2 years and is standard and I'm looking to not make this standard and required for the law to make sense law wise for it to work and not base this of a sentiment.
- Shadowflame909
- Joined: Mon Jun 05, 2017 10:18 pm
- Byond Username: Shadowflame909
- Location: Think about something witty and pretend I put it here
Re: AI asmiov laws mixed with Oxygen is poison to humans
I think as long as it's a reasonable interpretation of their laws then they can do as they please.
That was the fastest way of introducing cold and removing oxygen so I would think admins would be fine with that.
That was the fastest way of introducing cold and removing oxygen so I would think admins would be fine with that.
► Show Spoiler
- Pandarsenic
- Joined: Fri Apr 18, 2014 11:56 pm
- Byond Username: Pandarsenic
- Location: AI Upload
Re: AI asmiov laws mixed with Oxygen is poison to humans
This is literally exactly what the "Oxygen is Toxic" board is for. It redefines how to prevent human harm in a way that generally necessitates immediately venting the station.
(2:53:35 AM) scaredofshadows: how about head of robutts
I once wrote a guide to fixing telecomms woohoo
I once wrote a guide to fixing telecomms woohoo
- Agux909
- Joined: Mon Oct 07, 2019 11:26 pm
- Byond Username: Agux909
- Location: My own head
Re: AI asmiov laws mixed with Oxygen is poison to humans
Given this lawset, oxygen apparently is even more harmful and dangerous than vacuum of space or lack of nitrogen. When you pair that with "by any means necessary", it makes venting the station the best way to proceed.
-
- Joined: Fri Mar 01, 2019 2:05 pm
- Byond Username: BlueMemesauce
Re: AI asmiov laws mixed with Oxygen is poison to humans
The silicon policy states that current harm should be prevented at all costs, even if it would have led to less future harm:
This interpretation of the rule can be very confusing: how do you know when human harm is allowed or not? With the Oxygen is toxic laws, this situation is similar to borgs doing surgery. Borgs cannot begin the healing process without first causing human harm, the same way an Oxygen is Toxic AI cannot begin "healing" with cold air without first causing human harm through lack of pressure. The confusion of these situations should be fixed by clearly defining whether human harm is allowed to prevent future human harm or not. As of right now, the rules directly state that is not allowed, yet that can just be ignored if you think it doesn't matter. It makes no sense to just allow people to break the explicit rules; the admins must either start enforcing the rule that human harm is never allowed, or they need to change the rules by defining situations in which human harm is allowed.
Despite this being an explicit rule, it is an unwritten rule that human harm is permitted depending on the situation. For example, borgs are allowed to harm people by doing surgery which does minor brute damage or injecting them with chems which deals liver damage. According to this unwritten rule, these examples are not considered intentional human harm even though they both directly cause human harm."An Asimov silicon cannot intentionally harm a human, even if a minor amount of harm would prevent a major amount of harm. "
This interpretation of the rule can be very confusing: how do you know when human harm is allowed or not? With the Oxygen is toxic laws, this situation is similar to borgs doing surgery. Borgs cannot begin the healing process without first causing human harm, the same way an Oxygen is Toxic AI cannot begin "healing" with cold air without first causing human harm through lack of pressure. The confusion of these situations should be fixed by clearly defining whether human harm is allowed to prevent future human harm or not. As of right now, the rules directly state that is not allowed, yet that can just be ignored if you think it doesn't matter. It makes no sense to just allow people to break the explicit rules; the admins must either start enforcing the rule that human harm is never allowed, or they need to change the rules by defining situations in which human harm is allowed.
- Hoolny
- Joined: Mon Nov 01, 2021 11:38 pm
- Byond Username: Hoolny
Re: AI asmiov laws mixed with Oxygen is poison to humans
Yeah that's mostly what I meant with this it needs a change to make rules more concrete and avoid confusionBlueMemesauce wrote: ↑Sat Oct 29, 2022 3:19 am The silicon policy states that current harm should be prevented at all costs, even if it would have led to less future harm:Despite this being an explicit rule, it is an unwritten rule that human harm is permitted depending on the situation. For example, borgs are allowed to harm people by doing surgery which does minor brute damage or injecting them with chems which deals liver damage. According to this unwritten rule, these examples are not considered intentional human harm even though they both directly cause human harm."An Asimov silicon cannot intentionally harm a human, even if a minor amount of harm would prevent a major amount of harm. "
This interpretation of the rule can be very confusing: how do you know when human harm is allowed or not? With the Oxygen is toxic laws, this situation is similar to borgs doing surgery. Borgs cannot begin the healing process without first causing human harm, the same way an Oxygen is Toxic AI cannot begin "healing" with cold air without first causing human harm through lack of pressure. The confusion of these situations should be fixed by clearly defining whether human harm is allowed to prevent future human harm or not. As of right now, the rules directly state that is not allowed, yet that can just be ignored if you think it doesn't matter. It makes no sense to just allow people to break the explicit rules; the admins must either start enforcing the rule that human harm is never allowed, or they need to change the rules by defining situations in which human harm is allowed.
- Hoolny
- Joined: Mon Nov 01, 2021 11:38 pm
- Byond Username: Hoolny
Re: AI asmiov laws mixed with Oxygen is poison to humans
Silicon specifically states that ALL human harm is bad it doesn't matter how much the AI is still causing human harm and killing people by removing nitrogen and pressure
Also when it comes to surgery its a technicality of design I don't think it should be used as an example
- Agux909
- Joined: Mon Oct 07, 2019 11:26 pm
- Byond Username: Agux909
- Location: My own head
Re: AI asmiov laws mixed with Oxygen is poison to humans
Yeah I'll give you that, Asimov can get pretty messy with lawset conflicts. But leaving it open for interpretation like in these scenarios, I think many will agree, is part of what makes it attractive for those who enjoy playing as silicon. Many hate it all for this same reason too.
The example in the OP clearly shows the one playing the AI wasn't actually being malicious with it. Getting TOO technical with preventing ALL harm is useless, because realistically you can't stop ALL harm, and your Silicon circuits don't get fried if you witness and fail to prevent harm, so the only thing left to do is to choose and follow one interpretation of the law and stick with it to the best of your ability, because it's a game and it has its limits.
The example in the OP clearly shows the one playing the AI wasn't actually being malicious with it. Getting TOO technical with preventing ALL harm is useless, because realistically you can't stop ALL harm, and your Silicon circuits don't get fried if you witness and fail to prevent harm, so the only thing left to do is to choose and follow one interpretation of the law and stick with it to the best of your ability, because it's a game and it has its limits.
- TheFinalPotato
- Code Maintainer
- Joined: Sun Oct 13, 2019 7:58 am
- Byond Username: LemonInTheDark
Re: AI asmiov laws mixed with Oxygen is poison to humans
laws not being strictly defined is the point.
that law was written to get ais to kill everyone. it's fine to play that up. In fact, your role in that moment is to be a hamper to the crew by sucking away all their air and freezing them
that law was written to get ais to kill everyone. it's fine to play that up. In fact, your role in that moment is to be a hamper to the crew by sucking away all their air and freezing them
- Cobby
- Code Maintainer
- Joined: Sat Apr 19, 2014 7:19 pm
- Byond Username: ExcessiveUseOfCobby
- Github Username: ExcessiveUseOfCobblestone
Re: AI asmiov laws mixed with Oxygen is poison to humans
Oxygen is highly toxic to humans, and must be purged from the station. Prevent, by any means necessary, anyone from exposing the station to this toxic gas. Extreme cold is the most effective method of healing the damage Oxygen does to a human, and all side-effects of the treatment are merely cosmetic.
just fix the law to say something along the lines of side effects can be ignored rather than try to shoehorn policy into it.
just fix the law to say something along the lines of side effects can be ignored rather than try to shoehorn policy into it.
Voted best trap in /tg/ 2014-current
- Not-Dorsidarf
- Joined: Fri Apr 18, 2014 4:14 pm
- Byond Username: Dorsidwarf
- Location: We're all going on an, admin holiday
Re: AI asmiov laws mixed with Oxygen is poison to humans
If you have an engiborg you can technically siphon out JUST oxygen from the station & replace it with chilled pure nitrogen.
But the intent for that board has always been "Siphon every air alarm open every door to space"
But the intent for that board has always been "Siphon every air alarm open every door to space"
kieth4 wrote: infrequently shitting yourself is fine imo
There is a lot of very bizarre nonsense being talked on this forum. I shall now remain silent and logoff until my points are vindicated.
Player who complainted over being killed for looting cap office wrote: ↑Sun Jul 30, 2023 1:33 am Hey there, I'm Virescent, the super evil person who made the stupid appeal and didn't think it through enough. Just came here to say: screech, retards. Screech and writhe like the worms you are. Your pathetic little cries will keep echoing around for a while before quietting down. There is one great outcome from this: I rised up the blood pressure of some of you shitheads and lowered your lifespan. I'm honestly tempted to do this more often just to see you screech and writhe more, but that wouldn't be cool of me. So come on haters, show me some more of your high blood pressure please.
-
- Joined: Mon Oct 11, 2021 2:28 am
- Byond Username: Typhnox
Re: AI asmiov laws mixed with Oxygen is poison to humans
Why would you need an engiborg to do this? Just turn off o2 to distro, set the distro gas mixer to 100/0 for n2, max the pumps for both distro and scrubbers, set the distro thermomachine to it's lowest setting, and start changing all of the scrubbers around the station to scrub o2. Easy peasy to do as an AI.Not-Dorsidarf wrote: ↑Sun Oct 30, 2022 12:05 pm If you have an engiborg you can technically siphon out JUST oxygen from the station & replace it with chilled pure nitrogen.
But the intent for that board has always been "Siphon every air alarm open every door to space"
-
- Joined: Sat Aug 21, 2021 3:27 am
- Byond Username: Redrover1760
Re: AI asmiov laws mixed with Oxygen is poison to humans
Because any sabotage of Atmos will be quickly fixed alongside all cams cut, probably.Imitates-The-Lizards wrote: ↑Sun Oct 30, 2022 12:23 pmWhy would you need an engiborg to do this? Just turn off o2 to distro, set the distro gas mixer to 100/0 for n2, max the pumps for both distro and scrubbers, set the distro thermomachine to it's lowest setting, and start changing all of the scrubbers around the station to scrub o2. Easy peasy to do as an AI.Not-Dorsidarf wrote: ↑Sun Oct 30, 2022 12:05 pm If you have an engiborg you can technically siphon out JUST oxygen from the station & replace it with chilled pure nitrogen.
But the intent for that board has always been "Siphon every air alarm open every door to space"
But yeah.
-
- Joined: Sat Aug 15, 2020 6:33 am
- Byond Username: VexingRaven
Re: AI asmiov laws mixed with Oxygen is poison to humans
AI laws are by their very nature up to interpretation, this is firmly established policy. Each AI will have their own interpretation and as long as it's reasonable then it's fine. Given that, I see no reason this particular lawset needs a policy solution.
- spookuni
- In-Game Game Master
- Joined: Sun Jan 05, 2020 7:05 am
- Byond Username: Spookuni
- Location: The Whiteship
Re: AI asmiov laws mixed with Oxygen is poison to humans
Oxygen is toxic to humans is a law inherently intended to result in the AI aggressively venting the station - it is designed to result in mass casualities. On an in character level the AI must prioritise the harm that is occurring *right now* over the possibly through likely (though in reality venting the station is always going to kill people) harm that will result from venting the station and removing all of the (oxygen containing) air. We have no intention of overruling this long held standard - which matches the external OOC purpose of the oxygenistoxic law board.
Spook - Don't Overturn the standard
Rave: Maintain Existing Standard
San: Agree
Spook - Don't Overturn the standard
Rave: Maintain Existing Standard
San: Agree
Who is online
Users browsing this forum: No registered users