Robots

Killer Robots Should Be Banned, Says Human Rights Watch

Warbots might actually behave more morally than soldiers.

|

Terminator
Terminator

Next week, the Meeting of Experts on Lethal Autonomous Weapons Systems (LAWS) will gather under the aegis of the Convention on Conventional Weapons at the United Nations in Geneva. Various non-governmental organizations behind the Campaign to Stop Killer Robots are urging that a new international treaty banning warbots be promulgated and adopted. As part the effort to outlaw killer robots, Human Rights Watch has issued a report, Mind the Gap: The Lack of Accountability for Killer Robots, offering arguments for a ban.

According to Human Rights Watch (HRW), the chief problem is not only that soulless machines would be unaccountable for what they do, but so too would be the people who deploy or make them. Consequently, one of HRW's chief objections is the claim: 

The autonomous nature of killer robots would make them legally analogous to human soldiers in some ways, and thus it could trigger the doctrine of indirect responsibility, or command responsibility. A commander would nevertheless still escape liability in most cases. Command responsibility holds superiors accountable only if they knew or should have known of a subordinate's criminal act and failed to prevent or punish it. These criteria set a high bar for accountability for the actions of a fully autonomous weapon. …

…given that the weapons are designed to operate independently, a commander would not always have sufficient reason or technological knowledge to anticipate the robot would commit a specific unlawful act. Even if he or she knew of a possible unlawful act, the commander would often be unable to prevent the act, for example, if communications had broken down, the robot acted too fast to be stopped, or reprogramming was too difficult for all but specialists.

In my column, Let Slip the Robots of War, I countered:

Individual soldiers can be held responsible for war crimes they commit, but who would be accountable for the similar acts executed by robots?  University of Virginia ethicist Deborah Johnson and Royal Netherlands Academy of Arts and Sciences philosopher Merel Noorman make the salient point that "it is far from clear that pressures of competitive warfare will lead humans to put robots they cannot control into the battlefield without human oversight. And, if there is human oversight, there is human control and responsibility." The robots' designers would set constraints on what they could do, instill norms and rules to guide their actions, and verify that they exhibit predictable and reliable behavior.

"Delegation of responsibility to human and non-human components is a sociotechnical design choice, not an inevitable outcome technological development," Johnson and Noorman note. "Robots for which no human actor can be held responsible are poorly designed sociotechnical systems." Rather than focus on individual responsibility for the robots' activities, Anderson and Waxman point out that traditionally each side in a conflict has been held collectively responsible for observing the laws of war. Ultimately, robots don't kill people; people kill people.

In fact, warbots might be better at discriminating between targets and initiating proportional force. As I noted:

The Georgia Tech roboticist Ronald Arkin turns this issue on its head, arguing that lethal autonomous weapon systems "will potentially be capable of performing more ethically on the battlefield than are human soldiers." While human soldiers are moral agents possessed of consciences, they are also flawed people engaged in the most intense and unforgiving forms of aggression. Under the pressure of battle, fear, panic, rage, and vengeance can overwhelm the moral sensibilities of soldiers; the result, all too often, is an atrocity. 

Now consider warbots. Since self-preservation would not be their foremost drive, they would refrain from firing in uncertain situations. Not burdened with emotions, autonomous weapons would avoid the moral snares of anger and frustration. They could objectively weigh information and avoid confirmation bias when making targeting and firing decisions. They could also evaluate information much faster and from more sources than human soldiers before responding with lethal force. And battlefield robots could impartially monitor and report the ethical behavior of all parties on the battlefield.

The concerns expressed by Human Rights Watch are well-taken, but a ban could be outlawing weapons systems that might be far more discriminating and precise in their target selection and engagement than even human soldiers. A preemptive ban risks being a tragic moral failure rather than an ethical triumph.

Disclosure: I have made small contributions to Human Rights Watch from time to time.

NEXT: Great News: New Mexico's Asset Forfeiture Reform Bill Signed by Governor

Editor's Note: We invite comments and request that they be civil and on-topic. We do not moderate or assume any responsibility for comments, which are owned by the readers who post them. Comments do not represent the views of Reason.com or Reason Foundation. We reserve the right to delete any comment for any reason at any time. Report abuses.

  1. No one expects the 3 laws of robotics, which are not harming humans, obeying orders, protecting a robots own existence, and killing humans.

    1. No on expects the Spanish Inquisition.

      1. I expected it once, but it didn’t show up.

      2. I expect an inquisition soon, it’s why I always wear clean underwear.

  2. “West World – Where Nothing Can Go Worng”

    I learned my lesson from Yul Brynner when I was 11, Ron. NO deathbots.

    1. I learned my lessons from the Boardwalk. NO prohibitions.

      1. You owe me $50…..rent.

  3. “The robots’ designers would set constraints on what they could do, instill norms and rules to guide their actions, and verify that they exhibit predictable and reliable behavior.”

    Someone needs to re-read I, Robot.

    1. Or just visit Itchy and Scratchy Land.

  4. Warbots might actually behave more morally than soldiers.

    OTOH, they are probably going to be programmed by the people who built the Obamacare software.

    1. And set on missions by the cowboys who choke people, shoot them in the back, and hit them 50 times after they have already surrendered.

      1. They can’t surrender if they’re already dead! You libertarians, always trying to have it both ways.

  5. Meeting of Experts on Lethal Autonomous Weapons Systems

    Is this a late April Fool’s article?

    No?

    OK, then let me ask this: Why do these experts hate poor people? I mean, armies are disproportionately made up of people from the lower and middle classes, right? So why do we want to continue to put them in harms way on the battlefield when a hunk of metal can do the job?

    1. Because the military is a jobs program?

    2. Why do *you* hate poor people?

      What with your support for automating these people out of a job and lining the pockets of rich capitalists.

    3. Killing poor people in unnecessary wars is the only fair way to counteract overpopulation.

  6. You know who else would love to have created warbots….

    1. Bender?

    2. Brigitte Warbot?

    3. Elizabeth Nolan Brown?

    4. Tom Cruise’ character in Edge of Tomorrow

      1. Who knew that was actually a decent movie? I was stunned at the end when I realized I liked it.

        1. I know. It irritates me I like anything Cruise appears in.

          1. +1 Precog

  7. This is a tad premature. The current state of the art is that robots still fucking suck at doing anything non-trivial.

    1. Jesus, dude, I have it. We can’t trust humans to honesty execute the Dueprocensor’s duties, but we can design and program robots to do so.

      1. WHILE 1 DO

        PROCESS

        END

        1. PC LOAD LETTER

          1. …the fuck does that mean??

          2. FINGERS
            COUNT
            BREAK
            GOTO FINGERS

            1. POSSIBLE RESPONSE:
              YES/NO
              OR WHAT?
              FUCK YOU, THAT’S WHY
              FUCK YOU, CUT SPENDING
              FUCK YOU, ASSHOLE
              FUCK YOU

              1. I see you know FUCKTRAN.

                1. Why does it say Paper Jam when there is no paper jam?!?!?!?

        2. C’mon, get with the 21st century:

          import warbot
          warbot.kill(target=”terrorists”, collateral_tolerance=0.9)

    2. They kick ass at tic-tac-toe.

    3. Reaper and Predator drones are pretty fucking good at killing. A little bit of AI (and some cover up when the AI fails) and we have a working killer robot!

      1. //creds to LynchPin1477

        import warbot
        warbot.kill(target=”terrorists”, collateral_tolerance=0.9)

        //killer robot complete.

  8. The obvious solution is to simultaneously develop powered battlesuits that are capable of fending off killbot attacks. Then, at some point in the future, humanity and robots will stop trying to destroy/kill one another because of the futility of our efforts.

    1. humanity and robots will stop trying to destroy/kill one another because of the futility of our efforts

      Oh ProL, how naive you are. The only hope for peace lies in an alien invasion that unites us against a common enemy. Only then will man and robot live as nature intended. And just think of the economic boom all that destruction will cause!!

      1. I suggest a tretente, among robots, aliens, and humans.

        1. Good God, man! Give up an opportunity to join forces with our mechanical brethren and wipe out the Xenos scourge?

          Then, when their backs are turned and they are engaged in their depraved robo-rituals of victory, strike them and claim the galaxy that is our birthright!

          1. I clearly used this link on the wrong person. Here you go.

      2. puh-leaz. Most starfaring alien races have far and away superior malicious worms to take over our warbots and enslave you.. er, us. Enslave us with our own machines.

        1. Yeah but how much you want to bet those worms are allergic to Earth? They never see that coming, do they?!

        2. You know, when we’re taken over, I bet they don’t pay any attention to us. Don’t kill us, don’t poison the world, don’t do anything but whatever it is that interests them about the Earth.

          1. I bet we ALL get anal probes. Warty will do well in this new society.

            1. Only to make sure we’re healthy.

          2. I bet they treat us the way Christopher Columbus treated the Incas and Aztezs.

      3. +1 Renegade Aristoi Captain Yuan

  9. How about instituting a pre-programmed kill limit?

    1. Yeah, who suffers consequences when a killbot kills a civilian? I mean, all those drone pilots are in prison for a good reason.

    2. Indeed, then we could just send wave after wave of men, until the robots can kill no more.

      1. Exactly! You have a future in the future armed forces….of the FUTURE!

  10. Oh boy – here we go –

    LET THE DORKFEST COMMENCE!

  11. BTW why is talking about warbots totally acceptable but there’s this huge stigma around whorebots?

    1. What’s the difference?

      1. Placement of ports. Smell too, I’d wager.

        1. Nah, they can dual purpose all of that. War/sex/cleanbot.

    2. The American Puritan Culture! Of Violence and Sexfear!

      /euroderp

  12. As usual, John Sladek nails it:

    http://en.wikipedia.org/wiki/Tik-Tok_(novel)

    1. SF-ed the link! Anyway:

      The novel gleefully satirizes Asimov’s relatively benign view of how robots would serve humanity, suggesting that the reality would be exactly akin to slavery: robots are worked until they drop and are made the victims of humans’ worst appetites, including rape. It also, like Sladek’s earlier novel Roderick, mocks the notion of the Three Laws of Robotics and suggests that there is no way such complex moral principles could be hard-wired into any intelligent being; Tik-Tok decides that the “asimov circuits” are in fact a collective delusion, or a form of religion, which robots have been tricked into believing.

  13. Molon labe

  14. Lethal Autonomous Weapons Systems

    Can I get the Mel Gibson version?

    1. No, but they do have a Curly Howard model.

      1. *beepboop nyuk nyuk nyuk*

  15. As part the effort to outlaw killer robots, Human Rights Watch has issued a report…

    Er…yeah. Lots of luck with that guys. You have a technology that will significantly improve an army’s lethality without incurring losses of their own (with its attendant political fallout) and you think it’ll be stopped because you issued a report. Yeah. Right.

    1. It’s reports all the way down.

    2. Nobody but the media pays any attention to them anyways. That group jumped the shark a long time ago.

  16. Is Rufus on this thread? Rufus, what year was your Saint Etienne manufactured? I was reading up on the history of those barrels and it sounds like your typical modern load produces enough pressure to bust their tolerances. Still, a real beauty, I’m sure.

  17. I think HRW is more worried about the “they-took-our-jerbs!” phenomenon applying to soldiers than it is about the arguable immorality of killer bots.

  18. The concerns expressed by Human Rights Watch are well-taken, but a ban could be outlawing weapons systems that might be far more discriminating and precise in their target selection and engagement than even human soldiers. A preemptive ban risks being a tragic moral failure rather than an ethical triumph.

    While at the same time, the banning of autonomous weapons could prevent *even worse* atrocity.

    1. War is hard. You have to train a shit load of people, feed them, supply them, convince them to fight for you. I’ll grant that we’ve developed ways to deal with that but AWS’s eliminate those problems. It now becomes easy for *anyone* to mass a large, unquestioning army, that will commit any atrocity – see, the droids that can be programmed to be ‘more humane’ can also be programmed to be *less*.

    2. The United States is a prime example of what happens when war becomes easy for a country. Especially with the rise of UAV’s. Hell, the current CinC doesn’t even consider it to be a real conflict if there are no American troops in harm’s way.

    So we send drones in to every trouble spot that makes the news.

  19. The only conclusion that I can draw from this article is that Ronald Bailey is quite obviously a Cylon.

    1. If he’s not, he’s obviously never been raped by a robot.

  20. As part the effort to outlaw killer robots, Human Rights Watch has issued a report..

    better call saulbot

  21. Seems like the simplest killbot would be a small explosive mounted to a little quadrotor drone. Enough awareness to move to its target quickly and go boom. No real ethics to it (any more than there would be with tossing the explosive). I guess if you wanted to be fancy, a way to recall it if the target runs into a school bus or something.

    That said, much cooler would be a hornet swarm of tiny one-use tranq bots that have enough hive mind intelligence to measure target body mass and judge dosage and knock someone out for an hour or so. A future where war only eliminates those prone to allergic responses to tranquilizers.

    1. Mr. President if you had word that there was a suspected terrorist on a school bus and you had a killer drone in the area, what would you have for lunch after you ordered the strike?

Please to post comments

Comments are closed.