Police State

Facial Recognition Tech Straight Out of 'Robocop' Could Be a Real Threat to Civil Liberties

As governments and law enforcement agencies rush to incorporate facial recognition tech, California lawmakers have a chance to slam on the brakes.

|

Nearly a decade ago, the spokesman for a company that produces Tasers and body cameras for police departments envisioned the day when "every cop is Robocop." He was referring to then-nascent facial-recognition software, which lets police nab suspects based on an image grabbed from a camera, and a science-fiction movie about crime-fighting cyborg cops.

Technology advances at such rapid speeds that such a day already is here in authoritarian China. It's also gaining a foothold within American law-enforcement agencies that use body cameras. Such cameras have become ubiquitous for good reason. By recording police interactions with the public, the cameras depict police interactions with the public. They are a tool for improving accountability and building community trust.

But police departments—spurred by tech companies that might make a fortune selling high-technology products to government agencies—are turning this public-spirited tool into a means of constant surveillance. Evolving software applications will let police record every encounter and match up a citizen's face with a database, thus enabling an officer to make an arrest or call in a SWAT team based solely on an algorithm.

There are myriad problems here. But it's best to start with that "Robocop" analogy. The 1987 blockbuster pointed to a terrifying future where a nefarious corporation takes over policing in gang-infested Detroit. Its droid gruesomely kills an innocent person. The company then relies on the half-man, half-machine Robocop. The movie takes swipes at corruption, privatization and authoritarianism, but ultimately is about the triumph of humanity over machinery.

Civil-liberties concerns have driven California lawmakers to consider Assembly Bill 1215, which would ban police agencies from using facial and biometric tracking devices as part of their body cameras.

"Having every patrol officer constantly scanning faces of everyone that walks into their field of view to identify people, run their records, and record their location and activities is positively Orwellian," said ACLU attorney Peter Bibring.

This technology is creepy, especially when one considers the next step that's under active development: Tying facial-recognition software into security cameras that are practically everywhere. The bill's author, Assemblyman Phil Ting (D–San Francisco), points to an incident in China where the authorities used recognition software to grab someone from a crowd of 20,000 people during a concert.

Opponents of the ban naively insist that there's no difference between using such software and looking at a mugshot—and that police are still required to follow the Constitution's Fourth Amendment restraints on unreasonable searches. That's nonsensical. Police admit that they want to use these cameras as part of wholesale dragnets, by scanning everyone at public events and not only those that they suspect of having committed a crime.

In its official opposition to the bill, the Riverside Sheriffs' Association argues that, "Huge events…and scores of popular tourist attractions should have access to the best available security—including the use of body cameras and facial-recognition technology." There you have it. The goal of police is to scan our faces at every event.

This is far more intrusive than those checkpoints in totalitarian countries where people must constantly show their papers. In this emerging Robocop world, every American will always be identifiable to the authorities simply by walking around in public. If your face alarms the software, the police will get you.

There are many practical concerns, as well. Let's say I get pulled over for driving 75 MPH on the freeway and the officer approaches my vehicle. His body camera scans my face and compares it to tens of thousands of photos of older, bald, overweight white guys. It triggers a match and instantly the officer draws his gun or calls for backup. In other words, this software can turn a simple stop into a potentially dangerous situation.

That's of particular concern given how inaccurate facial-recognition software can be. "Facial recognition technology has misidentified members of the public as potential criminals in 96 per cent of scans so far in London, new figures reveal," according to a May report in the Independent. A Commerce Department study found a high rate of accuracy, but misidentification still was common. How would you like to be wrongly tagged as a gang-banger?

According to the Assembly analysis, the ACLU used such software to compare photos of all federal legislators and "incorrectly matched 28 members of Congress with people who had been arrested. The test disproportionately misidentified African-American and Latino members of Congress as the people in mug shots." The company that produced the software disputed the ACLU's approach, but this is disturbing, especially in terms of racial bias.

Republicans often complain about big government and creeping socialism, yet the only Republican to thus far support this bill is state Assemblyman Tyler Diep (R–Orange County), who was born in communist Vietnam. Good for him. "Robocop" provided dystopian warnings about the creation of a police state. It wasn't a model for a free society.

This column was first published in the Orange County Register.

NEXT: Review: Weedcraft Inc.

Editor's Note: We invite comments and request that they be civil and on-topic. We do not moderate or assume any responsibility for comments, which are owned by the readers who post them. Comments do not represent the views of Reason.com or Reason Foundation. We reserve the right to delete any comment for any reason at any time. Report abuses.

  1. Not if the government is subject to the NAP.

    1. Yeah, wake me up when we get The Terminator facial recognition, that comes with instructions on who to terminate

  2. “As governments and law enforcement agencies rush to incorporate facial recognition tech, California lawmakers have a chance to slam on the brakes.”

    Why would Sacramento want to blow an opportunity to easily identify, say, registered gun owners whose guns haven’t been duly surrendered?

    1. What about Climate Change Deniers? They can be identified if they are caught roaming outside the reeducation camps

  3. Two problems with this analysis:

    It ignores the false positive rate. If it only makes one mistake per 100 faces, that is still thousands of mistakes a day. No one will rely on such a terrible false positive number. And current technology is far worse than that. Facial recognition software is only good when both the faces on the watch list and the people to look at are very limited, like hundreds at best.

    It ignores that private people will have access and hire out their databases. Same thing with license plate scanners. You can’t put the genie back in the bottle. If facial recognition tech ever gets reliable enough, it will show up in smart glasses for civilians, and cops will buy those. Until it gets that reliable, no civilian is going to want smart glasses that bombard them with false positives and miss other people all day long.

    1. ” Facial recognition software is only good when both the faces on the watch list and the people to look at are very limited, like hundreds at best.”

      I thought neural networks only work when they have vast pools of data at their disposal. Which is why the Chinese have such an advantage in this field. ie payment by face, fronting up to the shopkeeper with a load of noodles or whatever and not a single renminbi on hand. The shopkeeper takes a picture of your face with his cell phone and software connects the face with a bank account and makes the transaction.

      1. Neural nets are only good for mathematical relationships, far as I know.

        Besides, it doesn’t pass the smell test. How many people do you know well enough to recognize? How many times do you mistake someone in a crowd for a friend? Imagine you “knew” millions of people (no-fly lists, shoplifters, whatever that subset is) and tried to recognize all of them from among the thousands and millions of people who pass through airports every day, or everyone stranger on a sidewalk as your car passed them by.

        This is not the few people who work at a small company and who try to come in the front door every day.

        1. “Besides, it doesn’t pass the smell test.”

          I don’t see why not. It’s already in use in China, and face recognition shouldn’t be much more difficult than identifying a person by his fingerprints or a zebra by his stripes. It’s a matter of finding and matching patterns.

          1. How long do you think it takes to look for one fingerprint among the millions or billions on file?

            How many zebras in one herd, and how many are you looking for?

            You ought to stop speculating where you are so ignorant.

            1. “How long do you think it takes to look for one fingerprint among the millions or billions on file?”

              Computers or people? Computers can do this more quickly than people can.

              “You ought to stop speculating where you are so ignorant.”

              It’s not speculation. People can do their shopping ‘by face’ in China today. The shop keeper takes the customer’s photo and software matches the face with a bank account.

    2. You can’t put the genie back in the bottle.

      This. Anonymity is not a naturally occurring right.

      It’s a huge change that our just being in public is so easily observed and logged now. But it’s as permanent a change as the computer; it’s not going away.

      The debate should be how we proscribe institutional rights to act on that intel.

  4. Every time someone gets worried about facial recognition, I’m reminded of the time that Facebook’s algorithm wanted me to tag my friends in a picture of my Mazda. It had ‘recognized’ the wheel rims as faces.

    It even had some suggestions for who they might be.

    1. Those wheels look familiar. Papers!

  5. What an awful critical analysis of Robocop!

    It reminds me of people (read: Paul Verhoeven) who hated Starship Troopers for “promoting fascism.”

  6. First Responders™ seem able to discriminate without dem warez. Dog: terminate. Brown driver: terminate. Brown pedestrian (in Salt Lake City): terminate with prejudice.

  7. We need to make sure that these body camerase (1) do record
    when they ought to, and (2) do not record when they ought not.

    See stallman.org/articles/when-should-body-cameras-record.html
    for suggestions about (1). They can be part of implementing (2).

  8. […] I’m afraid it’s far too late to put this evil djinni back into its bottle: […]

Please to post comments

Comments are closed.