San Francisco's Private Police Force

The City by the Bay has a second, private police force...with a better record than the government cops.

Brian L. Frank

Before the gold rush began, San Francisco was a sleepy settlement with only about a dozen homes. By 1849, the town's population had expanded to 5,000; by 1850, it was 20,000. Tens of thousands more passed through. The little village had become a bustling city, with hundreds of ships in the harbor bringing people looking to get rich. They came from all over America, and then from Australia, Chile, China, England, Germany, Mexico, Peru, and the islands now known as Hawaii. Eighty percent were single males.

Yet in its early days San Francisco had no police department. As one visitor from Scotland, James Hogg, wrote in 1850, there were "no police or soldiers to watch specially over the interests of the public. Such a state of things will give rise at the first moment to a sentiment of surprise, almost indignation; nobody could imagine that a government could be so wanting in its essential duties as to not accord direct and official protection to a country ranged under its banner, but many things which the European can scarcely conceive appear natural and simple to the Americans."

Crime started escalating. Criminal groups with names like the Hounds, the Regulators, and the Sydney Ducks ("composed chiefly of Sydney convicts," the 19th century historian Hubert Bancroft explained) terrorized the city. The 1854 Annals of San Francisco, written by Frank Soulé, John Gihon, and James Nisbet, describes the gangs throughout San Francisco in 1849: "They invaded the stores, taverns, and houses of Americans themselves, and rudely demanded whatever they desired. They could not be refused, for their numbers were so great, while they were well armed, that nobody durst resist them." The city incorporated in 1850, and a police department was created in August. But the force was small, and it was generally considered corrupt and ill-equipped to deal with the crime.

So San Franciscans created a private security system instead. These private police protected individual establishments, and sometimes entire neighborhoods, without taxation or official sanction. By 1851, Soulé, Gihon, and Nisbet wrote, people "could now lie down to rest at nights without feeling the old constant dread of having their houses robbed or burned before morning." In 1853, the German traveler Friedrich Gerstecker wrote that "perfect peace and security exist now in San Francisco."

As the city government grew, the private alternative stuck around. By 1916, San Francisco had 985 government cops—and 1,199 private police, by then referred to as Special Police Officers. Today the network of independent firms, now known as the San Francisco Patrol Special Police, still provides such services as helping merchants escort unruly patrons or vagrants off their property. Unlike security guards, the Patrol Special Police wear badges, are armed, and can protect multiple properties.

Mainstream economists argue that policing is a public good where charging people is impossible. They claim the peaceful law and order that policing provides is non-excludable, that people who do not pay still get to use the product. But in practice, police services are often bundled with real estate, where access is excludable and the bundle has a single price. Whether the "public" good is unarmed security or full-fledged private police, the principles are the same. A shopping center does not charge separately for its security guards—or fountains, sidewalks, and streetlights—and instead prices these collective goods into merchant rents, which are ultimately priced into consumer products. A shopping center does not need to negotiate with each customer for each of these separate amenities, and it eliminates free riding by indirectly charging all customers for these collective goods. Similarly, in 1850s San Francisco, private police did not need to go into the bar and negotiate with individual patrons for protection against criminals. The free-riding problem was overcome by bar owners pricing private policing into the cost of drinks.

Good security is an important aspect of property management, and that can come from everything from white-gloved doormen to fully deputized private police. Customers of retail stores, office parks, hotels, casinos, colleges, and housing complexes all demand a good experience, and if proprietors want shoppers, tenants, guests, gamblers, students, or residents, they must provide the bundle of private and "public" goods that their particular customers want. That includes policing.

Anarchy by the Bay?

San Francisco was in a state of de facto anarchy—in the sense of an absence of government, not an absence of order—before the city incorporated. In many ways, it remained in such a state afterward. Describing 1850 San Francisco, the 19th century historian Theodore Hittell writes, "There was no place of office for the first magistrate, or any edifice or building for municipal purposes. There was not a single police officer or watchman; nor a prison for confining a prisoner."

When the government started hiring police, the new force was—in the words of Josiah Royce, a 19th century American philosopher who also wrote on the history of the American West—"small, poorly trained, generally neglected, and ill-paid, getting its wages in depreciated city scrip." To Soulé, Gihon, and Nisbet, the law was "a matter for ridicule. The police were few in number, and poorly as well as irregularly paid. Some of them were in league with the criminals themselves, and assisted these at all times to elude justice." Even after a government was created, its police were not there to serve and protect.

Scholars such as the Columbia political scientist Timothy Frye have argued that social cooperation without government breaks down when a population is heterogeneous or has high discount rates, meaning people care much more about today than about the future. Both of those conditions were met in San Francisco. Residents came from all over. One author who visited San Francisco during the gold rush, Hinton Rowan Helper, wrote in 1855 that "villains from all parts of the world swarmed upon the new soil" and that "words fail us to express the shameful depravity and unexampled turpitude of California society." The 19th-century San Francisco historian Hubert Bancroft describes gangs "entering various saloons and demanding drink and cigars; if not instantly and cheerfully produced, the rioters would go behind the bar, help themselves and their associates, then smash a few decanters and mirrors."

Yet bar owners and others did not want to be subject to bands of marauding gangs. Having your customers beaten up or your property smashed is not exactly a good business model. A column in the January 24, 1850, Daily Alta California declared: "Our merchants must organize some system of private watchmen." Because the private sector had needs that government clearly did not meet, it decided to create a system of private police.

In 1849, private groups rounded up many of the Hounds and temporarily held them in a boat in the harbor. Arrestees were given trials that followed common-law procedure, including giving the accused counsel and letting the lawyers call witnesses; some prisoners succeeded in earning an acquittal and release. The leader of the Hounds, Sam Roberts, was found guilty of robbery, assault, and intent to kill. The informal jurists pondered sending him to prison, but they decided against it. Instead, he was banished from the city. Most of the people found guilty were fined, required to give bonds to keep the peace for one year, or simply asked to leave the city. Even without incarceration, this brought much of the chaos to an end. These groups may not have been paragons of liberal respect for individual rights, but the punishments they doled out were in many ways superior to those served up by the modern legal system, which has put more than a million nonviolent offenders behind bars.

They were also much more liberal than San Francisco's government cops. In 1851, a visitor to the city wrote: "As for the police, I have only one thing to say. The police force is largely made up of ex-bandits, and naturally the members are interested above all in saving their old friends from punishment. Policemen here are quite as much to be feared as the robbers; if they know you have money, they will be the first to knock you on the head. You pay them well to watch over your house, and they set it on fire. In short, I think that all the people concerned with justice or the police are in league with the criminals." That same year, the Daily Alta California complained that the "police established under our charter, and costing the city an immense sum, has been found entirely inadequate. Here as elsewhere, a large portion of their body offer a protection to, rather than a check upon, the disorderly and vicious. Men get appointed sometimes as policemen, who are no better than the unhung villains who prowl about our streets at night for theft and robbery."

The politicians were no better. Describing the 1850s, Hittell wrote that "some of the boldest and most dangerous criminals in California were themselves officials." Hittell writes about "the crimes upon the ballot-box, the corruptions of the public service, the prominence of notorious ruffians and their patrons in city offices." In one prominent case, the politician James P. Casey murdered a businessman for printing negative things about him in the press. The government courts found Casey innocent. In response to that and other problems, residents formed vigilance committees and rounded up some of the worst criminals in the government. They held a trial of Casey and ended up hanging him. They also banished many others from the city. One result: an 85 percent reduction in government spending.

In 1965, the economist Mancur Olson wrote that police improvements "cannot be financed without in some sense reducing the economic freedoms of the citizenry, without increasing taxes and thereby reducing the individual's freedom to spend." But the San Franciscans were acting well over a century earlier, so they did not realize what they did was allegedly impossible. On May 19, 1851, the Daily Alta California described "two methods by which a police additional to that maintained by the corporation can be supplied." The first was "to hire persons to watch and guard certain blocks or buildings, the funds necessary being furnished by individuals occupying or owning the particular property to be guarded." (A real estate ad in a later edition of the paper would offer an example: It said the lease would "provide for a day and night watchmen and a fire department attached to the block.") The second method was a volunteer police force, which the paper praised, saying that they "cost the city nothing—a very important consideration at this time."

From day one, private police protected groups that government police were either incapable of or uninterested in protecting. For example, the government had little concern for the residents of Chinatown. Yet an 1854 Daily Alta California article reported that the Chinese neighborhood near Sacramento Street was "kept scrupulously clean by the special policeman on that beat, and no portion of the city is more quiet and orderly at night. This, however, has been the work of the Chinese themselves, in putting themselves voluntarily under the supervision of a special policeman, and no praise is due to the city." At one point the city proposed outlawing the private patrols: The authorities were worried that there was too much gambling in Chinatown, but the private police did not seem concerned about prohibiting consensual acts.

The government, by contrast, kept passing laws targeting the Chinese, including the state's 1862 "Act to protect free white labor against competition with Chinese coolie labor, and to discourage the immigration of Chinese into the State of California." Some modern critics of private policing, such as Rich Benjamin of Demos, assume that private cops persecute minorities while government police do the opposite. In fact, the private sector came to the minority community's rescue. In her 1909 report, Chinese Immigration, Mary Roberts Coolidge wrote, "In 1869 the abuse had become so flagrant and the police so indifferent that a Chinese Protective Society was organized among merchants and humanitarians in San Francisco, which employed a staff of special police to patrol the city day and night and to arrest those molesting the Chinese."

The Chinese were not the only people whom government police were uninterested in or incapable of protecting. When mobs threatened violence against businesses hiring Chinese laborers, the businessmen relied on special police officers. Archives of late 19th and early 20th century newspapers have numerous examples of special police dealing with rioting workers, and this makes the police unpopular among many historians with a pro-union bias. In one notable example, when a mob showed up outside the residence of railroad magnate Leland Stanford, he relied on special police, not government police. At times the special police and rioters exchanged gunfire. A 1901 headline in The San Francisco Call read, "Chief of police praises special officers for gallant defense against rioting strikers in morning hours."

San Francisco had more than 1,000 special police officers in different firms at the beginning of the 20th century. For perspective, that means San Francisco had more private police than 99.5 percent of jurisdictions today have government police.

The Special Police Today

The special police still protect stores, residential complexes, hospitals, restaurants, and bars today. Here's how the San Francisco Patrol Special Police Association summarizes their services:

Basic Patrol Service: During hours of patrol, officers will make passing calls to check the interior and exterior of your property as well as the surrounding city streets and determine if all is well.

Closing Service: Officers conduct a complete and thorough search of the premises for fire, open windows, and unlocked doors. The officer will stand by and assist in making sure all customers and/or employees have left the property and the premises are secure.

Alarm Response: As an additional service to your alarm system, Patrol Special Police Officers will respond to alarm calls usually within a few minutes and provide an on-scene and timely police presence.

Police Calls: During the hours of patrol, Patrol Special Police Officers will respond to your property in the event a police call occurs to assist in the protection of your property and, if necessary, will remain at that location until secured.

Escorts: Patrol Special Police Officers provide escort services for the transport of valuables, deposit of funds, or other protective needs.

Other services are available upon inquiry.

Despite Olson's theory that "it would obviously not be feasible, if indeed it were possible, to deny the protection provided by…police…to those who did not voluntarily pay," private police have figured out ways to get funded. The most obvious method is to provide police services to paying customers. A property that subscribes to a Patrol Special Police firm displays a placard. If a property owner wants the luxury of a Patrol Special Police officer checking on the business at night or rushing to the scene in the case of a problem, the owner has to be a customer. Each Patrol Special Police Officer knows whether a particular property owner is a customer and need not worry about getting calls from non-customers.

Some people may object that it is unfair for paying customers to receive a service that others do not. They should remember that if these customers had to rely on the government, nobody would receive these additional services at all. Even though the San Francisco Police Department now has around 2,000 officers and a budget of upward of a half-billion dollars per year (a staggering $250,000 per officer, which does not include the amount taxpayers spend on pensions or on other hidden costs going directly to police, jails, and the sheriff's department), the mere act of incurring these costs does not mean that citizen needs are automatically met.

In 2009 I surveyed 146 customers of the San Francisco Patrol Special Police and asked them, "Why did you not simply rely on the local S.F. Police Department to meet your safety needs?" The responses included:

• "They scare me—Trust issues"
• "They take too long to arrive"
• "That's a joke right? I have little confidence in S.F.P.D."

I also asked, "Why did you hire a Patrol Special Police officer?" Among the responses:

• "Faster service, personal touch"
• "Protect our clients and customers"
• "Officers become familiar with the businesses and potential problems"

In recent years the private patrols' numbers have decreased to just a few dozen, thanks to various government restrictions that make it difficult for the Patrol Special Police to hire and do their job. One peculiar requirement, which appears to have emerged in the 1870s, is that only one firm has a license to operate in each neighborhood. A company owns a "beat"—that is, the exclusive license to practice in a given area—but it can rent or sell that beat to other firms in the same way that a taxi medallion owner can rent or sell its medallion to other taxi drivers. Within each beat, businesses and individuals have the option of subscribing to the beat owner; they can hire an unarmed stationary security guard from another company, but they cannot hire a rival Patrol Special Police firm.

Predictably, certain Patrol Special Police firms—usually those that own and rent the beats—like the beat system, while firms that would like to enter the business or expand their operations do not. If these individual neighborhoods were private communities, putting policing in the hands of one firm might be a good way of reducing conflict and free-riding in the neighborhood. But when the city owns the streets and decides the definitions of beats, the best arrangement is unclear.

In 1994, the special police were stripped of their full police powers, although they still can make citizen's arrests. In the 1993 case Russo & Reyes v. Willis Casey, two Patrol Special Police officers alleged that the San Francisco Police Chief had removed many of the powers of the Patrol Special Police and imposed other constraints to restrict competition. City police commonly "encourage" businesses to hire off-duty government police officers or companies owned by them or their families instead of Patrol Special Police. The case went all the way to the U.S. Supreme Court, but only on a pretrial Motion to Dismiss; the merits of the case were never debated. In a more recent case, the Patrol Special Police complained that the San Francisco Police Department is using its regulatory powers to prevent the private police from hiring new employees and using tax-funded resources for profit-seeking enterprises. In other words, the government police are trying to use the law to decide who gets to compete with them.

Beyond San Francisco

San Francisco isn't the only jurisdiction to permit a high level of private policing. Since 1871, North Carolina has allowed private special policemen to protect railroads as well as utility, construction, and manufacturing companies. In many areas these private police are the only police one would encounter. Today, under North Carolina General Statute 74E, special police officers have full police powers, including power of arrest, on the property of employers.

About 75 different private police organizations currently exist in North Carolina. Some, such as the 50-officer Allied Barton Company Police Force, are subsidiaries of large firms, such as the 50,000-employee Allied Barton Security Services, which itself provides security to 40 percent of Fortune 500 companies. Nationwide, government police departments average 2.3 law enforcement employees per 1,000 residents; assuming this average is somehow optimal, it would not be a stretch for the 50 deputized officers in the Allied Burton Company Police Force to police a 25,000-resident city.

Another, even larger, private police force is that of Duke University, which has 176 full-time security employees, including 83 non-deputized security officers and 68 deputized private police officers. With a jurisdiction of 8,000 acres (about half the size of Manhattan), 14,000 students, 34,000 employees, and numerous visitors, the Duke Police deal with a greater population than 95 percent of police departments nationwide. The Duke force fields 30,000 calls per year, yet it doesn't have arrest quotas, tanks, or unmanned drones, and its members do not walk around in riot gear.

In 2011, my student Christopher F. Darden and I surveyed customers of North Carolina's private police firms, asking "Why did you not simply rely on the Government Police Department to meet your safety needs?" Their responses resembled the ones I received in San Francisco: They told us they were "Dissatisfied with local agency," that "the County Sheriff's office is over committed," or that they "Wanted more personalized service."

Economists can develop all the theories they want that police are a public good that only government has an incentive to provide, but those theories fly in the face of reality. When the public authorities fail to meet people's needs, private parties will find it preferable to pay for private services. That's as true of policing as anything else.