The Volokh Conspiracy
Mostly law professors | Sometimes contrarian | Often libertarian | Always independent
Stephen Carter Makes the Case for Barring the Bar Exam
The famous columnist and Yale Law School professor points out that the case made against other standardized tests, such as the LSAT, also applies to bar exams.

In a recent article in Bloomberg, prominent columnist and Yale Law School Professor Stephen Carter makes the case for abolishing the the bar exam as a requirement for admission to the legal profession. As he points out, the arguments usually advanced for abolishing the LSAT as a requirement for admission to law school also apply to requiring passing the bar exam as a precondition for entering the legal profession:
Should law school applicants still have to take the LSAT? A proposal by a committee of the American Bar Association would eliminate the longstanding rule that accredited law schools must require prospective students to take a "valid and reliable test" as part of the application process. If the LSAT is axed, maybe the bar exam should be next.
The recommendation to eliminate the admissions testing requirement comes amidst cascading charges that reliance on the Law School Admission Test hurts minority applicants. The proposition is sharply contested by many friends of diversity…. Some find it stigmatizing to be told they can't do as well on the test as White applicants. But given that the case against the test appears to have persuaded the wordily named Council of the ABA's Section of Legal Education and Admissions to the Bar, let's assume for the sake of argument that the LSAT does indeed represent an unfair barrier to entry to the legal profession.
Why doesn't the same argument apply to the bar examination?
I'm serious.
Except in Wisconsin, nobody can practice law without passing the bar examination. Some states — California is the most prominent — require even lawyers who are licensed elsewhere to pass an examination if they want to move into the jurisdiction. Such rules function as classic barriers to entry, easily manipulated to keep the supply of lawyers low.
Moreover, the ABA admits that minority bar examination passage rates continue to lag. A 2021 study found that a rising percentage of non-White students at a law school is correlated with a reduction in the school's bar passage rate. Hmmm. If the LSAT is a problem because of its supposed effect on diversity, maybe the bar examination should join it in the waste bin. Or the exam could be optional, leaving employers to decide whether they want to require it.
The barrier to entry, even minority entry, might be justified if we could point to the vital public purpose the bar examination serves. That's harder than one might suppose….
Don't get me wrong. I'm not against standardized testing in every circumstance. For example, I'd support a plan under which the bar authorities would follow the medical profession in requiring a certification process before members can market themselves as specialists in particular fields. But there's no persuasive justification for forcing graduates of accredited law schools to jump through yet another hoop before they're allowed to practice their trade.
I've been on the anti-bar exam bandwagon for many years now. I first made the case for abolition back in 2009, along with a "modest proposal" for reform in case abolition turns out to be politically infeasible. I am pleased to welcome Prof. Carter to the small, but hopefully growing, Bar the Bar Exam movement! His eloquence and stature in the legal world might enable him to win more people over to the cause than I ever could.
He is absolutely right that the case against the LSAT also applies to bar exams. Carter is also right to point out that if bar exam passage had real value in predicting a lawyer's competence, employers could just adopt the requirement voluntarily. I made a similar argument back in 2010. Indeed, abolition of the bar exam requirement could incentivize both bar associations and other groups to create voluntary certification systems that measure lawyer quality much better than current bar exams do (the latter are mostly just tests of memorization).
The comparison with the LSAT actually understates the case for bar exam abolition. I don't have a strong view on whether the LSAT should be retained. But it does serve one useful function that bar exams do not. The LSAT gives law school admissions offices a common metric for evaluating applicants from hundreds of different undergraduate institutions, with widely divergent majors. It's hard to say whether an applicant who graduated with a 3.5 GPA from as a physics major from Podunk University really has comparable credentials to a person who got the same GPA as a political science major from Big State U. But if they both got the same LSAT score, that makes it more likely their abilities are similar.
The LSAT might also make it easier for graduates of lesser-known institutions to compete with those who attended the Ivy League or other similar elite schools. If a Podunk grad got a higher LSAT score than a Harvard grad, that might be a good reason to pick the former over the latter, even if you normally would assign less weight to a Podunk degree than a Harvard one. Absent standardized testing, admissions officers will more often fall back on using school prestige as a proxy for applicant quality. That may be appealing if you're an elite college graduate (like me!). But not so much if you want to provide more opportunity to people who didn't attend such institutions - in some cases simply because they didn't fully mature and start working hard on academics until after high school.
None of this necessarily proves that law schools should retain the LSAT as an admissions requirement. It's possible that admissions offices should instead find better ways to assess applicants' undergraduate credentials, ones that rely less on crude proxies. Even if a standardized test of some kind should be used, the LSAT may not be the right one.
But these kinds of issues do provide potential rationales for the LSAT that do not apply to bar exams. Few if any legal employers use bar exam scores as a proxy for quality. Indeed, most states don't even make the scores available to test takers. If there are employers who believe that passing a memorization test really is a valuable credential, they have lots of other options, including just creating a simpler and easier to take memorization test of their own.
If employers want to ensure that the lawyer they hire reaches some minimal threshold of intellectual ability or conscientiousness, that should be readily evident from their law school grades and other previous academic record. The bar exam adds little, if anything, to these credentials.
And, as I have pointed out before, the bar exam is not a good indicator of the test taker's competence in handling legal issues. Most of the thousands of petty rules tested are ones most lawyers never actually use when they practice law. Indeed, the vast majority of current practicing lawyers - including those at the very pinnacle of the profession - probably couldn't pass their state's bar exam again if they had to take it without studying. If the exam really did test knowledge that is essential for every lawyer to know, that would be a terrible scandal. But virtually all lawyers know it doesn't. Instead, it's primarily a barrier to entry into the profession, keeping out people who are bad at memorization, or unable to take the time and effort to memorize many thousands of petty rules that you can then forget soon after taking the exam.
In sum, I hope more people with join Stephen Carter and myself in advocating abolition of the bar exam. But, if you're still not convinced, perhaps you might consider my "modest proposal" for reform:
Members of bar exam boards… and presidents and other high officials of state bar associations should be required to take and pass the bar exam every year by getting the same passing score that they require of ordinary test takers. Any who fail to pass should be immediately dismissed from their positions, and their failure publicly announced…. And they should be barred from ever holding those positions again until - you guessed it - they take and pass the exam.
After all, if the bar exam covers material that any practicing lawyer should know, then surely the lawyers who lead the state bar and administer the bar exam system itself should be required to know it. If they don't, how can they possibly be qualified for the offices they hold? Surely it's no excuse to say that they knew it back when they themselves took the test, but have since forgotten. How could any client rely on a lawyer who is ignorant of basic professional knowledge, even if he may have known it years ago?
Of course, few if any bar exam officials or state bar leaders could pass the bar exam without extensive additional study (some might fail even with it). That's because, as anyone who has taken a bar exam knows, they test knowledge of thousands of arcane legal rules that only a tiny minority of practicing lawyers ever use. This material isn't on the exam because you can't be a competent lawyer if you don't know it. It's there so as to make it more difficult to pass, thereby diminishing competition for current bar association members…. Effectively, bar exams screen out potential lawyers who are bad at memorization or who don't have the time and money to take a bar prep course or spend weeks on exam preparation.
My proposed reform wouldn't fully solve this problem. But it could greatly diminish it. If bar exam board members and bar association leaders were required to take and pass the exam every year, they would have strong incentives to reduce the amount of petty trivia that is tested. After all, anything they include on the exam is something they themselves will have to memorize! As prominent practicing lawyers, however, they presumably are already familiar with those laws that are so basic that any attorney has to know them; by limiting the exam to those rules, they can minimize their own preparation time. In this way, the material tested on bar exams might be limited to the relatively narrow range of legal rules that the average practicing lawyer really does need to know.
Editor's Note: We invite comments and request that they be civil and on-topic. We do not moderate or assume any responsibility for comments, which are owned by the readers who post them. Comments do not represent the views of Reason.com or Reason Foundation. We reserve the right to delete any comment for any reason at any time. Comments may only be edited within 5 minutes of posting. Report abuses.
Please
to post comments
It's hard to say whether an applicant who graduated with a 3.5 GPA from as a physics major form Podunk University...
Hi, Ilya. Say hello to 100 years ago, when this shit was worked out.
https://en.wikipedia.org/wiki/Reliability_(statistics)
These are required to be adequate before even thinking of publishing a test or rating scale. It is very basic requirement. If the results cannot be repeated various ways, they can never be valid.
What are the scores on these measures for the bar exam?
Hi, Ilya. Once reliability statistics of an exam are adequate, one must then move on to prove it is valid, meaning, it measures what it claims to measure.
https://en.wikipedia.org/wiki/Validity_(statistics)
What are these statistics for the bar exam? Do they exist and are subject to discovery in a lawsuit?
Hey, Ilya. The IQ test is the most reliable and validated test in history. That sucker predicts your social class at age 50 from a score at age 7.
It was being used to provide a benefit, not to damage children, the extra help of special education. Yet the lawyer on the Cali Supreme Court prohibited its use in the public schools. The stigma of getting extra help was racially discriminatory. Diverse kids had lower scores on it. The US Supreme Court refused this case cert.
https://law.justia.com/cases/federal/district-courts/FSupp/495/926/2007878/
Hi, Ilya. Now the IQ was banned as discriminatory despite its use to help kids get more services.
The Bar exam is designed to exclude people. It damages them financially, mentally, and is a trigger.
Look at the pass rate for the diverses on p. 2 here:
https://www.calbar.ca.gov/Portals/0/documents/admissions/Examinations/February-2022-CBX-Statistics.pdf
So no reliability. No validity. Used to exclude and to damage. Prevents people from getting a job. Hideous consequences to people who worked to get into a profession for years. Far more diverse disparity than on the IQ. But, to the lawyer, it persists.
These facts are the path to knocking down the Bar exam in court. They are quackery, without any validity, or even reliability. They are negligent in not meeting modern standards of test production.
Then these quack exams are racially discriminatory. And should not be continued, the way the IQ test was stopped by the federal court.
They are misleading in assuring the public of the adequacy of their legal representation.
They promote the IRAC of 25 issues an hour, which is lawyer malpractice.
The BAR exam, at least in NY, was gobsmackingly easy. If you could not pass it, you had no business practicing law.
And yet 45% of ABA law school grads do not pass. But every single one of them graduated. And therein lies the problem.
As noted in the post and as we all well know, most of the tested material will be utterly irrelevant to most lawyers' careers (and can be readily looked up when needed). The bottom line of what the bar exam measures is an intersection of capacity and motivation.
If law schools did a better job of filtering out people who signed up for law school to Make Big Money but can't manage to hold it together long enough to pull off an exercise like the bar exam, the exercise itself wouldn't be needed on the back end. But the likelihood of that happening is statistically zero.
Indeed.
Why did you capitalize "BAR"?
He likes beer!!! (It's funnier if you imagine Justice K shouting it.)
Bachelor of Architecture
Because I was pressing the shift key when I was typing it.
I do not have a better explanation.
Maybe Prof. Somin should read up on the slipper slope concept. Once the bar exam is abolished as a barrier to diversity, why wouldn't law school grades be next? After all, black students have worse grades on average than white ones. And employers who want to implement their own tests will find the EEOC on their case if the test produces any racial disparities in results. So I'm curious where Prof. Somin thinks it should end.
On the bright side, this post isn't about Trump or immigration, which is why I read it.
Hate-crime!!!
(And truth is not a defense.)
Do away with the bar exam?
What about the medical boards?
How about a dual track system for doctors: Anybody can practice medicine, but only people who pass the medical boards can call themselves "board certified".
You could do the same with lawyers.
Then see which get the work.
I'm pretty confident that today's "woke" companies would hire incompetent blacks who couldn't pass the bar.
Would a "woke" CEO let himself be operated on by a non-certified surgeon? Hmmm...
Probably not. But in a company where he figures its the cost of doing business and that any real harm will be averted by other people who pick up the slack? Probably yes.
If employers want to ensure that the lawyer they hire reaches some minimal threshold of intellectual ability or conscientiousness, that should be readily evident from their law school grades and other previous academic record.
These are heading south in a hurry.
It's up to y'all. You want being a credentialed lawyer to mean something important or not? Computer programmers function without such credentials.
If licenses and certifications mattered for programmers we'd just now be moving into FORTRAN, from assembly.
The bar exam represents a minimum "bar" to practicing law. Some might consider a base level of memorization important to practicing laws...
On a larger point however....
One of the major benefits of standardized exams (LSATS, bar exams, SATs etc.) is to act as a meritocratic, even-handed gradation of people for a relative skillset. That was generally useful for minorities, immigrants, and those who were not as well connected. Is it perfect? No. Do people with more resources have more time to study for such exams. Yes. But more resources only get you so far. (Connections to the right people often get you much further, but that doesn't help with standardized exams).
If you're not using a standardized exam, how are you sorting through people? The "old" way was the old boy network. Who knew who. Who went to what schools. Who trained under who. That was much more difficult for minorities and immigrants to break into, and was the cause of much discrimination. If you didn't "know the right people"....you could essentially be locked out of professions, no matter how much natural talent you had. Standardized exams...to an extent...could help recognize that talent.
By eliminating the standardized exam, you force people back to the old way, the old-boy network. Because people will be sorted, that's inevitable.
Meritocracy is generally useful for meritorious minorities. It's hell on people trying to run racial quota systems.
That's what's motivating the war on standardized exams: They tend to expose covert quotas, by providing reasonably objective measures of the merit that wasn't used to pick the candidates and determine if they were qualified.
If there were no bar exam, a law degree from the bottom half of law schools would quickly be basically worthless, with such schools graduating anyone willing to pay.
Once you get past the increasingly murky and subjective admissions criteria, how is that behavior any different than that of the top half of law schools?
Once you get past the increasingly murky and subjective admissions criteria, how is that behavior any different than that of the top half of law schools?
Generously, one might presume that the upper half would be willing to protect their brand.
In a sea of meaningless law degrees, there would emerge a market for quality.
At some level, consumer protection comes into play.
Anybody can get a degree from an ABA-accredited law school if they want to. It might not be their first choice, or their second choice, or their tenth choice, but they can do it. Even those who attend unaccredited schools are usually doing so because it's cheaper/closer than an accredited school that would have them (if you're a marginal California candidate it makes more sense to go to People's College of Law than to travel cross-country to attend Fourth Tier Private School that charges the same as Harvard).
If we're also saying that any graduate can practice law because there's no exam, then anybody can start styling themselves as a lawyer and taking cases because the only barrier to entry is willingness to sign a student loan form. Given the dire consequences that poor legal representation can have, I have concerns.
John Q. Public has no way of knowing that their lawyer is dangerously incompetent. The bar exam might not be a rigorous enough barrier to the practice of law, but eliminating it entirely is even worse.
We don't need no stinckin' bar exams.
Bar exams are racist attempts to keep Black and Brown people down.
Just like criminal laws. Systemic racism!
At some level, consumer protection comes into play.
Are you concerned of torts? The law has a solution. Sue.
Who are you going to sue? The least qualified attorneys are liable to be judgment proof.
Yeah we probably ought to stop any sort of competency testing for entry into any profession. I mean, do we really need competent lawyers or doctors or engineers? That type of testing keeps the less capable out and that’s ableist or white supremacy or something else that’s bad.
It is not clear to me that the bar exam tested my competency in much other than impractical, academic understanding of the law.
Had you failed it, it would have tested your incompetency. I don’t want to pay a bazillion an hour to someone who can’t pass an easy test.
Is LSAT performance a good predictor of performance in regular exams once in law school?
And this is exactly why the "party of science" leftists refuse to allow discussion of the average 85 IQ of blacks. Because if blacks are inherently unintelligent, their whole thesis that blacks fail because of white racism falls apart.
if bar exam passage had real value in predicting a lawyer's competence, employers could just adopt the requirement voluntarily.
How do we know it doesn't have such value?
Those who can't pass aren't practicing law, so we don't know how competent they would be. Not very, is my guess.
"If a Podunk grad got a higher LSAT score than a Harvard grad, that might be a good reason to pick the latter over the former"
You mixed up latter and former!
Both the LSAT and Bar exams are cognitive tests, and correlate with general intelligence. That's the point: when it comes to this subject, are you intelligent enough to do the work, and have you proven that you are willing to make the effort. Removing both is the goal of people who don't want society to know which group of people are incapable of the necessary cognitive effort.
Anyone who thinks otherwise should have to go to doctors who didn't do well on the MCAT and/or failed their final subject tests.
Prof Somin says:
…and…
But that's just not true. The 1991 CRA, which codified Griggs, makes it almost impossible for an employer to adopt a test as a screening requirement. As we saw in Ricci v. DeStefano, it is almost impossible to validate such a test in a way that immunizes one from liability. (Or, at least, not that immunizes one from suit. Why would an employer want to risk incurring hundreds of thousands of dollars on defensive litigation to prove that its test is valid?)
This is a recurring problem more broad than the LSAT. For some reason - I don’t claim to know what it is - minorities as a group score worse on standardized tests. That indicates a problem somewhere. Instead of the hard work of identifying (or admitting) the problem(s) and fixing it/them instead we cry racism and just quit measuring. If you stop taking your blood pressure it doesn’t fix your hypertension problem.
Doing this poorly serves the people you’re claiming to try to help.
The "problem" has been identified:
https://en.wikipedia.org/wiki/The_Bell_Curve
Good luck "fixing" it...
And now the demand for equity in grading would exacerbate the problem. We turn a blind eye to the facts in order to avoid unpleasant conclusions.
Jim B, who took and passed two bar exams fresh out of Georgetown.
Many years ago.
"[P]rominent columnist and Yale Law School Professor[.]" And there it is. Someone who doesn't actually practice law wants more unqualified lawyers.
As someone who actually practices, the problem isn't filtering out too many applicants. It's that they don't filter out enough. Law school should be longer and harder, and the bar exam should be tougher. They certainly shouldn't be watered down.
Might I suggest that you'd have a hell of a lot more support for that program if most of what you're required to be a lawyer to do today were permitted to be done by paralegals?
As a graduate of a Podunk U (in this case a regional public university in Illinois mostly famous for producing NFL quarterbacks), I am sure the LSAT was one of the reasons that the Ivy League law school I attended looked at me as an applicant. Maybe the LSAT is not perfect, but nothing is. And it is likely better than any of the alternatives.
I think this argument leaves out some of the benefits of the bar exam requirement. It's no secret that job dissatisfaction among lawyers is very high. Requiring an intensive preparation period for the bar exam may serve the useful function of deterring some law school graduates who are not suited for the day to day rigors of practice (and there are many). A lawyer who finds preparing for and passing the bar exam too difficult is quite unlikely to thrive in practice, in my opinion.
I am not sure what to make of complaints that preparation takes a lot of time and prep courses are expensive. Shouldn't we want practicing lawyers to have the stomach for intense preparation? And the cost of prep courses is a tiny fraction of most graduates' law school debt. It doesn't seem to me that sacrificing a few months to intense preparation, or borrowing a few hundred dollars to pay for a prep course, is too high a price to pay for the privilege of a law license.
The post contains a number of references to memorization of "petty rules." How do we decide which rules are petty and which are important? The value of this exercise is not so much in memorizing this or that rule successfully but in developing a working knowledge about a set of legal doctrines across the entire legal spectrum. What ends up on the exam is a small fraction of what is studied. Obviously, memory fades over time, but there is still value in having exposed oneself to all major areas of law.
Law school typically involves a broad survey of law in the first and part of the second year, then much more specialization in the last three semesters. It is useful to go through another broad and intensive survey right before practicing. It is pretty common for practicing lawyers getting an unfamiliar issue to comment that "I haven't looked at that issue since the bar exam." Even though most lawyers won't remember the specifics later in their careers, having some passing familiarity with an area (and recognizing the need to refamiliarize oneself with the details) strikes me as better than never studying the subject at all.
Finally, many of those who do fail the exam, due to poor memorization skills or whatever, retake and pass the exam. I find it hard to believe that a truly competent would-be lawyer, with the intestinal fortitude to survive in the practice of law, will be unable to pass a bar exam despite adequate law school performance, reasonable efforts to study, and a couple shots at the exam. So whatever portion of takers are actually turned away are probably better off in other careers.
Reform of the bar exam may be called for, but the case for abolition is weak.
Many years ago.
One of the major problems with higher education in general is that standards are being abandoned in order to admit minority students who are not ready for college, and are unlikely to graduate if admitted. This practice should be ruled as fraud and forbidden, because all it achieves is to waste the time, money, and effort of students, parents, faculty, and administrators alike.
The right way to equalize racial outcomes, if that is desired, is to fix the K-12 school system first. And in turn, to fix that we probably need to junk LBJ's Great Society welfare system and replace it with one that does not subsidize having children out of wedlock.
As for admission to the bar -- you're certainly right that the bar exam is designed to make entry to the profession needlessly hard, and any exam that fits that description should be abolished. If this were done, most likely it would be replaced by requiring graduation from an accredited law school. But that would bring problems of its own, not least of which is the unacceptable racial brainwashing that the accreditation agencies throughout academia now insist on.
There does need to be a way to test the competence of lawyers, and thus a bar exam needs to exist whether or not its use is enforced as a precondition of licensure (I would prefer no licensure of ANY occupation). But I would agree to Carter's modest proposal so that the exam is a better measure of competence rather than either ideology or memory.
All Professional Exams tend to be discriminatory. And the scores of those exams are not a measure of actual ability. The interesting thing is that other professions are realizing that the barrier these exams, and the use of the scores on the exam for post exam opportunities is counter productive. The USMLE (Medical Doctors) exam is moving to a Pass/Fail system.
As another example, I've been doing engineering work for 30+ years. However, I was ADD before they even knew that it existed. I learn differently. I wouldn't have succeed in a traditional college environment.
But I've learned much of the same knowledge that a registered Professional Engineer has, but since I don't have the 4 year degree, I'm not even allowed to take the test.
I suspect that there are a lot of Paralegals as well as knowledgeable business people that could pass the Bar if they were allowed to take the test.
Ending these kinds of barriers would benefit a number of industries.
I actually found that bar exams, in connection with bar prep classes, was helpful, long run, to being an attorney and practicing law. The problem is that many of us don’t really always end up after LS with a good framework in every core subject. To this day, I still use the framework I learned in BAR/BRI in parts of Torts and Con Law. Moreover, many of us didn’t take the classes in subjects that we knew we weren’t going to practice after LS, loading up on those that we did expect to use. So, for example, I was expecting a career in computer law, but defensively ended up as a patent attorney. I took classes like IP, Computer, Antitrust, and Admin Law, instead of, for example, Family Law, Water Law, etc. in LS. The prep classes left me with the background to stay out of trouble in the areas of the law where I never intended to practice, like knowing the difference between common law and community property family law (I was licensed in both types of jurisdictions), and mostly didn’t practice there. And my choice of electives was fortuitous, in terms of where I ended up spending my career. Still amazed that so many attorneys in my type of practice don’t know how the APA works, or what the Sherman Act means.
Maybe one of the legal eagles here can explain something to me. I've seen this proposal any number of times. And I sort of get it. I'm not a fan of arbitrary barriers to entry or licensing for labor markets. But, of the bar exam and law school, why is it that the bar exam that is always the barrier that is being proposed to be removed and not law school? I mean, it seems to me that a three year graduate degree at a prestige university is a bigger barrier to entry than a fee of under a couple of thousand dollars, on the high side, to take the bar. And in terms of arbitrariness, law school, from admissions to different qualities of schools to different professors' grading practices, seems a hell of a lot more arbitrary than a roughly standardized test. And, if your goal is protecting the consumer, well, I'd much rather have a guy like Abraham Lincoln, who never attended college, let alone law school, as a lawyer than a guy who attended a prestige law school but never passed the bar.
Is it just that the guys pushing these proposals are usually law professors?
Why stop at the LSAT and Bar Exam. Why not eliminate all grading systems on the basis that they are racially biased? I propose that in lieu of grades, give participation trophies to all students.
Above all things Law School should teach how to think like a lawyer. And how to write like a lawyer.
These are arguably the only things it does.