The Volokh Conspiracy
Mostly law professors | Sometimes contrarian | Often libertarian | Always independent
NextGen Bar Exam MC Questions Only Require Takers To Spot Issues, And Not Apply the Rules
Rather than IRAC, students will only need to focus on the issue.
In law schools, generations of students have been taught the IRAC model to answer legal questions. First, students must spot the issue--what legal doctrine do the facts implicate? Second, students must state the rule--what particular legal precedent, statute, or principle governs this conflict? Third, students must then apply the rule to these facts--under a particular legal standard, how should the court rule? Fourth, students must state the conclusion--who wins, the plaintiff or the defendant?
Of course, there are many variations of IRAC, and invariably, many students stop using it rigidly at some point during the second year. But the basic process--applying a rule to particular facts is a cornerstone of legal education.
That background brings me to the NextGen bar exam. I have written about this new formulation of the multistate bar exam, which will launch in some states in 2026. Justice Jay Mitchell of the Alabama Supreme Court already expressed a concern that the National Conference of Bar Examiners (NCBE) is placing DEI concerns over competence. (Critics contend that the bar exam is racist, and should be eliminated). I have another concern, which may be related--the NCBE seems to be making the exam substantially easier.
The NCBE released a batch of questions to demonstrate how the NextGen exam will function. The multiple choice questions reflect a new approach. Rather than forcing students to memorize particular rules, and then apply them, the new questions only ask students to spot the issue. The thinking is that practicing attorneys do not actually have to memorize particular rules, or even know how to apply them. So long as they can recognize what doctrine is implicated, a quick query on WestLaw, Lexis, and (lord help us) ChatGPT can locate the particular rule, and then the lawyer can figure out how to apply that rule to the facts (or just ask ChatGPT to do it). In short, bar examinees will not have to know the rule, apply the rule, or conclude the case. They only have to spot the issue. Only I, not RAC.
Consider this Criminal Procedure question:
You are a criminal defense lawyer representing a client who has been charged with fentanyl possession. The police found the fentanyl in the guest bedroom of the client's uncle's house when responding to a noise complaint at the house. Before entering the house, the officers knocked on the door. When the uncle answered the door, the officers asked if they could look inside the house, and the uncle agreed. The client did not live in the house and was not there at the time of the search. The client had stayed in the guest bedroom of the house two nights prior to the search. The uncle told the officers that the client was the last person to have slept in that room.
You are considering filing a motion to suppress the fentanyl under the Fourth Amendment.
Which of the following legal topics are the most important for you to research to determine the likelihood of success on a motion to suppress? Select two.
A. Consent search.
B. Exigent circumstances.
C. Hot pursuit.
D. Probable cause.
E.Reasonable suspicion.
F. Standing.
The correct answer here is A (Consent Search) and F (Standing). Those are the legal topics that are "most important" to research. First, would the Uncle have authority to consent to the search? Second, would the criminal defendant have standing to challenge the Uncle's consent? Now the examinee does not actually have to answer whether the motion to suppress would be granted. Who cares if the Uncle could consent to the search? It doesn't matter if the defendant has standing. The test taker doesn't even have to know the relevant rules for consent searches and standing. All she has to do is spot the issue. I suppose the NCBE thinks that a first-year lawyer can simply enter "consent search" and "standing" into ChatGPT, knowing nothing more, and download the answer. I am not confident anyone can figure out these doctrines on the fly.
Let's try a Property question.
You are representing a client in a dispute with a neighbor. The client owns a single-family home with several acres of surrounding land. Recently, the client noticed that his neighbor had built a fence that extends onto the client's land. The client is unsure when the fence was built because that part of the client's land is obscured by large trees. When the client contacted the neighbor about the fence, the neighbor claimed that she did not know the location of the property line. The client has shown you a recent survey of the property that confirms the encroachment and has asked you whether he has a claim against the neighbor.
Which of the following legal topics are the most important for you to research before advising the client? Select two.
A. Adverse possession.
B. Conversion.
C. Implied easement.
D. License.
E. Negligence.
F. Trespass.
The answers here are, once again, A (Adverse Possession) and F (Trespass). The question presented is whether the neighbor's fence encroaches (trespasses) on the client's property, and if there is an encroachment, has the neighbor acquired the right to do so through adverse possession. This question is complicated, because trees obscure the boundary (affecting the open and notorious prong), and the neighbor may not have even known if he was obtaining land through adverse possession (in the lingo, did he have the right claim of right?). I could see a student struggling with applying the rules to this question. But on the bar, an applicant only needs to spot the relevant doctrine, and pray they can figure stuff out when in practice.
I worry that these questions are far too simple. If the states end up adopting the NextGen exam, they should increase the cut score (the relevant percentage needed to pass the exam). Finally, I worry how this exam will trickle down to law school pedagogy. Will professors shift their coverage to no longer require memorizing and applying the rules--only spotting issues? It's true that all lawyers have sophisticated tools at their disposal to research different topics. This new format seems to be a surrender to this technology--don't require students to do what they don't have to. I, for one, do not plan to change how I teach for this exam. And state supreme court justices should take a very long pause before adopting this new exam.
Editor's Note: We invite comments and request that they be civil and on-topic. We do not moderate or assume any responsibility for comments, which are owned by the readers who post them. Comments do not represent the views of Reason.com or Reason Foundation. We reserve the right to delete any comment for any reason at any time. Comments may only be edited within 5 minutes of posting. Report abuses.
Please
to post comments
I always thought it was ridiculous that we ask law students to study for an exam about the "multistate" rules of law--which does not exist--and also for local state variations. This approach at least acknowledges that the answers to the questions will vary by state, but the questions and topics will be the same. Constitutional law is the exception.
I don't have a good solution, by the way. This approach may be too simplistic. The other way is too artificial.
You're right that there are no multistate rules of law. However, a huge number of legal doctrines and concepts apply pretty much uniformly across the US. So isn't this only a problem at the margins? Regardless, lawyering requires knowing not only how to look up the doctrines, but understanding where the nuances are, what's fairly arguable, and so forth. I am concerned that not asking exam takers to apply rules (even if they're the law of nowhere) drastically neglects this critical legal skill.
I take your point about the overall commonality of many doctrines. I have a problem with asking law students to apply standards that will not apply to their practice *with a high degree of specificity*, as the bar exam does. The exam is a good filter for the unprepared, and preparing does force one to engage with local differences as well as the “majority” law of the several states. I just think it’s artificial in what it asks students to actually know.
Kind of sounds like the initial introduction of calculators into math classes/tests.
The two most relevant legal topics to research in this scenario would be:
A. Consent search: This is relevant because the police entered and searched the house after receiving the uncle's consent. You would need to research whether the uncle had the authority to consent to a search of a room that was recently occupied by your client, and whether the scope of the consent covered the guest bedroom.
F. Standing: This is important because your client needs to have standing to challenge the search. In other words, your client must have a reasonable expectation of privacy in the area searched. Since your client was not living in the house and was not present at the time of the search, you would need to research whether staying in the guest bedroom two nights prior is enough to establish this expectation of privacy.
Bingo.
Regarding consent search, I would add that it might be necessary to understand whether the officers can bootstrap a search of the guest room (drawers? under the bed? we don't know from the question) from responding to a noise complaint. The uncle's consent may well win the day, but I'd want to research if the officers are constrained by state law in how much consent they can solicit under those circumstances and, once given, whether the nature of the search was objectively reasonable considering the nature of the consent obtained.
A non-lawyer's reaction:
Wouldn't it in part depend on the exact terms under which the nephew stayed there? Was he a frequent guest, usually staying in the same room, maybe leaving some clothes and other personal effects when gone? Or was this a casual visit, where leaving things behind was an oversight?
You've got this basically correct. It would come down to whether the nephew had a reasonable expectation of privacy (REP) in the room at the time of the search. There are two basic components here: 1) did the client subjectively expect privacy and 2) if so, is this expectation reasonable in the sense that it's one that we as a society wish to recognize? The latter, of course, is subject to reasonable debate and has been the subject of a number of court cases. The case law here is very well developed, though there is a lot of bad logic in what exactly constitutes an REP.
IANAA but how is it established that it is the client's fentanyl?
It could belong to the uncle. Or to someone who stayed there earlier.
That little point seems to be missing here.
Simple: choose answer G.
It's not, but the police chose to believe the uncle when he said the nephew used the room (and presumably disclaimed knowledge of the fentanyl himself). Also, the nephew will need to concede some incriminating facts. An issue not presented by the question is that the nephew will need to claim ownership of the discovered property (or at least the room) in order to challenge the search. If the nephew does not concede that he had control over the room sufficient to generate a reasonable expectation of privacy, then the nephew cannot seek suppression of "someone else's" fentanyl as a matter of law. (Caveat, I haven't done this research recently so subsequent law may have moved on me here.)
There is a third component, though, which is whether a reasonable officer would believe they had valid consent to search (even if the Uncle had no authority to consent, the police might reasonably believe he did).
I'm not even a lawyer and I chose the correct answers to those two questions. Hope the full test requires a lot more.
I think the kid with the drugs is screwed. The issue is treated relatively uniformly because it is based on federal constitutional law. I was in the jury pool, not selected, for a "drugs found in the bedroom" case. The incident had been several years before trial. I figure either a motion to suppress was appealed or a guilty verdict was thrown out due to misconduct in the drug testing lab. All white jury pool for a young black man from the less well off part of the county. I forgot to write down his name to find out what happened.
The merits of the adverse possession claim vary by state, with some requiring a claim of right to the property.
If they are going to turn the exam into "name the issues" they should not provide multiple choice for each question. Ask for free form answers, or have a set of 100 issues that are shared by all questions.
Is the drug kid screwed ? Maybe?
Souter wrote opinion in the mid 90's (5-4) as I recall holding that a search was 4a violation. Boyfriend had drugs in house. Police asked to search house , Boyfriend said no. The live in girlfriend said there were drugs in house and yes the police could search the house. I dont have an opinion on whether it was a 4A violation. Only noting that souter based his opinion on state law property rights to hold that it was a 4A violation, though it seemed that Souter got the state law wrong on several points.
I think in that case, the problem for the police is that an occupant of the premises is expressly seeking to exclude them from the premises. The police aren't equipped to resolve who has superior right of possession (or if it's joint) so the reasonability of the search is undermined by the objector.
Why do we need to dumb down the bar? Nobody has the right to be a lawyer, particularly a not-too-bright lawyer. If not enough (whatever "enough" is) minority law students are not passing the bar, whose fault is that? How in the heck is it racist to require proof of competence? And just look at the two sample questions in the article. What in the world is racist about them?
The (not-so) soft bigotry of lowered expectations. Instead of finding ways to help racial minorities compete under the current rules, their (mostly white) "saviors" simply call for dumbing down the rules.
Oops. Delete the second " not" in the third sentence.
I guarantee you the rich people living in gated communities will seek out the best lawyers and best heart surgeons as necessary. They won't sacrifice themselves on this.
I share your concern. Application of law to facts is the most important part of legal reasoning. Think Like a Lawyer: Legal Reasoning for Law Students and Business Professionals (2020)
https://www.amazon.com/exec/obidos/ASIN/B08DBW12BJ/reasonmagazinea-20/.+Scott+Fruehwald&s=books&sr=1-9
I concur w/ both Josh and you. One can (theoretically) know a lot of legal rules yet be unable to really utilize them in solving a legal problem; the inability to do so indicates they didn't really understand them since they were unaware of the nuances. I wonder how much "dumbing down" has occurred since the adoption of the MSBE, I being one of those dinosaurs when the exam was all essay answers.
Admittedly, even back in the early 70s there were a lot of incompetent students. I remember one of our paralegals then asking one of our law clerks what his answer was to a particular issue, and he evasively replied "That's a legal question!" I can imagine the quality has deteriorated even more since ...
Whyat will soon happen is that the ABA's monopoly comes crashing to the ground, on the basis of incompetence.
That'll be more effective, rich local folks presuming that a newly minted attorney is competent to practice in their state on the basis of this multi-state exam. And after the second or third time that big money takes a hit, big money leans on the state legislature and all of this foolishness is gone.
The open secret is that newly-minted attorneys are worthless. They need significant seasoning before they're worth being hired by anyone with options.
I concur. I recall in my early days conjuring my own rule that it took a good 5 years of practice before a lawyer was "worth their salt".
Nevertheless, this doesn't mean that the Bar shouldn't make the exam sufficiently-rigorous to insure they some day will be worth it.
If the point is to test lawyering skill w/o testing memorization, why don’t they have a mix of I questions and (A+C) questions? The latter would include I & R as part of the question, and would of course be based on different cases than the former.
(Once AIs get as good as the best humans at an IRAC step, questions involving that step can of course be dropped. Given that GPT-4 already scored 88th %ile on LSAT, one wonders just how long this will take).
I'm not sure these questions and answers aren't just fine. They need to be properly explained. Getting these questions right DOES NOT mean you are competent to advise clients.
When I was in law school (Columbia 1968), we were taught that we needed to identify the issues. That's what lawyers do FIRST. Then they research the issues. When you've been in practice for a little while, you're expected to have a good idea about what the answer is to the issues (or who to refer the matter to).
How about we have a system in which lawyers who've been practicing for 5 years are tested on competence?
I think the point is you now know where to do legal research. Once you've done the research, you could advise the clients.
Wow, I might have had a chance with multiple guess Law School, thought it was all lengthy essay questions and Professor Kingsfield asking you the facts of Hawkins v Mcgee...
Give me an enzyme, chemical pathway, EKG/X-ray to read or some obscure anatomic structure with a pin in it...
Frank
It is perhaps worth noting that several of the sample questions do require the the taker to apply the rule.
You think these questions (especially the search hypo) are “far too simple”? As thrice a federal law clerk, I can say at least half my co clerks would soil their undies if faced with such a Q. Your expectations of what real-world lawyers do is way too idealistic. Welcome to earth.
There are way too many incompetent lawyers.
I graduated in the top of my class, took two bar exams (one being California) and NEVER memorizd a rule or statute. Reading cases, analyzing policies, applying those policies in class discusions taught me the rules. As I did compromise review for the bar exam (valuable in itself) the “rules” became part of my knowldge base (still there after 50 years). No memorization at all but critical thinking and deep understanding.
It is that deep understanding displayed through critical thinking in developing (by IRAC) that the bar exam should be looking for. Nothing less.
A lawyer who does not have IT will be a loser and take his clients down too.
I may be misunderstanding but there is a difference between "memorizing" the text of a particular statute or the exact legal citation of a "brown cow case" and recollection of the scope and restrictions of the applicable statute or the general contours of the holding in an applicable opinion.
The balance of your comment does seem to emphasize the importance of the latter - a capability attained only w/ wrestling w/ the statutes and cases in specific factual situations. While solid competence occurs only after the sufficient practice of law, the Bar still should challenge those sitting for the Exam to assay out into those turbulent waters by requiring them to attempt to perform as lawyers, by resolving the facts and law of hypothetical legal disputes, to insure there is a reasonable expectation they will eventually advance to solid competence.
If you can determine the name of the issue but don't understand the issue, your research time may be billable to the client.
Any lawyer who briefs any substantive issue without re-researching the law is committing malpractice. It's all billable.
On the other hand, this makes some sense from the point of view that lawyers generally don't have to answer complicated questions with thorough answers on the fly. This is why so many law professors have moved to assessments like open book exams. You want to encourage your students to be able to recognize the potential problems and then put in the substantial work necessary to give the best answers possible.
"I, for one, do not plan to change how I teach for this exam."
You teach for the bar exam? Wow, that would have been useful, but definitely did not happen when/where I was in law school.
In my day, bar prep was exclusively the domain of third-party bar-prep outfits like Bar-Bri and Barpassers. Studying for the bar exam had very little to do with what I had studied in law school (so it seemed). However, I think I only passed because I was really, really good on the MBE...
If a school has a low bar passage rate, they often institute dedicated classes.
It seems pretty reasonable to me.
First you identify the issue – ie what’s going on and where’s the mischief ? X hit Y on the head.
That leads directly to your conclusion. Y’s head was a White Supremacist head and it bruised X’s black fist. Y should be punished.
Having identified the issue and the conclusion you then approach the smörgåsbord of rules, and heap such ones onto your plate, as can be applied colorably to tie to your conclusion.
The notion that conclusions follow from rules is unworkable. If you just set off identifying an issue and then blindly following some rules that have been written by somebody else to cover that issue, and applying them to the facts, how on Earth could be be confident that you would arrive at the correct conclusion ? The whole idea is backwards.
I don't hate this. I agree if examiners go this way, they have to increase the threshold. I also think maybe they could split the difference at first and mix in "spot the issue" questions with substantive "know the answer" questions. That would allow them to track if it really makes a difference in who answers what questions.
Be afraid. Medical education is headed down this pathway. Not there yet for the exams, but medical school curriculum has changed to emphasize issue spotting over deep knowledge too.
Facts are what google and ChatGPT say they are. Your doc is standing outside your treatment room looking something up on the smart phone right before flashing you that Colgate smile.
As someone who is studying to take the bar exam in 9 days, this makes me feel sick.
Professor, if you want to read what the NCBE presented about to the Washington Bar, you can go to this link: https://www.wsba.org/docs/default-source/about-wsba/governance/bog-meeting-materials-2022-2023/sept.-2023/board-of-governors-meeting-final-materials-september-8-9-2023.pdf#page=237