The Volokh Conspiracy
Mostly law professors | Sometimes contrarian | Often libertarian | Always independent
Self-Represented Plaintiff Files Lawsuit, Court Spots AI-Hallucinated Citations—in Defense Lawyer's Filings
From Russell v. Mells, decided yesterday by Florida Court of Appeal (Second District) Chief Judge Matthew Lucas, joined by Judges Robert Morris and Susan H. Rothstein-Youakim:
Because [one] case citation [in defense counsel Attorney McLane's filing] appeared to have been "hallucinated" (most likely by a generative artificial intelligence program) and because the other two case citations contained misquotations, we issued an order to show cause to appellee's counsel. In our order, we directed counsel to file a written response explaining how these case citations and quotations were generated. We further warned that the response should also show cause as to why sanctions shouldn't be imposed.
In her response, Attorney McLane stated that the three case citations "were researched via computer generated searches" and acknowledged that she "failed to fully vet these searches." With respect to the two misquotations, she stated that "the errors … were not substantive in nature and were primarily the result of miss placed [sic] quotation marks." She conceded that the citation to "Cade v. Roberts" was "substantive but was not made for the purpose of misleading the Court." She then noted that there was Florida case law supporting "the substance of the argument" on this point, presumably meaning that the quoted text in her brief about motions to dismiss could find support elsewhere in Florida law. {She never tells us where, and there is no text we've found in Florida law that directly matches the purported quotation she set forth in the brief. But substantively Ms. McLane is correct.}
Lastly, we couldn't help but notice, the signature line of counsel's response to our order to show cause appears to have been executed by someone on behalf of Ms. McLane, instead of by Ms. McLane herself. {While a delegated signature execution may not have been a legal or ethical impropriety, under these circumstances, it certainly didn't make a good impression. In the future, our orders to show cause for these kinds of matters will specify that counsel must personally execute the written response, though that point really should not need to be stated.}
In essence, counsel has told us that her "computer generated searches" misstated the law but that she didn't mean to mislead the court when she filed those misstatements. We will take her at her word about her intentions. But what counsel seems to imply—that since the substance of the analysis in her brief wasn't necessarily wrong, her misstatements are not an issue we should be overly concerned about—is simply unacceptable. Indeed, we are deeply troubled by this brief and by this attorney's response.
The judges on this panel have, collectively, served for over fifty years as judicial officers. We have over a hundred years of experience as members of the Florida Bar. Before becoming appellate or trial judges, we practiced in state and federal courts in a wide variety of cases throughout the State of Florida. None of us can recall an instance when an attorney accidentally submitted a completely fabricated case as a legal authority to a court of law—not until the recent advent of generative artificial intelligence.
Unfortunately, we're finding this problem arising more and more frequently…. When a lawyer cites imaginary legal authorities to our court as if they were law, we are compelled to refer that lawyer to the Bar because of the professional rules of conduct. [The court did indeed do so here. -EV]
It doesn't take much moral imagination to understand why. As judges, we rely on attorneys to ethically represent their clients. We expect that representation to be zealous, honest, and competent. Indeed, lawyers owe the courts and their clients a duty to practice with competence and candor. By signing an appellate brief, a lawyer certifies that he or she has read the document and that to the best of the lawyer's knowledge, information, and belief there are "good grounds to support the document."
These ethical requirements are not excused simply because a computer program generated a faulty or misleading legal analysis. Nor is it an excuse that the attorney did not intend to mislead the court. "To state the obvious, it is a fundamental duty of attorneys to read the legal authorities they cite in appellate briefs or any other court filings to determine that the authorities stand for the propositions for which they are cited."
Obviously, that didn't happen when Ms. McLane filed this answer brief. Instead, counsel "fundamentally abdicated" her duty to the court and her client when she submitted this filing without verifying that the three cases cited in her brief said what she claimed they said. Accordingly, it is our duty to refer this matter to the Florida Bar to proceed as it deems appropriate.
We are publishing this aspect of the case with the hope that it will remind attorneys that technological advances do not dispense with ethical obligations….
Editor's Note: We invite comments and request that they be civil and on-topic. We do not moderate or assume any responsibility for comments, which are owned by the readers who post them. Comments do not represent the views of Reason.com or Reason Foundation. We reserve the right to delete any comment for any reason at any time. Comments may only be edited within 5 minutes of posting. Report abuses.
Please to post comments
I guess it is time for a law stating that lawyers cannot bill clients for any piece of work with any AI component, including time reviewing said work.
(yeah, right. And every kid gets a pony)
It would be funny if a client refused to pay a bill due to AI slop like this, and the lawyer had to sue them and try to dismiss his AI slop in front of the same judge who had caught his AI slop.
"including time reviewing said work"
Why? If AI shortens the time, and the lawyer carefully reviews the results for accuracy before including in legal submissions, then what has the lawyer done wrong?
Because we're seeing that they are not carefully reviewing the AI work for accuracy. I fully expect lawyers to use AI despite a law like that but defined consequences of some sort should make the review a higher priority as well as provide recourse for the client.
They are effectively making up case law and lying to the court to support their argument, I don't care if they handed it off to AI or a ghost writer to create their fiction.
But that means because some people abuse a tool, those who don't can't use it, even if it saves time and client billing.
I don't use AI for research, but I do refer to Westlaw headnotes. Not as an endpoint, but as a way to find cases that might be relevant. Which, of course, I then read. That's the proper way to use them. The idea that I should be barred from billing clients for that time-saver because some lawyers use the headnotes improperly is not well-taken, and would only add to the billable time.
Did sloppiness like this ever happen before AIs entered the picture? I don't mean hallucinations, those seem to be unique to AIs. But did Google searches ever turn up iffy matches and lawyers or clerks just grab the reference without more than a quick skim? And before the internet, did lawyers or clerks ever get in a hurry and grab the first result in an index without more than a quick skim? (IANAL and don't know how your law library indexes work.)
"We further warned that the response should also show cause as to why sanctions shouldn't be imposed."
Perhaps it is time for courts to apply strict liability. No excuses requested, none heard. The brief, like my long ago freshman lit paper that had three grammatical errors, goes into the wastebasket. If the deadline has passed, then so be it, no refiling, next case on the docket please.
Parties damaged as a result of their attorney's negligence then file suit against their attorney for making them whole, as if the case had been successful.
No, that would be exceptionally bad for pro se litigants, who have a hard enough time already. There are also exceptional circumstances that come up sometimes, like blowing a deadline because you're in a coma. And what do you do about equitable relief? You haven't thought about this at all.
Yes. There are lawyers who just read the headnotes (supplied by Westlaw) and rely on them without reading the case. Which is risky, as headnotes sometimes don't capture the decision accurately. Or the case may have unique facts which are different from the case the lawyer is working on.
At least in that situation, the cited opinion actually exists, and I think would be fair to put forward for the opposing side to distinguish, clarify, etc.
That still seems unethical. Everything I have been reading on these hallucinations slags lawyers for not reading the case itself to verify the quotes are on point and not taken out of context.
Yes. it's the same level of unethical, because it is the same issue: not reading the cases one is citing.
What if you read the opinion you wish to cite and conclude that the headnote is a valid summary and the case is applicable to your argument, even if opposing counsel disagrees?
Bored Lawyer 8 minutes ago
Flag Comment
Mute User
"Yes. There are lawyers who just read the headnotes (supplied by Westlaw) and rely on them without reading the case. Which is risky, as headnotes sometimes don't capture the decision accurately."
That happened to me in an IRS appeals conference (administrative appeal). The IRS at the time used RIA for the tax research. He relied on the RIA synopsis of the cases on point, which the synopsis had very wrong on the key points. The cases he relied were very pro taxpayer and our facts, but he ruled against us based on the bad synopsis. Fortunately, the appeals officer made a huge math error in recomputing the additional tax which almost completely nullified the bad holding by the appeals officer.
Very rarely. You might consider reading the decision, which discusses this.
What does rarely have to do with the simple question of whether it happened at all? You might want to read my question. Here, let me help you.
Did sloppiness like this ever happen before ...
Forgive me for assuming your question was not entirely stupid. Sorry. I forgot who I was responding to.
As you note, hallucinations themselves are new. But the general problem certainly happened.
1. There are headnotes prepared by Westlaw or Lexis that summarize the important holdings of cases to make it easier to find them. But they don't always summarize accurately, or there are caveats that make the cases inapplicable.
2. Sometimes the case one found is perfect except that it was overturned. Or relies on a law that was repealed.
3. Lawyers frequently borrow from older briefs — whether they're their own, ones created by other lawyers in one's firm, found on the Internet, or supplied by a friend. They assume that if it was filed with a court in the past, it must be good.
4. And, of course, lawyers delegate to clerks, paralegals, etc. to draft briefs.
In each and every scenario, one must read the cases. But lazy/rushed lawyers sometimes do not.
"And, of course, lawyers delegate to clerks, paralegals, etc. to draft briefs."
I once had a secretary who drove me crazy correcting what she thought were mistakes in my legal citations. She was generally a piece of work. Did not last long in that job.
"Did sloppiness like this ever happen before AIs entered the picture? I don't mean hallucinations, those seem to be unique to AIs. But did Google searches ever turn up iffy matches and lawyers or clerks just grab the reference without more than a quick skim? "
Yes, definitely. I've had cases scattered over 20+ years of practice where the other side cites a case for a proposition that it doesn't support if you read the case. My personal favorite are cases where the other side cites a case for a particular reason or quote, and when you go to it, the only time the opinion said that was when they were saying "Defendant argues [issue cited for], but we disagree." It's become much easier to do now, but it's always existed in some form.
There's an old Star Trek episode, where computers decide the outcomes of battles during war, and the calculated losers report to disintegration chambers.
I used to laugh how such a ridiculous system, they voluntarily reported for disintegration, could possibly come about. Now I wonder...
Semi-related, look how many suspects turn themselves in or pull over for the flashing lights behind them, even when they know they're likely to spend ten years in prison. It can't be entirely down to fear of being hunted down. Disintegration might change the picture some, but some criminals facing the death penalty still turn themselves in.
Judges could put an end to this in a minute by requiring that any filing include a copy of each case cited and of each page containing a quote or a holding.
It would also put a condign end to string citing.
The lawyer in question graduated law school in 1989. Are old people more likely to be doing this, not catching the fake citations?