The Volokh Conspiracy
Mostly law professors | Sometimes contrarian | Often libertarian | Always independent
Lawyer's "Repeated Claims That the Spurious Citations Resulted from Clerical Errors Unrelated to the Use of Generative AI Are Not Credible"
From Monday's opinion by Justice Frank Menetrez, joined by Justices Richard Fields and Michael Raphael, in Schlichter v. Kennedy:
Grotke's approach differs from those taken by the attorneys in Noland and Alvarez [two previous cases involving hallucinated citations]. Grotke has not admitted that the Writ and the AOB [Appellant's Opening Brief] contain hallucinated citations that were produced by generative AI. Grotke admitted that he used AI in some fashion when preparing the AOB and that it was "possible" that he used AI in some fashion when preparing the Writ. But he maintains that the four spurious citations resulted from clerical error and that he intended to cite the actually existing cases for the propositions described in the declaration that he filed in response to our order to show cause. We find that Grotke's claims are not credible.
It is difficult to understand how Grotke's four spurious citations could possibly be mere clerical errors, and Grotke has not intelligibly explained how it would be possible. The spurious citations do not involve the mere omission or addition or transposition of one or several digits. Rather, all four spurious citations are completely different from the correct citations for the actually existing cases that have those case names. Grotke's spurious citations bear the hallmarks of hallucinated citations produced by generative AI. "[H]allucinated cases look like real cases. They are identified by a case name, a citation to a reporter, the name of a district or appellate court, and the year of the decision. [Citation.] But, they are not real cases."
Grotke's claim that he intended to cite the actually existing cases is similarly lacking in credibility. The actually existing cases do not support the legal propositions for which Grotke provided the spurious citations in the Writ and the AOB. Consequently, it would make no sense for Grotke to claim that he intended to cite the actually existing cases to support those legal propositions. Grotke attempts to avoid that problem by claiming that he cited the four cases for various other legal propositions, which he describes in his declaration. But the attempt fails, because the legal propositions described in his declaration are not the legal propositions in the Writ and the AOB for which the spurious citations were provided as authority.
For all of these reasons, we conclude that Grotke's repeated claims that the spurious citations resulted from clerical errors unrelated to the use of generative AI are not credible.
Other parts of Grotke's response show a similar lack of candor and credibility. Grotke claimed in his declaration that the spurious citations "resulted from a breakdown in [his] citation-verification process during compilation from vLex." But Grotke admitted at the hearing that before receiving our order of September 19, 2025, he had never signed up for or had a membership on vLex but merely used it "on and off" or "here and there."
Insofar as Grotke claims that he did check the four cases—by searching for them either by case name or by volume and page number citation—before filing the Writ and the AOB, the claim is not credible. If Grotke had tried to check the cases by volume and page number citations, then he would have discovered that the cases do not exist. Grotke admits that is what happened when he searched for the cases in response to our order of September 19, 2025. And if Grotke had tried to check the cases by case names, then he would have discovered that the actually existing cases do not stand for the propositions for which he was citing them.
We agree with Noland and Alvarez that "attorneys must check every citation to make sure the case exists and the citations are correct. [Citation.] Attorneys should not cite cases for legal propositions different from those contained in the cases cited. [Citation.] And attorneys cannot delegate this responsibility to any form of technology; this is the responsibility of a competent attorney." As explained by Alvarez, "[h]onesty in dealing with the courts is of paramount importance, and misleading a judge is, regardless of motives, a serious offense."
For all of the foregoing reasons, we find that Grotke has failed to show cause why he should not be sanctioned for relying on fabricated legal authority in the Writ and the AOB…. [W]e issue a sanction in the amount of $1,750 to be paid by Grotke individually …. We direct the Clerk of this court to notify the State Bar of the sanctions against Grotke.
I e-mailed the lawyer to see if he had a response, and he said this:
The cases were real, not hallucinations, though I have seen AI hallucinate cases in the past. The cites were just mistaken as to where they were located, page number, volume, etc. I reviewed the cases and included them because they were relevant. I believed that I had the correct cites because they were relevant, but somewhere along the way, maybe AI being the cause, I obtained the wrong cites. As I explained to the court, if I knew exactly why they were incorrect, they would not have been submitted that way.
Editor's Note: We invite comments and request that they be civil and on-topic. We do not moderate or assume any responsibility for comments, which are owned by the readers who post them. Comments do not represent the views of Reason.com or Reason Foundation. We reserve the right to delete any comment for any reason at any time. Comments may only be edited within 5 minutes of posting. Report abuses.
Please to post comments
We've seen a number of cases in which lawyers have been fined for including apparent AI hallucinations in their filings. I would hope that those lawyers were not allowed to pass those fines along to their clients; but is there any sort of oversight to ensure that they don't do so?
Furthermore, if a judge discovers hallucinations in a filing and orders the lawyer to amend it, can the lawyer charge the client for the additional hours that it takes to produce that amended version?
Money is fungible. Fines are an expense. Those fines will be paid for by his clients, and it is almost impossible to prevent him finding some way to bill this client.
I think that the judge is “miffed” that the attorney appears to be lying to the Court, which is a separate offense from using incorrect citations.
I think it is appropriate for the the judge to ask “how did this happen?” before imposing sanctions. It’s hard to imagine a set of circumstances which would justify including multiple incorrect citations in a brief, but my (or the judge’s) lack of imagination doesn’t prove that there are no such circumstances.
If I were the judge, yes, I'd be curious too. But for the simple goal of discouraging bad citations, it is immaterial how they got there. The attorney blew it. Whether intentionally, from being sloppy or lazy or in a hurry, it just doesn't matter.
Same as buying groceries. If the price of oranges doubles in a week, you might be curious, but whether it was a freeze in Florida, a trucker strike, an oil embargo, or end of season doesn't have much to do with whether you buy fewer oranges or get apples instead.
It absolutely does matter, just as it matters whether you ran over your neighbor because you hate him and pressed the gas pedal to the floor when you saw him, or whether you were checking your phone for text messages and didn't see him when he walked in front of your car. Intentional wrongdoing is always worse than negligence.
Sometimes a judge will expressly put in a sanctions order that the money is to be paid by the attorney, not the client. But that's implicit in any sanction directed at an attorney for his own misconduct.
Is there "oversight"? Not in the sense of the judge going over to the lawyer's office and standing over his shoulder while he makes out the sanctions check. But if the attorney tries to bill the client for that (or for the time spent dealing with the sanctions issue), the client can refuse to pay and file a grievance if necessary; that would not go over well for the lawyer.
I understand the judge being miffed that the lawyer is refusing to say what the judge wants to hear. But the judge seems just as much an ass for insisting the lawyer repeat certain words in the prescribed manner.
The lawyer screwed up. How he screwed up is his problem, not the judge's. Fine him for the bad result, not the manner in which it happened.
See above; that's just wrong. The manner in which something happens is relevant to the punishment imposed for that thing.
Why do judges impose such pitifully small fines? It won't deter. I suppose the embarassment is the big deterrent, but why not make the fine more than symbolic, or, better yet, throw him in jail for 3 days?
Here the referral to disciplinary authorities based on the finding of lack of candor with the Court is likely the most consequential aspect of the ruling.
I've seen attorneys referred to disciplinary orders in a major published opinion and nothing ever comes out of it. Maybe they get a wrist-slap private citation, but nothing published. It just lets the court act like they've Done Something instead of having to actually do anything.
Maybe instead of AI blurbs and pseudonymous cases someone at this blog can post about the “don’t follow illegal orders” message to the military and Trump’s claims those lawmakers are seditious and should be hanged? I’m very interested in the law in this situation. Seems much more important.
1. Service members are obligated not to follow illegal orders.
2. Telling service members they have to obey the law is not sedition.
3. The penalty for sedition is not execution, anyway.
There you go; that's all the relevant law you need.