The Volokh Conspiracy
Mostly law professors | Sometimes contrarian | Often libertarian | Always independent
Sanctions Issued in Case Where Lawyers Cited ChatGPT-Hallucinated Precedents
From today's opinion in Mata v. Avianca, Inc., by Judge Kevin Castel (S.D.N.Y.), which stems from an incident blogged about here last month (and see this follow-up):
In researching and drafting court submissions, good lawyers appropriately obtain assistance from junior lawyers, law students, contract lawyers, legal encyclopedias and databases such as Westlaw and LexisNexis. Technological advances are commonplace and there is nothing inherently improper about using a reliable artificial intelligence tool for assistance. But existing rules impose a gatekeeping role on attorneys to ensure the accuracy of their filings.
Peter LoDuca, Steven A. Schwartz and the law firm of Levidow, Levidow & Oberman P.C. (the "Levidow Firm") (collectively, "Respondents") abandoned their responsibilities when they submitted non-existent judicial opinions with fake quotes and citations created by the artificial intelligence tool ChatGPT, then continued to stand by the fake opinions after judicial orders called their existence into question.
Many harms flow from the submission of fake opinions. The opposing party wastes time and money in exposing the deception. The Court's time is taken from other important endeavors. The client may be deprived of arguments based on authentic judicial precedents. There is potential harm to the reputation of judges and courts whose names are falsely invoked as authors of the bogus opinions and to the reputation of a party attributed with fictional conduct. It promotes cynicism about the legal profession and the American judicial system. And a future litigant may be tempted to defy a judicial ruling by disingenuously claiming doubt about its authenticity.
The narrative leading to sanctions against Respondents includes the filing of the March 1, 2023 submission that first cited the fake cases. But if the matter had ended with Respondents coming clean about their actions shortly after they received the defendant's March 15 brief questioning the existence of the cases, or after they reviewed the Court's Orders of April 11 and 12 requiring production of the cases, the record now would look quite different. Instead, the individual Respondents doubled down and did not begin to dribble out the truth until May 25, after the Court issued an Order to Show Cause why one of the individual Respondents ought not be sanctioned.
For reasons explained and considering the conduct of each individual Respondent separately, the Court finds bad faith on the part of the individual Respondents based upon acts of conscious avoidance and false and misleading statements to the Court.
Sanctions will therefore be imposed on the individual Respondents [and, as usual in such cases, on their law firm]…. The sanctions are "limited to what suffices to deter repetition of the conduct or comparable conduct by others similarly situated." Rule 11(c)(4)….
Some excerpts from the court's analysis:
Here, Respondents advocated for the fake cases and legal arguments contained in the Affirmation in Opposition after being informed by their adversary's submission that their citations were non-existent and could not be found. Mr. Schwartz understood that the Court had not been able to locate the fake cases. Mr. LoDuca, the only attorney of record, consciously avoided learning the facts by neither reading the Avianca submission when received nor after receiving the Court's Orders of April 11 and 12….
The Court concludes that Mr. LoDuca acted with subjective bad faith in violating Rule 11 in the following respects:
[a.] Mr. LoDuca violated Rule 11 in not reading a single case cited in his March 1 Affirmation in Opposition and taking no other steps on his own to check whether any aspect of the assertions of law were warranted by existing law. An inadequate or inattentive "inquiry" may be unreasonable under the circumstances. But signing and filing that affirmation after making no "inquiry" was an act of subjective bad faith. This is especially so because he knew of Mr. Schwartz's lack of familiarity with federal law, the Montreal Convention and bankruptcy stays, and the limitations of research tools made available by the law firm with which he and Mr. Schwartz were associated.
[b.] Mr. LoDuca violated Rule 11 in swearing to the truth of the April 25 Affidavit with no basis for doing so. While an inadequate inquiry may not suggest bad faith, the absence of any inquiry supports a finding of bad faith. Mr. Schwartz walked into his office, presented him with an affidavit that he had never seen in draft form, and Mr. LoDuca read it and signed it under oath. A cursory review of his own affidavit would have revealed that (1) "Zicherman v. Korean Air Lines Co., Ltd., 516 F.3d 1237 (11th Cir. 2008)" could not be found, (2) many of the cases were excerpts and not full cases and (3) reading only the opening passages of, for example, "Varghese", would have revealed that it was internally inconsistent and nonsensical.
[c.] Further, the Court directed Mr. LoDuca to submit the April 25 Affidavit and Mr. LoDuca lied to the Court when seeking an extension, claiming that he, Mr. LoDuca, was going on vacation when, in truth and in fact, Mr. Schwartz, the true author of the April 25 Affidavit, was the one going on vacation. This is evidence of Mr. LoDuca's bad faith.
The Court concludes that Mr. Schwartz acted with subjective bad faith in violating Rule 11 in the following respects:
[a.] Mr. Schwartz violated Rule 11 in connection with the April 25 Affidavit because, as he testified at the hearing, when he looked for "Varghese" he "couldn't find it," yet did not reveal this in the April 25 Affidavit. He also offered no explanation for his inability to find "Zicherman". Poor and sloppy research would merely have been objectively unreasonable. But Mr. Schwartz was aware of facts that alerted him to the high probability that "Varghese" and "Zicherman" did not exist and consciously avoided confirming that fact.
[b.] Mr. Schwartz's subjective bad faith is further supported by the untruthful assertion that ChatGPT was merely a "supplement" to his research, his conflicting accounts about his queries to ChatGPT as to whether "Varghese" is a "real" case, and the failure to disclose reliance on ChatGPT in the April 25 Affidavit….
The Court has considered the specific circumstances of this case. The Levidow Firm has arranged for outside counsel to conduct a mandatory Continuing Legal Education program on technological competence and artificial intelligence programs. The Levidow Firm also intends to hold mandatory training for all lawyers and staff on notarization practices. Imposing a sanction of further and additional mandatory education would be redundant.
Counsel for Avianca has not sought the reimbursement of attorneys' fees or expenses. Ordering the payment of opposing counsel's fees and expenses is not warranted.
In considering the need for specific deterrence, the Court has weighed the significant publicity generated by Respondents' actions. The Court credits the sincerity of Respondents when they described their embarrassment and remorse. The fake cases were not submitted for any respondent's financial gain and were not done out of personal animus. Respondents do not have a history of disciplinary violations and there is a low likelihood that they will repeat the actions described herein.
There is a salutary purpose of placing the most directly affected persons on notice of Respondents' conduct. The Court will require Respondents to inform their client and the judges whose names were wrongfully invoked of the sanctions imposed. The Court will not require an apology from Respondents because a compelled apology is not a sincere apology. Any decision to apologize is left to Respondents.
The Court concludes that a penalty of $5,000 paid into the Registry of the Court is sufficient but not more than necessary to advance the goals of specific and general deterrence….
Editor's Note: We invite comments and request that they be civil and on-topic. We do not moderate or assume any responsibility for comments, which are owned by the readers who post them. Comments do not represent the views of Reason.com or Reason Foundation. We reserve the right to delete any comment for any reason at any time. Comments may only be edited within 5 minutes of posting. Report abuses.
Please
to post comments
[This opinion written by ChatGPT] 🙂
That was truly inspired....made me laugh.
same
And the collective sigh of relief from everyone at the firm could be heard several states away. $5k plus some CLEs, and no bar referrals. Could have been a lot worse.
The Bar may yet decide to act. Are they dependent only on referrals to act in New York? Not in my state.
What astonished me the most was the one attorney supposedly had 30+ years experience. IANAL, but I'd think any lawyer with that much experience should have been able to just smell the hallucinations. The citations, the summaries, something should have given away the fakes. And to not double check once questioned, but to wait until it got the Judge's attention ... he really sounds like someone I would never want to rely on for anything legal ever again. And if I were a past client, or he had been a past opponent, I'd want to take a good long hard look at his work then.
As my old partner used to say, 90% of the people are not in the top 10%. And 10% of the people are in the bottom 10%.
There are a lot of really bad lawyers out there.
He was completely out of his element - a PI lawyer having to wrestle with bankruptcy research. I'm not excusing him (and I'm not denigrating PI law); I'm just saying that his years of experience were largely irrelevant in this particular context.
My years of experience would be largely irrelevant if I tried to handle a PI case. But (1) that's why I wouldn't handle a PI case, I'd get someone who was competent to do it, and (2) I could still figure out that those cases were bogus or at a minimum that I needed to do a little more research or talk to someone about it if I tried.
Actually, both had that level of experience, but one was just a figurehead, foolishly allowing his bar admission to be used by his colleague. But as I’ve tried to explain — and I badly offended someone on Twitter for saying it — these guys are just NY PI lawyers. They don’t do substantive motions. They might be great negotiators. They might be great in the courtroom, performing persuasively in front of the jury. (I have no idea.) But their practice does not involve addressing complex legal issues in written submissions.
To be clear, I am not calling them incompetent or stupid (though their actions in this case don't exactly point away from that). I am just saying that despite their decades of practice they have virtually no experience with the situation that confronted them in this case that caused them to turn to ChatGPT in the first place.
This decision should have been announced in open court with the lawyers present so the judge could string them along with suggestions of disbarment and involuntary servitude before letting them off with a fine.
Why?
So....a slap on the wrist = 5K penalty. The client is out of luck.
The client was out of luck anyway; they had malpracticed up the case before the ChatGPT debacle. They had timely filed a lawsuit, but then inexplicably dismissed it when they learned about the airline's bankruptcy. Then they refiled it — but after the statute of limitations pursuant to the Montreal Convention had passed.
All of the ChatGPT stuff was just a sideshow as far as the merits of the case were concerned. They only turned to AI after the airline moved to dismiss the case on statute of limitations grounds.
Not necessarily. They can always sue their lawyers for legal malpractice.
HallucinAItion, surely
Or "hallucitation" (often credited to Kate Crawford)?
In my earlier reading of the case; I assumed good faith (albeit massive incompetence) by the attorney. But, here, it seems like he actually did get notice from opposing counsel, questioning his cites. For me, if true, that changes my entire calculation. Now, I think the sanction was extremely light. (And is it just me, or did the judge imply: "Hey, if opposing counsel had asked me to also make the bad lawyer pay for all the time and effort their firm had to put in; I happily would have done that. But no such request was made, and I'm therefore not adding that to the $5K amount.")
Yes, although as I noted in a previous thread it doesn’t seem like the opposing counsel had to do all that much work in response.
You guys always seem to play this as a game among yourselves. Did opposing counsel bill the client for the time spent in the response?
In a situation like this if I spent some time opposing it but not much, I'd likely advise the client to just let it go. There are lots of unexpected plot twists in litigation, and setting a precedent of nitpicking over minor fees can come back to bite you if for whatever reason you end up being on the short side of things later in the case.
There's also a credibility angle: even though the judge here signaled that he would have awarded the fees, it wouldn't surprise me if he still thinks more highly of the defense lawyers for not asking for them. Reputational investments like that can help tilt coin-flip scenarios your way later on.
Yeah. They got what they really wanted, which was dismissal of the case. Getting an extra (say) $2,500 check from the plaintiff's lawyers wasn't really important to them.
Only after the fact. Avianca moved to dismiss. He submitted his ChatGPT-generated response. And then Avianca filed a short reply brief saying, "We don't know what the heck is going on here; we can't find most of these cases cited and the others don't hold what he claims."
It was only at that point that the court jumped in, said, "Yeah — what's going on? Submit copies of these cases you’ve cited." That, not the initial filing, is where things went totally off the rails for the ChatGPT lawyer. Because instead of doing his due diligence and then saying, "WTF? You're right. These cases don't exist. Mea culpa," he returned to ChatGPT to find the cases.
What was that you said about them? "To be clear, I am not calling them incompetent or stupid." Care to change your mind?
From the dugouts this may look like a slap on the wrist, but from the bleachers this case got a huge amount of exposure, especially in the software community. Just having the facts publicized like this was all we needed to convince our direct reports to learn how chat AIs work and for the love of Mike to stop telling our customers that we’re using it everywhere.
I’m all in favor of chat engines, but as a replacement for end-user programming tools such as report writers, not to “generate” facts on their own. Having an end user write a prompt such as “show me a summary by state of all widget sales in New England last year” and then have the chat engine configure a report template to answer that question would be fantastic.
The key here is that the chat engine needs to not be taken as authoritative, but just as a helper technology.
Here is Slashdot's thread on this: https://yro.slashdot.org/story/23/05/27/1755212/lawyer-greatly-regrets-relying-on-chatgpt-after-filing-motion-citing-six-non-existent-cases
They definitely got off light, but I think the reputational harm is where the real damage is. Knowledge and interest in this case is not limited to the court that issued the sanctions. Even though the lawyers don't really practice in that court so the reputational harm there is minimal, the courts they DO practice in have very assuredly heard of this and will take notice. This is going to have lasting harm on their reputations, which will hurt them anytime their credibility is at stake and in those coin-flip scenarios.
Forget about reputational harm in the courts in which they usually practice. A PI career is pretty much dependent on word-of-mouth for bringing in business (at least until you get to the point where you can afford your own jingle.) Referrals from past clients and from colleagues. Who's going to refer a case to them now? (Hell, if you're a fellow attorney it would arguably be malpractice to refer a client to them.)
The judge explicitly took that into account: "In considering the need for specific deterrence, the Court has weighed the significant publicity generated by Respondents' actions."
Introducing ChatGPT Deutsch - GPTDeutsch.com, where innovation meets language! Prepare for a fascinating journey into the magnificent realm of Dutch artificial intelligence. We are excited to unveil a remarkable interactive experience that will revolutionize the way you communicate and explore the depths of language. Say goodbye to language barriers and hello to limitless possibilities with ChatGPT-4, the pinnacle of OpenAI's impressive language modeling technology!