The Volokh Conspiracy

Mostly law professors | Sometimes contrarian | Often libertarian | Always independent

AI in Court

Judge Faults Federal Government Lawyer for Apparent AI Hallucination

|

From Judge Hala Jarbou (W.D. Mich.) yesterday in Daghra v. Hinkley:

Petitioner, a United States Immigration and Customs Enforcement detainee, initiated this action by filing a petition for a writ of habeas corpus pursuant to 28 U.S.C. § 2241. An immigration judge had granted Petitioner a bond of $35,000, but the bond order was stayed pending appeal to the Board of Immigration Appeals pursuant to 8 C.F.R. § 1003.19(i) (2025). Petitioner argued that the 90-day automatic stay provision in § 1003.19(i) violates the Fifth Amendment's Due Process Clause, and sought an order requiring the Government to allow him to post bond. While this lawsuit was pending, the automatic stay of Petitioner's bond order expired. The Government now represents that the bond order is back in effect and Petitioner will be released if he posts the $35,000 bond. Accordingly, the Court finds that the habeas petition is moot and dismisses it without prejudice.

There is one additional issue in this case that the Court must address. In the Government's response to the Court's initial order to show cause, it stated the following:

More recently, the Sixth Circuit has reiterated that § 1226(e) bars challenges that "ask the court to reweigh the evidence underlying a bond decision or second-guess the Immigration Judge's discretionary judgment." See Taylor v. Hott, 724 F. App'x 387, 392 (6th Cir. 2018) (district court lacked jurisdiction to review IJ's bond denial where petitioner challenged flight-risk determination) ….

The cited case, Taylor v. Hott, is not located at the identified page of the Federal Appendix. Indeed, page 387 is contained within a different opinion—Atkins v. CGI Techs. & Sols., Inc., 724 F. App'x 383 (6th Cir. 2018)—which is about commercial arbitration, not immigration bond determinations. In its research, the Court was unable to identify a Sixth Circuit case with the caption Taylor v. Hott, or any federal case containing the quoted language. Thus, it seems this citation was likely produced by generative artificial intelligence ("AI").

"It is no secret that generative AI programs are known to 'hallucinate' nonexistent cases, and with the advent of AI, courts have seen a rash of cases in which both counsel and pro se litigants have cited such fake, hallucinated cases in their briefs." "Without question, it is improper and unacceptable for litigants … to submit non-existent judicial opinions with fake quotes and citations." It should be obvious that any attorney who uses AI must scrupulously review its work product to ensure that the cited cases exist and that the citations accurately and fairly represent the underlying case law. The duty of candor towards this tribunal demands no less.

Although the Court will not presently impose sanctions for this conduct, it goes without saying that the Government must ensure its future filings with this Court do not include non-existent case law.

Thanks to the Media Law Resource Center (MLRC) MediaLawDaily for the pointer.