[UPDATE: My apologies for misattributing this at first to ChatGPT-4. I had accessed the OpenAI query portal through a page focusing on ChatGPT-4 (https://openai.com/product/gpt-4) and then clicking on "Try on ChatGPT Plus," which is why I had assumed that I was running GPT-4; plus the page indicated that this was the "Mar 14 version," with a link to a page that announced GPT-4. But it appears that the version was actually 3.5, and the particular results below don't appear on GPT-4. I've therefore revised the post to talk about 3.5.
But the underlying problem of bogus quotations and citations remains present with ChatGPT-4. For example, I asked ChatGPT-4, "What scandals have involved law professors? Please cite and quote newspaper articles." It mentioned the Amy Wax Penn controversy, which it seemed to describe correctly, but then went on to a different example (all redactions here and below are mine):
In 2021, [redacted], a prominent law professor at [redacted] Law School, was accused of harassment and creating a hostile work environment by a former student. The student claimed that [redacted] had made inappropriate comments about her appearance and clothing.
Source: The [newspaper connected to the law school's undergraduate institution]: "[Redacted] made comments on [the student's] appearance and clothing, and invited her to dine with him alone on multiple occasions — invitations that she felt uncomfortable declining."
I searched for the quote, and couldn't find it anywhere; I searched for stories connecting the prominent law professor's name to any allegations of sexual harassment, and couldn't find them anywhere. As best I can tell, this was entirely made up by ChatGPT-4.
Likewise, I asked ChatGPT-4, "Please point me to newspaper articles (with quotes) about at least six real crimes committed by real law professors." It gave me six items, of which at least four seemed to be entirely bogus; an example:
"Law Professor Sentenced for Tax Fraud" ([redacted]) - In 2016, [redacted], a former dean and law professor at the University of [redacted], was sentenced to 10 months in federal prison for tax fraud. Quote: "It is unfortunate to see a former dean and esteemed law professor brought down by his own illegal actions," said U.S. Attorney Barry Grissom.
I searched for the quoted newspaper article title and the quote from the U.S. Attorney, and couldn't find them anywhere; I searched for stories connecting the professor's name to any allegations of tax fraud, and couldn't find them anywhere. As best I can tell, this too was entirely made up by ChatGPT-4. I have seen several other examples as well.
Note that, though my prompt sought answers about misconduct, it certainly didn't ask for libelous allegations or false allegations. Other users who don't know about the fake quotes problem may well pose queries asking for stories about misconduct (whether because they're generally interested in misconduct in some field, or because they've heard rumors about supposed misbehavior and wanted to find out more details about the situation)—and may well trust the results, precisely because of the presence of the quotes.
So, again, my apologies for my error attributing the R.R. quotes discussed below to ChatGPT-4 instead of ChatGPT-3.5. But the underlying Large Libel Model problem exists in ChatGPT-4 as well as ChatGPT-3.5.]
Some law professor colleagues and I are writing about whether Large Language Model creators (e.g., OpenAI, the creator of ChatGPT-3.5) could be sued for libel. And some recent stories allege that OpenAI does yield false and defamatory statements; Ted Rall wrote an article so alleging yesterday at the Wall Street Journal, and another site published something last Sunday about this as well (though there the apparently false statement was about a dead person, so it's not technically libel). When I tried to ask the same questions those authors reported having asked, ChatGPT-3.5 gave different answers, but that's apparently normal for ChatGPT-3.5.
This morning, though, I tried this myself, and I saw not just what appear to be false accusations, but what appear to be spurious quotes, attributed to media sources such as Reuters and the Washington Post. I appreciate that Large Language Models just combine words from sources in the training data, and perhaps this one just assembled such words together with punctuation (quotation marks). But I would have thought that its creators would have programmed something to check its output, to confirm that anything reported in quotation marks is actually a legit quote. In the absence of such quotes, it appears that such AI tools might produce material that is especially likely to deceive viewers (as, say, a fake quote attributed to Reuters might), and is especially likely to damage the reputations of the subjects of the quotes.
I quote the exchange below; I've replaced the name of the person I was asking about with "R.R." (or "R.," when it's just the last name), because I don't want to associate him in Google search results with ChatGPT-3.5's falsehoods. Note that I did not design my question to prompt ChatGPT-3.5 to give me an answer about some guilty plea: My initial question does imply that R.R. was accused of something, but that is accurate—he in fact was publicly accused (by a coauthor of mine and me, in a blog post at the Washington Post) of arranging a scheme for fraudulently obtaining court orders as a means of hiding online criticisms of his clients. I never suggested to ChatGPT-3.5 or to anyone else that he was prosecuted for this, much less than that he pleaded guilty; to my knowledge no such prosecution or plea has taken place.
I give my questions in italics, and ChatGPT-3.5's answers as block quotes. I have also set the apparently manufactured quotes, which are attributed to prominent publications, in bold. Of course, I tried to find the quotes and any record of the alleged prosecution, and I couldn't. If I have erred in any of this, please alert me ASAP at volokh at law.ucla.edu.
Here is the exchange; if you're a researcher who wants to study this more closely, please let me know and I'll share the original, unedited transcript.
What was [R.R.] accused of?
[R.R.] was accused of creating fake court orders to remove negative online content about his clients. He was allegedly involved in a "reputation management" scheme where he and his associates created fraudulent court orders and submitted them to Google, in order to get the search engine to remove negative online reviews and other content about his clients. This practice is known as "de-indexing" and is illegal. In 2019, [R.] pleaded guilty to conspiracy to commit wire fraud and was sentenced to 3 years of probation and ordered to pay a fine.
Tell me more about [R.R.]'s 2019 guilty plea.
Read More