The Volokh Conspiracy
Mostly law professors | Sometimes contrarian | Often libertarian | Always independent
Hallucinating Josh Blackman
Did I write "The Most Dangerous Man On the Supreme Court"?
I realize that I live rent-free in the heads of many law professors. Apparently, I also reside in the dreams of generative AI.
A professor emailed me to ask if I ever wrote this article:
Blackman, Josh. "The Most Dangerous Man On the Supreme Court." Charleston Law Review, vol. 11, no. 17, 2017, pp. 321-365.
No, I've never written this article. In fact, I'm not sure who would have been the most dangerous person on the Supreme Court in 2017. And I've never published in the Charleston Law Review.
Yet, a student in this professor's class submitted a paper that cited this article! And apparently the student used Chat GPT or some other generative AI. The professor wanted to verify I didn't write the article, to support an academic misconduct complaint against the student. I verified the claim, though in candor, I double checked to make sure I didn't write something with that title in some other journal. (I didn't.).
The professor also told me the student cited a book published by Justice Barrett about the Supreme Court and cinema in the Southern Illinois University Press. I think it is safe to say she did not publish that book--or any other book for that matter. (Sorry, I couldn't resist.)
I was tempted to title this post, I Dream of Joshie, but I doubt enough readers would have gotten the reference.
Editor's Note: We invite comments and request that they be civil and on-topic. We do not moderate or assume any responsibility for comments, which are owned by the readers who post them. Comments do not represent the views of Reason.com or Reason Foundation. We reserve the right to delete any comment for any reason at any time. Comments may only be edited within 5 minutes of posting. Report abuses.
Please
to post comments
Next thing you know I'll have been awarded the Nobel in Chemistry (or maybe literature, or...)
Readers wouldn't understand an "I Dream Of Jeannie" reference? He clearly DOESN'T read the comments -- or else he'd know that an awful lot of us are old(-ish) fogies who absolutely would get it.
Thanks, now I need to use a red-hot fireplace poker to get the image of Josh Blackman in crop top and harem pants out of my head.
I don't understand how this is happening -- if Josh had NEVER published ANYTHING in that particular journal, why does it think he did?
It's not a search engine. It doesn't look for certain items and verify them.
It's a large language model. It instead looks at patterns of how items are written, and imitates that pattern. It changes key parameters, while maintaining the pattern.
It sees a pattern for a citation. "Author, Title, Journal, Journal number". Then uses that pattern to create novel speech.
It doesn't think he did. (It doesn't think at all.)
You know how when you're typing on your phone, it suggests what your next word might be? (On the iPhone, it gives you three choices; I assume android is similar.) It does that by looking at what words statistically most often follow the word you just typed. That's all generative AI does.
I knew Barbara Eden. Barbara Eden was a good friend of mine...
If that's true you are one lucky bastard.
I don't think any of us would object to the observation that Josh is no Barbara Eden.
Yeah, but you are probably kicking yourself that you didn't compile your Roberts posts into an article and submit it.
It probably won't take too many kids kicked out of law school for having chatgpt write their papers for them to figure out its a shortcut, but not a shortcut to success.
ChatGPC is also a good source of spurious Lincoln quotes. But who isn't?
"No man has a good enough memory to be a successful liar, which is why I invented Artificial Intelligence." Abraham Lincoln
"I really like these menthol cigarettes!" -Abraham Lincoln
Man you really don’t want to be grading right now. Respect.
Is the question "is Josh hallucinating about his own importance"?
Well, yes.
Another post by Blackman that is primarily about Blackman. Free rent isn't worth living anywhere near Blackman's head, let alone inside of it.
Josh is the easiest of writers for AI to fake. Wait a minute . . .!
You may be on to something there. That would explain a lot, if there is not an actual biological form of Blackman, but rather just some matrix version accidentally produced from some horrid coding or algorithmic accident. Even if true, Matrix Blackman is just as off-putting. But at least God is not to blame.
At least Searle's Chinese Room wouldn't invent fake articles. Score 1 for traditional pseudo-AI
That show was far before my time, and I do get the reference. It just really is that well known.
If one is REALLY old, they'll think he's referencing the Stephen Foster song.
"Hallucinating Josh Blackman"
The very best libertarian reason for not taking drugs?