The most prestigious law school admissions discussion board in the world.
|
 |
 
|
Law Professors Prefer AI Over Peer Answers
Poast new message in this thread
Date: June 2nd, 2026 5:12 PM Author: Snowy coffee pot mood https://law.stanford.edu/wp-content/uploads/2026/06/salinas_et_al.pdf
"Professors rated LLMs far higher than their peers (average win rate = 75.33%), with models performing similarly to the best instructor. LLM responses were also rarely flagged as harmful (3.53%, vs 12.06% for professors). Preferences for LLM answers were consistent across evaluators and reflected shared professional standards." |
 |
Date: June 2nd, 2026 5:32 PM Author: Unholy 180 macaca llm's are pretty good at legal stuff. thete's gonna be a flood of litigation as normies and proles realize a $20 claude subscription can produce at least as good of results as a $200/hr shitlaw attorney who doesn't return their calls. (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2Elisa#49911539) |
|
Date: June 2nd, 2026 5:39 PM Author: abnormal address boltzmann (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2Elisa#49911544) |
|
Date: June 2nd, 2026 5:40 PM Author: Snowy coffee pot mood I think filing fees will largely prevent that, but I agree that AI can do a pretty good job with basic drafting tasks. It can definitely analyze typical consumer dispute documents and create a competent complaint.
IME, the public AI tools aren't very good with legal research and citations, but a lot of cases don't require much of that. They also aren't particularly good with strategy and argument judgment. But competent drafting is typically more important than either of those for the normie litigation you're talking about. |
|
Date: June 2nd, 2026 5:43 PM Author: Flickering Round Eye Weed Whacker a $500 filing fee isnt going to prevent normie litigation where stakes are high enough, such as some prole homeowner vs. a house contractor over a $30k kitchen reno (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2Elisa#49911551) |
|
Date: June 2nd, 2026 8:08 PM Author: Up-to-no-good confused theater half-breed Which LLMs? ChatGPT has been dead fucking wrong about multiple legal questions I've asked it (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2Elisa#49911904) |
Date: June 2nd, 2026 5:17 PM Author: Snowy coffee pot mood Hey, 1Ls, no need for office hours. Just ask AI. (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2Elisa#49911521) |
|
Date: June 2nd, 2026 5:31 PM Author: Flickering Round Eye Weed Whacker Law professors prefer JDs over LLMs, the study added. (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2Elisa#49911536) |
|
Date: June 3rd, 2026 11:33 AM Author: Ultramarine Hideous National Giraffe (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2Elisa#49912733) |
|
Date: June 2nd, 2026 5:44 PM Author: Shivering Peach Public Bath What "questions" could a law professor possibly need the answer to? Should I go to Greece or Spain for my next sabbatical? (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2Elisa#49911554) |
|
Date: June 2nd, 2026 5:49 PM Author: abnormal address boltzmann (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2Elisa#49911563) |
|
Date: June 3rd, 2026 11:33 AM Author: Ultramarine Hideous National Giraffe (http://www.autoadmit.com/thread.php?thread_id=5870655&forum_id=2Elisa#49912734) |
|
Date: June 2nd, 2026 8:07 PM Author: tan orchestra pit haunted graveyard This is a dumb study with a predictable result.
They're essentially taking popular 1L cases taught first year law students, and asking professors and LLMs to explain them.
Predictably, the LLMS did better because they can just summarize the casebooks from the past 40 years in the most concise way.
But let's say we a ran a study, where we compared the explanations in the study guide vs the explanations of professors, and other professors chose the study guide 75% of the time. Would that be meaningful or surprising?
I wouldn't think so... |