The most prestigious law school admissions discussion board in the world.
|
 |
 
|
Crazy that the AI Legal Agent benchmarks are amongst the lowest
| gunnerretttired | 07/28/26 |
| gunnerretttired | 07/28/26 |
| femgooner meta scientist | 07/28/26 |
| gunnerretttired | 07/28/26 |
| femgooner meta scientist | 07/28/26 |
Poast new message in this thread
Date: July 28th, 2026 1:59 PM Author: gunnerretttired (gunneratttt) STEMmos have always looked down on us, but it turns out automating that stuff is way easier than putting together A DEAL! (http://www.autoadmit.com/thread.php?thread_id=5887079&forum_id=2ГѓЖ’#50029944) |
Date: July 28th, 2026 3:28 PM Author: gunnerretttired (gunneratttt) (http://www.autoadmit.com/thread.php?thread_id=5887079&forum_id=2ГѓЖ’#50030208) |
|
Date: July 28th, 2026 3:32 PM Author: femgooner meta scientist My irl lawyer friends don't believe me when I tell them that it's only a matter of time before enough money is thrown at RL environments to make LLMs almost as good at law as they are at programming
Right now they are already better than most attorneys (most attorneys suck) |
 |
Date: July 28th, 2026 3:41 PM Author: gunnerretttired (gunneratttt) I agree it's better than many attorneys already and that someday it may get to that point you're saying. I'm just saying it's a bit suprising how much of a gap there is between legal performance benchmarks and other things.
https://x.com/i/status/2064394151441863006 |
|
Date: July 28th, 2026 3:48 PM Author: femgooner meta scientist It's because they haven't thrown resources at RL for law specifically. The models are extremely good at programming because there has been an enormous amount of resources sunk into training them for that specifically. It's true that programming is easier (less resource intensive) than law to RL train for, but it still required a lot of effort to get models this good at programming
Eventually the same thing will happen for law. The incentives are there because lawyers are outrageously overpaid for the actual level of expertise and training that they have. They're able to command the excessive compensation they get only because they're a monopoly/cartel
AI displacing lawyers is going to be one of the most positive outcomes from AI because lawyers have such disproportionate power and influence in our society and their interests conflict with those of most people. They are an extremely anti-social force in modern society and responsible for a lot of our society's ills |