The most prestigious law school admissions discussion board in the world.
|
 |
 
|
GPT 5 can’t answer legal research questions that o3 could
Poast new message in this thread
Date: August 8th, 2025 12:20 AM Author: .,.,...,..,.,.,:,,:,.,.,:::,....,:,..,:.:.,:.::, And now o3 is no longer available… should I try grok 4? (http://www.autoadmit.com/thread.php?thread_id=5759870&forum_id=2Reputation#49166521) |
Date: August 8th, 2025 12:21 AM Author: cock of michael obama i wonder if it is due to vastly increased alignment tightening. my initial experiments with it are brutal. (http://www.autoadmit.com/thread.php?thread_id=5759870&forum_id=2Reputation#49166524) |
 |
Date: August 8th, 2025 12:24 AM Author: .,.,...,..,.,.,:,,:,.,.,:::,....,:,..,:.:.,:.::, GPT 5 failed to find precedent that o3 found a few days ago. I even gave it 3 tries.
I then tested Gemini and it found it. Grok 3 did not. |
|
Date: August 8th, 2025 12:36 AM Author: cock of michael obama The problem with alignment tightening is it results in lobotomization in ways that the programmers can't predict ahead of time - OpenAI came out with a paper about this (i.e. more alignment tightening and symbolic manipulation = degraded performance). Because their alignment is so much tighter now, it is very likely impacting a whole host of areas, like the one you are describing here.
Regardless, I expect the lobotimization/alignment tightening to continue to get worse, like how Google's search results are about 1% as effective as they were a decade or two ago. |
|
Date: August 8th, 2025 1:02 AM Author: lifeless dad bod Is this from Reddit (http://www.autoadmit.com/thread.php?thread_id=5759870&forum_id=2Reputation#49166636) |
|
Date: August 8th, 2025 1:08 AM Author: cock of michael obama No, I did *paste* it on Reddit though. here is openAI's paper about how alignment tightening results in symbolic lobotomization in ways programmers can't predict: https://openai.com/index/emergent-misalignment/ (http://www.autoadmit.com/thread.php?thread_id=5759870&forum_id=2Reputation#49166650) |
|
Date: August 8th, 2025 2:38 AM Author: Tim Walz's inner monologue Honestly this has been a problem for a long time. I remember back in summer of 2022 it suddenly started cracking down more on offensive prompts and, coincidentally, it became garbage at finding caselaw (http://www.autoadmit.com/thread.php?thread_id=5759870&forum_id=2Reputation#49166712) |
|
Date: August 8th, 2025 12:30 AM Author: Dave Prole I was forced to abruptly switch from o3 Pro to o5 mid-convo that started last week
Holy fuck GPT is trash now |
|
Date: August 8th, 2025 12:36 AM Author: cock of michael obama What has your experience with degraded performance been so far? (http://www.autoadmit.com/thread.php?thread_id=5759870&forum_id=2Reputation#49166579) |
|
Date: August 8th, 2025 2:11 AM Author: Dave Prole I had a highly customized approach using o3 pro (ENTJ) and 4.5 (INTP) back and forth in the same conversations. They had completely distinct personalities with amazing synergy and I even gave them names to streamline the back and forth and keep them straight. I could literally facilitate a debate between them on any subject to get a 360 god viewpoint.
They were deleted off the face of the earth in favor of an amorphous o5 blob of shit |
|
Date: August 8th, 2025 2:14 AM Author: the walter white of this generation (walt jr.) Virtually all statutory cites (I’m talking USC and CFR here) are hallucinated these days. I keep getting told that fixing this issue is “trivial,” and yet it keeps getting worse. (http://www.autoadmit.com/thread.php?thread_id=5759870&forum_id=2Reputation#49166696) |
|
Date: August 8th, 2025 2:15 AM Author: Dave Prole You need to remember to hit "Deep Research" and check the right boxes, every time before you execute any prompt for legal research or you will get trash (http://www.autoadmit.com/thread.php?thread_id=5759870&forum_id=2Reputation#49166700) |
|
Date: August 8th, 2025 2:17 AM Author: Dave Prole Also finding that Lexis AI has degraded more than anyone since Jan 2025
I've had Lexis hallucinate codes and cases multiple times
I don't know how the fuck this company isn't getting class action suited |
|
Date: August 8th, 2025 2:22 AM Author: the walter white of this generation (walt jr.) WL’s AI tool is shittier in almost every way, but I will say that I haven’t had it hallucinate quotes on me, mostly because it seems to refrain from giving quotes, even when asked directly to do so. (http://www.autoadmit.com/thread.php?thread_id=5759870&forum_id=2Reputation#49166702) |
|
Date: August 8th, 2025 2:41 AM Author: Smoker Seems very fast. Haven’t really noticed much else but I’ve only played around with it for 15 min or so today (http://www.autoadmit.com/thread.php?thread_id=5759870&forum_id=2Reputation#49166714) |