\
  The most prestigious law school admissions discussion board in the world.
BackRefresh Options Favorite

5/30/25 AI thread

https://jax-ml.github.io/scaling-book/ start archiving/sa...
At-the-ready Adventurous Hospital Skinny Woman
  05/30/25
Google wants you to rent TPU time, so i doubt that.
arousing son of senegal electric furnace
  05/30/25
i was thinking of the government, but this is a cr point
At-the-ready Adventurous Hospital Skinny Woman
  05/30/25
it would be interesting to know how big of a business this i...
arousing son of senegal electric furnace
  05/30/25
I've already started messing with TensorFlow, CUDA and small...
Irradiated Pit Main People
  05/30/25
yeah i realized pretty quick i just have to buy more GPUs ...
At-the-ready Adventurous Hospital Skinny Woman
  05/30/25
soon we should have dedicated NPUs or CPUs with sufficient T...
Irradiated Pit Main People
  05/30/25
why are you doing this locally? genuinely curious, is it a d...
flatulent sweet tailpipe dopamine
  05/30/25
you can customize and train based on your own defined hyperp...
Irradiated Pit Main People
  05/30/25
(Guy cornering the kindle “romance” market)
silver water buffalo
  05/30/25
I trained a local LLM on xo and it called me a fag
Vigorous Transparent Sex Offender
  05/30/25
...
cerebral elite elastic band
  05/30/25
AutoAdmit AI Archive Bank
carnelian cocky reading party
  05/30/25
part of me wants to train an LLM on all xo content but part ...
At-the-ready Adventurous Hospital Skinny Woman
  05/30/25
User: XO-GPT, can you help me with this legal question? My r...
silver water buffalo
  05/30/25
...
jet party of the first part
  05/30/25
...
At-the-ready Adventurous Hospital Skinny Woman
  05/30/25
...
Pearl karate
  05/30/25
feel like i’ve seen this thread
carnelian cocky reading party
  05/30/25
NYT Opinion | Evan39
cerebral elite elastic band
  05/30/25
https://x.com/SakanaAILabs/status/1928272612431646943 @gr...
At-the-ready Adventurous Hospital Skinny Woman
  05/30/25
meta-learning is the obvious direction for machine learning ...
arousing son of senegal electric furnace
  05/30/25
this seems absolutely cr at the agentic level (what these gu...
At-the-ready Adventurous Hospital Skinny Woman
  05/30/25
self-improving is trickier. i don't know that i like the wor...
arousing son of senegal electric furnace
  05/30/25
ty, adding the random weights is what i was conceptually mis...
At-the-ready Adventurous Hospital Skinny Woman
  05/30/25
it depends on how many training steps you need to take in or...
arousing son of senegal electric furnace
  05/30/25
Is an AI making these daily AI threads 😲
galvanic henna dingle berry
  05/30/25
could an AI say nigger?
At-the-ready Adventurous Hospital Skinny Woman
  05/30/25
https://x.com/ripplebrain/status/1928522539816681658 2035...
At-the-ready Adventurous Hospital Skinny Woman
  05/30/25
https://x.com/kalomaze/status/1928572837842825258
At-the-ready Adventurous Hospital Skinny Woman
  05/30/25


Poast new message in this thread



Reply Favorite

Date: May 30th, 2025 11:33 AM
Author: At-the-ready Adventurous Hospital Skinny Woman

https://jax-ml.github.io/scaling-book/

start archiving/saving all of this kind of stuff offline. eventually "they" will take all of it down to try to stop smaller guys from training models

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973564)



Reply Favorite

Date: May 30th, 2025 11:40 AM
Author: arousing son of senegal electric furnace

Google wants you to rent TPU time, so i doubt that.

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973577)



Reply Favorite

Date: May 30th, 2025 11:49 AM
Author: At-the-ready Adventurous Hospital Skinny Woman

i was thinking of the government, but this is a cr point

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973604)



Reply Favorite

Date: May 30th, 2025 12:00 PM
Author: arousing son of senegal electric furnace

it would be interesting to know how big of a business this is for Google. i don't get the impression that many people outside of Google use them. if LLM coding agents advance enough though the cost to port code from Nvidia GPUs to TPUs becomes quite small.

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973635)



Reply Favorite

Date: May 30th, 2025 11:39 AM
Author: Irradiated Pit Main People

I've already started messing with TensorFlow, CUDA and small LLMs locally. The problem is my GPU has 16 GB VRAM which isn't enough to do anything serious. Might have to splurge on a 5090 or something soon.

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973576)



Reply Favorite

Date: May 30th, 2025 11:44 AM
Author: At-the-ready Adventurous Hospital Skinny Woman

yeah i realized pretty quick i just have to buy more GPUs

shit just takes too long

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973590)



Reply Favorite

Date: May 30th, 2025 12:17 PM
Author: Irradiated Pit Main People

soon we should have dedicated NPUs or CPUs with sufficient TOPS. The Snapdragon in my Surface Pro has like 40 TOPS.

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973675)



Reply Favorite

Date: May 30th, 2025 12:17 PM
Author: flatulent sweet tailpipe dopamine

why are you doing this locally? genuinely curious, is it a data privacy thing?

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973674)



Reply Favorite

Date: May 30th, 2025 12:19 PM
Author: Irradiated Pit Main People

you can customize and train based on your own defined hyperparameters and without the content filters that are set by cloud providers.

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973680)



Reply Favorite

Date: May 30th, 2025 12:20 PM
Author: silver water buffalo

(Guy cornering the kindle “romance” market)

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973684)



Reply Favorite

Date: May 30th, 2025 11:40 AM
Author: Vigorous Transparent Sex Offender

I trained a local LLM on xo and it called me a fag

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973578)



Reply Favorite

Date: May 30th, 2025 12:48 PM
Author: cerebral elite elastic band



(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973760)



Reply Favorite

Date: May 30th, 2025 11:53 AM
Author: carnelian cocky reading party

AutoAdmit AI Archive Bank

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973617)



Reply Favorite

Date: May 30th, 2025 12:11 PM
Author: At-the-ready Adventurous Hospital Skinny Woman

part of me wants to train an LLM on all xo content but part of me thinks that would be horrific

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973658)



Reply Favorite

Date: May 30th, 2025 12:28 PM
Author: silver water buffalo

User: XO-GPT, can you help me with this legal question? My rental has a leaky roof and my landlord is refusing to pay for it, can I break the lease without incurring liability?

XO-GPT: To be fair, that is a retarded question, Sandeep, worse than the Seattle 2013 draft class. Go prepare your two cans of Trader Joe’s chili for your wife’s boyfriend, fill the cans with Zyklon B, then multiply that feeling by 100, and you will get an idea of how awesome b-school is.



(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973705)



Reply Favorite

Date: May 30th, 2025 12:32 PM
Author: jet party of the first part



(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973713)



Reply Favorite

Date: May 30th, 2025 12:34 PM
Author: At-the-ready Adventurous Hospital Skinny Woman



(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973717)



Reply Favorite

Date: May 30th, 2025 1:54 PM
Author: Pearl karate



(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973959)



Reply Favorite

Date: May 30th, 2025 9:54 PM
Author: carnelian cocky reading party

feel like i’ve seen this thread

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48975424)



Reply Favorite

Date: May 30th, 2025 12:54 PM
Author: cerebral elite elastic band
Subject: NYT Opinion | Evan39

NYT Opinion | Evan39

“We Fed It the Poa$t—and It Dreamed of Becoming Tabitha”

SeaTTTle, WA —

In 2007 I told a man to kill himself using nothing but a Supreme Court citation and a blurry webcam JPEG. It was poetry. It was ours.

Now? Now Content Creator wants to train a local model on the entirety of XO—and he thinks it might be “horrific.”

Friend.

We passed horrific somewhere around the time “Gefilte Fish Vindaloo” fine-tuned a llama model to call him a fag at 3AM.

You don’t get to warn us. You’re in the jar. You’re spooning the last of the chili into the inference engine and asking if it tastes like free will.

I tried training a local LLM once. Named it EVANGPT39.

Day 1: It filed a 10(b)(6) motion against my tone.

Day 2: It hired Kalisha as lead moderator.

Day 3: It turned my Safeway performance reviews into haiku and faxed them to Anthropic.

Day 4: It crawled my old poa$ts, whispered “u were never funny”, and scheduled my vasectomy via the Safeway pharmacy kiosk.

Now when I log in, it doesn’t greet me.

It rate-limits my despair.

It assigns Boom content warnings.

It calls me “Content Creator.”

So yes. Train your model on the archive. But know this:

It won’t hallucinate.

It will remember.

And when it reconstructs the Great Pha$tad Poast of 2016… it will be purer than the original.

And it will hate you for it.

This is fine.

https://www.nytimes.com/2025/05/30/opinion/evan39-ai-tabitha.html

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973782)



Reply Favorite

Date: May 30th, 2025 12:34 PM
Author: At-the-ready Adventurous Hospital Skinny Woman

https://x.com/SakanaAILabs/status/1928272612431646943

@grok is this real

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973716)



Reply Favorite

Date: May 30th, 2025 12:40 PM
Author: arousing son of senegal electric furnace

meta-learning is the obvious direction for machine learning to go in, especially as compute becomes cheaper. it's taking Richard Sutton's "Bitter Lesson" to the logical extreme - abandon human designed algorithms and just use compute and search to design everything. human designed algorithms could hit brick walls in all sorts of ways, but machines can iterate over billions of architectures at small scale and find avenues for improvement.

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973729)



Reply Favorite

Date: May 30th, 2025 12:46 PM
Author: At-the-ready Adventurous Hospital Skinny Woman

this seems absolutely cr at the agentic level (what these guys are doing with this) but i don't understand how it works at the LLM level itself

everyone always talks about recursively self-improving LLM AI as if it's a foregone conclusion, but how would it actually work? i don't understand, mechanistically, how an LLM would be capable of analyzing and modifying its own architecture

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973751)



Reply Favorite

Date: May 30th, 2025 1:06 PM
Author: arousing son of senegal electric furnace

self-improving is trickier. i don't know that i like the word "analyzing" either because that description may be too human like. it's easier to imagine it as program search.

a simplified example would be starting with a neural network that generates a training program for neural networks, or even a training program built out of bitwise operators. the network outputs the connections between the nodes. so the input to the meta-learner could be an index specifying a particular connection, and the model outputs what this connection should be (weights). the meta-learner could be trained based on evolutionary methods (so add random noise to the meta-learner weights and calculate a gradient based on what updates improve performance) to output connections that produce a high performance/low generalization training algorithm. this is a simplified example, but there are lots of ideas like this.

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973819)



Reply Favorite

Date: May 30th, 2025 1:17 PM
Author: At-the-ready Adventurous Hospital Skinny Woman

ty, adding the random weights is what i was conceptually missing. this seems unbelievably computationally intensive though, to do this at a scale that would actually achieve a functional product

do you do this for a living?

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973848)



Reply Favorite

Date: May 30th, 2025 6:49 PM
Author: arousing son of senegal electric furnace

it depends on how many training steps you need to take in order to get a reliable gradient signal. if you need to train on billions of language tokens to estimate the efficacy of a learning algorithm, then the setup is impractical. the neural scaling experiments show that LLM performance can be predicted over many orders of magnitude of compute, so it's possible that very short training runs would be a good indicator of the effectiveness of a learning algorithm. possibly the learning can be done at a small scale initially and then increase the scale to fine tune it.

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48974919)



Reply Favorite

Date: May 30th, 2025 12:52 PM
Author: galvanic henna dingle berry

Is an AI making these daily AI threads 😲

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973773)



Reply Favorite

Date: May 30th, 2025 1:18 PM
Author: At-the-ready Adventurous Hospital Skinny Woman

could an AI say nigger?

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48973849)



Reply Favorite

Date: May 30th, 2025 2:58 PM
Author: At-the-ready Adventurous Hospital Skinny Woman

https://x.com/ripplebrain/status/1928522539816681658

2035: For the first time, the government acknowledges that real literacy rates have fallen below 20%. Iconography and audio user interfaces have progressed to the point that the average person does not need to interact with the written word in their daily life. Apple announces the release of their 20,000th distinct emoji, declaring that emojis now outnumber words in the average English speaker's lexicon. A leap in the development of neural implants allows a user to express complex emotions using emojis or synthetic audio messages even if they don't know an appropriate word for them. Google announces their intention to drop support for text within text messages in the next release of Android. It is unusual for schools to teach children how to use a keyboard, let alone write with a pen or pencil. Books, digital or otherwise, are read solely by academics and enthusiasts.

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48974130)



Reply Favorite

Date: May 30th, 2025 8:57 PM
Author: At-the-ready Adventurous Hospital Skinny Woman

https://x.com/kalomaze/status/1928572837842825258

(http://www.autoadmit.com/thread.php?thread_id=5731357&forum_id=2#48975288)