The most prestigious law school admissions discussion board in the world.
|
 |
 
|
So can any of you NERDS explain how you "train" a local AI? You just buy expensi
| scarlet arousing spot international law enforcement agency | 02/21/26 |
| Ocher Abusive Associate | 02/21/26 |
| Umber free-loading state | 02/21/26 |
| scarlet arousing spot international law enforcement agency | 02/22/26 |
| floppy mediation | 02/22/26 |
| scarlet arousing spot international law enforcement agency | 02/22/26 |
| floppy mediation | 02/22/26 |
| scarlet arousing spot international law enforcement agency | 02/22/26 |
| curious dopamine | 02/21/26 |
| Ocher Abusive Associate | 02/21/26 |
| razzmatazz yarmulke pit | 02/22/26 |
| scarlet arousing spot international law enforcement agency | 02/22/26 |
| razzmatazz yarmulke pit | 02/22/26 |
| cr friend | 02/25/26 |
| Clique ancien regime | 02/25/26 |
Poast new message in this thread
Date: February 21st, 2026 10:07 PM Author: scarlet arousing spot international law enforcement agency Expensive ass graphics card and then what? Download some shit and it starts training AI? (http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2),#49685993) |
Date: February 21st, 2026 10:20 PM Author: Ocher Abusive Associate no its more complicated than that. you don't do full training yourself at this point. like pre-training + training across billions of tokens from scratch. that's something frontier labs do it takes distributed training tons of gpu hours millions of dollars. you can train your own small models. but most of what peole do today is fine-tune big models. I wouldn't do the training locally either. Those GPUs aren't optimized for that you use a cloud server gpu, you pay for the VM, deploy it and they charge you per hour when its running. Train it on the cloud then basically you extract the base model directory + weights to your local system. Depends how big and complex the system is whether your local computer can run it. I don't know as much about that part I have never ran anything directly on a local machine. I can tell you how to set up cloud servers, how set up a cli runner on it that plugs in to hugging face transformers etc, but I don't know exactly how to import it locally it would take actual experimentation for me to figure it out (http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2),#49686010) |
 |
Date: February 21st, 2026 11:04 PM Author: Umber free-loading state (http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2),#49686073) |
|
Date: February 22nd, 2026 1:27 AM Author: scarlet arousing spot international law enforcement agency And do what with it (http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2),#49686201) |
|
Date: February 22nd, 2026 1:30 AM Author: floppy mediation There are a lot of reasons people need a local llm (but used in parallel with cloud AI for reasoning)
Do you think the guy who is working on the next Coke product or designing the next iPhone is chatting with Claude or using MPCs? Now imagine an enterprise org with millions of people's SSN/DOB and ACH info |
|
Date: February 22nd, 2026 1:31 AM Author: scarlet arousing spot international law enforcement agency Ok I'm imagining. Now what (http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2),#49686208) |
|
Date: February 22nd, 2026 1:32 AM Author: floppy mediation Start using Claude and ask the same questions you're asking here (http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2),#49686211) |
|
Date: February 22nd, 2026 1:33 AM Author: scarlet arousing spot international law enforcement agency No (http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2),#49686213) |
|
Date: February 21st, 2026 10:20 PM Author: curious dopamine Use Axolotl for training. Train a qlora in 8bit and let your dataset be formatted as plaintext, you also need to establish a format (http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2),#49686012) |
|
Date: February 21st, 2026 10:31 PM Author: Ocher Abusive Associate I have never used that. Isn't it supposed to be config file based controls, no need to write a runner file w python, torch etc? Is it good? Or are there limitations? (http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2),#49686022) |
|
Date: February 22nd, 2026 1:33 AM Author: razzmatazz yarmulke pit Yeah I think that's where you get Bitcoin too (http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2),#49686212) |
|
Date: February 22nd, 2026 1:34 AM Author: scarlet arousing spot international law enforcement agency You'd think AI would be DEVVING thousands of entirely new groundbreaking L1 block chains every day. But no one is doing this. They're focusing on personal assistant agents (http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2),#49686215) |
|
Date: February 22nd, 2026 1:37 AM Author: razzmatazz yarmulke pit Not flame, the ban on porn usage is a dumb artificial throttle. If you want true innovation you need to have cumming as an end goal. (http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2),#49686219) |
|
Date: February 25th, 2026 2:59 PM Author: cr friend (http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2),#49694728) |
|
Date: February 25th, 2026 3:00 PM Author: Clique ancien regime (http://www.autoadmit.com/thread.php?thread_id=5837098&forum_id=2),#49694732) |