Post AvwLBHoTr9epenqbY0 by Angle@anticapitalist.party
(DIR) More posts by Angle@anticapitalist.party
(DIR) Post #AvwLB98M7tCyjq4qmG by Angle@anticapitalist.party
2025-06-27T01:25:22Z
0 likes, 0 repeats
Aaaagh, AI is so weird! Like, minor differences in words can make a huge, huge, huge difference in performance! And I thought I was picky about word usage and prone to 'Well, acktually'ing people over it, but apparently not enough! It's bizarre. I'm starting to get a feel for it, though. :/
(DIR) Post #AvwLBALVcTK8UvEruy by Angle@anticapitalist.party
2025-06-27T23:31:41Z
0 likes, 0 repeats
Okay, tried a different system, found something much more reliable. Now have a fairly simple combination of technologies that's effectively a programmer slightly dumber than me but with vastly more experience - which overall, makes it a better programmer. And all this on my $2600 gaming PC. :/
(DIR) Post #AvwLBBaR0SrCLVEIoy by Angle@anticapitalist.party
2025-06-27T23:32:55Z
0 likes, 0 repeats
So, uh, what now? This is, like, apocalyptic, in terms of my job prospects, isn't it? I've spent 15+ years learning to code, and now a $2600 computer + anybody with a handful of technical brain cells can outperform me? I mean, sure, I can use the thing too, probably better than a lot of them, but still... :/
(DIR) Post #AvwLBCmAaJq22BjBke by Angle@anticapitalist.party
2025-06-27T23:34:17Z
0 likes, 0 repeats
Though I suppose that's missing the forest for the trees - the existing job market is the least of our worries. This going to completely reshape the economy. Like, technical expertise is going to get a thousand times cheaper overall... I have no idea what that does. Opens a lot of doors and wildly destabilizes existing structures, I guess? I dunno. It's terrifying. :X
(DIR) Post #AvwLBDSi29rkA7dA3c by Angle@anticapitalist.party
2025-06-27T23:35:11Z
0 likes, 0 repeats
On the other hand, one upside! I don't ever expect to be truly bored, in my entire life, ever again. XD
(DIR) Post #AvwLBESkJVUPGWehkm by Angle@anticapitalist.party
2025-06-27T23:38:56Z
0 likes, 0 repeats
I guess there are some positives - if there was a technical problem you had that you struggled to solve because of a lack of expertise, good news! That problem will probably go away. On the other hand, uh, this will also remove a lot of barriers between people and the dangerous toys you don't want them to have, potentially? I dunno. And again, if you were hoping things would get less interesting, like, at any point, too bad lol. XD
(DIR) Post #AvwLBFWgMMESZ1VMWm by Angle@anticapitalist.party
2025-06-27T23:53:14Z
0 likes, 0 repeats
Oh, and that's to say nothing of further developments in the field. If this is what I can do now, imagine what other people with more resources can do, or what will be possible later...?
(DIR) Post #AvwLBGVehf0Nc823ZA by Angle@anticapitalist.party
2025-07-08T21:29:31Z
0 likes, 0 repeats
Another note, running my local AI has caused me to indirectly learn a LOT about terminal commands, the linux filesystem, process management, test management, and all sorts of stuff. Like being able to sit and watch over the shoulder of another programmer who's not as smart as me, but *way*, *way* more experienced. And I've only been at it for a couple few weeks... :/
(DIR) Post #AvwLBH8eMgCHZ4HCLY by purple@nya.social
2025-07-08T21:44:43.040Z
1 likes, 1 repeats
@Angle@anticapitalist.party i'm an admin with > 20 years experience. the stuff AI puts out, and i'm talking o4-mini-high, their best tool for the job, is more like me as a teenager going through books that were already out of date and seeing what worked. it's extremely fever-dreamy. i use it a few times a week to do dull shit like "make a minimal bash script iterate over all aws efs shares and apply these security groups to each mount" which is one of those tasks with aws that is both recursive AND painful.but the ai doesn't know that you can't add security groups. you can only "update" them.my job is safe, for now.
(DIR) Post #AvwLBHoTr9epenqbY0 by Angle@anticapitalist.party
2025-07-08T22:01:10Z
0 likes, 0 repeats
@purple I'm using Unsloths version of Devstral Q8_0, via LM Studio and Cline, and it's... Okay? Like, imagine someone who's genuinely a fair bit dumber than average, and not much good at anything besides coding... But has spent, like, 1000 years coding, and has gone through and used an inconceivably vast quantity of different tools and libraries. So, useful mainly for the stuff it knows, and less for its ability to apply it, but still quite useful.
(DIR) Post #AvwLBIg0e8TYKotLyy by Angle@anticapitalist.party
2025-07-08T22:01:55Z
0 likes, 0 repeats
@purple I've never used any of the GPTs much, so I can't compare it, but if you have the hardware (~20GB VRAM) I'd definitely say give Devstral a shot and see how it works for you. :/
(DIR) Post #AvwLBJuw280cBOsmsy by Angle@anticapitalist.party
2025-07-08T22:10:40Z
0 likes, 0 repeats
@purple Also note, from what I've heard OpenAI actually takes care to make sure that nothing they offer is particularly powerful - they don't turn a profit off of the models they make available and don't ever plan to, they just offer them so they can gather data on how they perform and use that to build bigger and better models. So, if you want to actually get your hands on something powerful and suited for your use case, you need to look elsewhere. :/
(DIR) Post #AvwLBKuyJTdHHnuKa8 by purple@nya.social
2025-07-08T22:29:55.529Z
0 likes, 0 repeats
@Angle@anticapitalist.party correct, they (supposedly) make tools to be used by other tools, which is how we're doing it. the company i contract with is the "elsewhere" you mention, although that is currently only because it's the cheapest way to get a specific vector product our tools need (embeddings -- base level stuff that is hard to run at-scale in somebody else's cloud cheaply). i'd be better off using claude ($) or a local MoE model like you mention.as for devstral, despite my best efforts i can't find the time to get stuff going on GPUs here at the house. i'm a fan of Mixtral, but i can only run stuff on CPUs at home so i don't use it for work where it's genuinely faster for me to code the dang script myself than it is to wait on some 8 year old AMDs i got kicking around.
(DIR) Post #AvwLBLtag67cJoGk4G by Angle@anticapitalist.party
2025-07-08T22:31:17Z
0 likes, 0 repeats
@purple Just use LM Studio? Should be a matter of minutes to get it set up and running, if you're got the hardware. Well, I guess you'll need to download the models, but that can be done quite comfortably in the background. :/
(DIR) Post #AvwLBMhZgG6Wopeeye by purple@nya.social
2025-07-09T00:21:29.891Z
1 likes, 0 repeats
@Angle@anticapitalist.party hahahahahahahahaif only it were that easy. you won't get much of anywhere by connecting LLMs to each other.