Posts by mnl@hachyderm.io
(DIR) Post #AdQ5xsEiwi8pT0DUO0 by mnl@hachyderm.io
2024-01-01T22:19:22Z
0 likes, 0 repeats
@freakazoid @screwtape If it was easy to make things less tedious I would have done so, this is kind of a circular discussion I feel. And the things I have done to make my work less tedious I do indeed not need an LLM for.I currently mostly use GPT-4, I send everything I'm doing to github and others already. I'm pretty sure local models will work plenty well, if they aren't already.
(DIR) Post #AdQ5xt0w3ShpsWlzX6 by mnl@hachyderm.io
2024-01-01T22:19:22Z
0 likes, 0 repeats
@freakazoid @screwtape I haven't built a "natural language to working e-commerce system" with conventional means because that's kind of impossible. I haven't built a "formal language to working e-commerce system" because that's almost just as hard and mostly pointless, since I don't know what features it would need (should I support postgres? firebase? deploy on AWS? and GCP? and local? and work with PHP templates? and import wordpress? and integrate with shopify?)
(DIR) Post #AdQ5xtpyzfXUQqel6G by mnl@hachyderm.io
2024-01-01T22:19:22Z
0 likes, 0 repeats
@freakazoid @screwtape But it's actually doable with today's LLMs and a modicum (one person's? small team's?) of work, from scratch. Once we build better tools, languages, conventions and patterns around it, these things will shrink in cost and effort even further.
(DIR) Post #AdQ5xvLDP27H60HDQ8 by mnl@hachyderm.io
2024-01-01T22:29:21Z
0 likes, 0 repeats
@freakazoid @screwtape not sure what you mean? how can you do vendor lock-in when the API is legit "string" -> "string"? There's plenty of "opensource" models out there and I don't see that stopping, and new methods of low-cost training or finetuning are being published by the day. I'm also reasonably sure that mixtral does most of what I need an LLM to do, in its simple untuned instruct version.That said I'm not very knowledgeable about the tech itself.
(DIR) Post #AdQ5xwrVkRXnoSOWOm by mnl@hachyderm.io
2024-01-01T22:36:20Z
0 likes, 0 repeats
@freakazoid @screwtape Indeed I hope that opensource models (or academia funded whatever) become good enough that there is no need to rely on vendors. This is for the narrow field of glueing stuff together, I'm sure the bigger companies will find something to keep themselves busy. I don't care very much.As for language development, I don't know. Does it matter? Not to me really, I'm more interested in building systems and products and making silicon do things.
(DIR) Post #AdQ5xxoMDecEkxvW7c by mnl@hachyderm.io
2024-01-01T22:36:20Z
0 likes, 0 repeats
@freakazoid @screwtape If the need for most programming is eliminated, doesn't that solve your problem?
(DIR) Post #AdQ5xzJad1C1Q7XyRU by mnl@hachyderm.io
2024-01-01T22:42:42Z
0 likes, 0 repeats
@freakazoid @screwtape But if no one needs to look at what goes on behind the scenes, then do we care? I usually don't care about all the little machine instructions that the CPU actually runs when it runs my program. Likewise, if most programming is done by LLMs generating whatever LLMs generate to make things work, and a few specialists know how to make that better, then does it really matter?
(DIR) Post #AdQ5y09hVGsQ1jvafQ by mnl@hachyderm.io
2024-01-01T22:42:42Z
0 likes, 0 repeats
@freakazoid @screwtape Or maybe more aptly, do I care about the software that squarespace runs when I make a website? No, I'm just building a webpage. Do I care about how mp3 and streaming and what not works when I listen to a song on spotify? No, I just listen to a song on spotify.Do I care about what the machines do when I ask them to build me an app to feed my cat? No, I'm just building an app to feed my cat.
(DIR) Post #AdQ5y1ZGFiuuPItW9A by mnl@hachyderm.io
2024-01-01T22:48:49Z
0 likes, 0 repeats
@freakazoid @screwtape What would you suggest to make a website? I'm fine paying someone who makes it super easy to make a website and takes care of all the junk a couple of dollars per month, imo they earned it. I personally have my blog on bearblog because I enjoy not having the hassle, and I am perfectly happy giving them $9 per month for it.
(DIR) Post #AdQ5y2SuunR7Buvxtg by mnl@hachyderm.io
2024-01-01T22:48:49Z
0 likes, 0 repeats
@freakazoid @screwtape What's the alternative? hosting a server at home (since paying AWS would be monetizing?), taking care of backups, connectivity, bandwidth, DDOS protection, graphic design, a UI for administration and metrics and logs?
(DIR) Post #AdQ5y4OjjJHTBWzeeu by mnl@hachyderm.io
2024-01-01T22:57:13Z
0 likes, 0 repeats
@freakazoid @screwtape or I can just pay someone $5 and have a website right now, and so can my mom for that matter. A website that is way more reliable and feature rich than anything I'd ever built. I'm not going back to hosting my webpage like in the nineties.
(DIR) Post #AdQ5y5sYDwivmHwylk by mnl@hachyderm.io
2024-01-01T23:01:20Z
0 likes, 0 repeats
@freakazoid @screwtape I can imagine many different ways, but I live in a society, and I can also move my webpage to another provider if those things happen. But the thing is that my mom will not be able to do any of those things without paying someone $5, and if in the future people will be able to build the app of their dreams by paying someone $5, and noone ever sees the code behind that app, that's a pretty interesting future to me.
(DIR) Post #AdRLwHeBI9bm7cLbw8 by mnl@hachyderm.io
2024-01-02T14:25:52Z
0 likes, 0 repeats
@freakazoid @iska @screwtape @lispi314 the thing I might not even worth bringing up, but “human language as the main language” means that my programming today mostly happens on paper. I have always done this (more visually, before llms), but this is where the actual work happens. This wouldn’t be possible without llms, as I’d be much more chained to my editor to get stuff done. I can go through 3-4 pages a day this way, yet still manage my usual quota of 20-30 commits.
(DIR) Post #AdRMrqkHTA7nU3eNRg by mnl@hachyderm.io
2024-01-02T15:58:56Z
0 likes, 0 repeats
@iska @freakazoid @screwtape @lispi314 i suspect that it's hard to build...
(DIR) Post #AdhVFbMhQjwBAtocGe by mnl@hachyderm.io
2024-01-10T10:35:44Z
0 likes, 0 repeats
@sofia yes. Calling for a lock down of training data based on copyright law would be a terrible thing for opensource models, imo. There's also a lot of research that goes into generated datasets and just curating leads to much better training results.
(DIR) Post #AdhVFdM424cLLVX8YS by mnl@hachyderm.io
2024-01-10T10:38:07Z
0 likes, 0 repeats
@sofia like i'm perfectly fine ethically with training my own model on the entirety of all papers in libgen... As long as I don't create the "replace a scientist machine". And while I take openai's stance with a pretty big grain of salt, they aren't (compared to midjourney, say), pushing for the "let's replace people" model, and provide tools to remove your self from the training corpus. FWIW, lip service does a fair amount here and is not in the headlines.
(DIR) Post #AdhVFezRx7iUPwy6aG by mnl@hachyderm.io
2024-01-10T10:39:47Z
1 likes, 0 repeats
@sofia i'm really taken aback by the copyright stan-isation of the countercultural debate here, as if the nytimes was a defender of the rights of individual journalists. No, if they were to train their own model on their journalists output they would go ahead, just like adobe and shutterstock and co.openai paying nytimes licensing fees won't change anything for the better.
(DIR) Post #AdhW10ZlVzguyVX3AW by mnl@hachyderm.io
2024-01-10T10:59:23Z
0 likes, 0 repeats
@lain @sofia yeah i meant more like "let's fire research assistants and replace them with AI". Maybe not the best analogy here.
(DIR) Post #AdhW11PWPZ5jZ1kNqC by mnl@hachyderm.io
2024-01-10T11:00:49Z
0 likes, 0 repeats
@lain @sofia So much of the use-cases really depend on the context. For example, I build many "automate this job entirely", say, writing SEO titles. Because I work for a family business, that means that Joe can now, instead of grinding through 5000 SEO titles, do more product photography. But, I could also build "fire all content writers" machine, with the same prompt.
(DIR) Post #AdhWLPYmKnXiFlncky by mnl@hachyderm.io
2024-01-10T11:06:11Z
0 likes, 0 repeats
@lain @sofia what about selling people on the concept that the machine could do it better, when it kind of can't? Or if it was the case that a human + the machine could do way better.