Post ATxLaMhOSKfyAoFpsu by jzakotnik@mastodon.social
(DIR) More posts by jzakotnik@mastodon.social
(DIR) Post #ATxE5IX9C1p0bBhVke by tante@tldr.nettime.org
2023-03-24T11:01:23Z
0 likes, 0 repeats
"SparseGPT: Remove 100 Billion Parameters for Free" This is very relevant. LLMs are bloated for a bunch of reasons making inference that more wasteful.https://neuralmagic.com/blog/sparsegpt-remove-100-billion-parameters-for-free/
(DIR) Post #ATxE5KVRrJeQiUvBNg by tante@tldr.nettime.org
2023-03-24T11:02:19Z
0 likes, 0 repeats
These models are bloated because a) big corporations have an advantage if running them is only accessible through themb) OpenAI believes that they'll find their machine god in more parameters
(DIR) Post #ATxEI1kCvW4wIAsa9I by Quisley@mastodon.social
2023-03-24T11:05:38Z
0 likes, 0 repeats
@tante someone please make them reread the last sentence of the nine billion names of god
(DIR) Post #ATxGOoipwOCxq9bUK8 by tante@tldr.nettime.org
2023-03-24T11:30:33Z
0 likes, 0 repeats
I can't stress this enough btw. OpenAI is not yet another tech startup. They are a quasi religious cult with a side business.
(DIR) Post #ATxI69lTgFvVVc4Jfc by fasterandworse@hci.social
2023-03-24T11:47:56Z
0 likes, 0 repeats
@tante chatGPT et al are *products*
(DIR) Post #ATxITsosKlgdu7yIgy by jzakotnik@mastodon.social
2023-03-24T11:53:41Z
0 likes, 0 repeats
@tante Out of curiosity, what is the "cult" about openAI? Seems like any other commercial company to me and yes, chatGPT is a bit hyped at the moment, but I doubt that outside of the tech bubble people even know what the company behind it is.
(DIR) Post #ATxImRsCkBFnplNiBE by tante@tldr.nettime.org
2023-03-24T11:54:38Z
0 likes, 0 repeats
@jzakotnik they were literally founded to build AGI because if anyone else would build it it would kill us all.
(DIR) Post #ATxLaMhOSKfyAoFpsu by jzakotnik@mastodon.social
2023-03-24T12:27:10Z
0 likes, 0 repeats
@tante yeah, it's sad that they have open in their name but nothing is open about them. Nevertheless I didn't know they were cult-like. Just another capitalist company trying to deliver products with exaggerated marketing.