Post AjMoOFrBvOZPdTtFmi by yogthos@mas.to
(DIR) More posts by yogthos@mas.to
(DIR) Post #AjMnNoynknZqK6gAiW by yogthos@mas.to
2024-06-27T20:15:55Z
0 likes, 0 repeats
The researchers have developed a new type of LLM that doesn't use matrix multiplication making it more efficient and less energy-intensive.The model uses ternary values and simpler arithmetic operations instead of matrix multiplication.Expensive self-attention mechanism is replaced with a simpler, more efficient unit called MLGRU.The new model has shown performance comparable to state-of-the-art models on several benchmark tasks.#machinelearninghttps://arstechnica.com/information-technology/2024/06/researchers-upend-ai-status-quo-by-eliminating-matrix-multiplication-in-llms/2/
(DIR) Post #AjMnNq97PvQLwOVvRA by fancysandwiches@urbanists.social
2024-06-27T21:27:34Z
0 likes, 0 repeats
@yogthos It may be less energy intensive, but that probably wont lead to less energy being used. Instead a system using this approach would probably just be thrown even more data in a hope to improve the models. Also, in order to really gain the benefit of this technique you need to use *different* hardware, FPGAs instead of GPUs, so operators would have to buy/build more hardware.
(DIR) Post #AjMnNrO2nuxPmyVMLA by yogthos@mas.to
2024-06-27T21:31:58Z
0 likes, 0 repeats
@fancysandwiches I mean they have benchmarked it against existing approaches which seems to show improvements, using FPGAs would further improve the efficiency here.
(DIR) Post #AjMnNs1kQIiTm754E4 by fancysandwiches@urbanists.social
2024-06-27T21:39:53Z
0 likes, 0 repeats
@yogthos Yes, and those improvements will lead to "excess capacity" which will just be filled. This won't lead to less resources being used.
(DIR) Post #AjMnNsgrxPbrpeJuK0 by yogthos@mas.to
2024-06-27T22:05:46Z
1 likes, 0 repeats
@fancysandwiches which is completely beside the point, waste of resource has nothing to do with improvements in technology, that's a social problem
(DIR) Post #AjMnR6kK9fD4IHTUTQ by adiz@soc0.outrnat.nl
2024-06-27T22:24:53.984Z
0 likes, 0 repeats
@yogthos@mas.to @fancysandwiches@urbanists.social making a technology more efficient and capable is never a bad thing.
(DIR) Post #AjMoNV9JaC8mm50Z0a by fancysandwiches@urbanists.social
2024-06-27T22:35:05Z
0 likes, 0 repeats
@adiz @yogthos LMAO, shit take
(DIR) Post #AjMoNWS8jgnEokp6zQ by adiz@soc0.outrnat.nl
2024-06-27T22:35:26.277Z
0 likes, 0 repeats
@fancysandwiches@urbanists.social my brother in Christ how so? @yogthos@mas.to
(DIR) Post #AjMoOFrBvOZPdTtFmi by yogthos@mas.to
2024-06-27T22:33:41Z
0 likes, 1 repeats
@adiz @fancysandwiches indeed, the problem is with how we apply technology, and the reason we abuse tech is due to the perverse incentives created by the capitalist system
(DIR) Post #AjMoSR3CFV4BViUzxI by yogthos@mas.to
2024-06-27T22:36:08Z
0 likes, 0 repeats
@adiz @fancysandwiches I can see how a python developer would have no capacity to appreciate efficiency 😂
(DIR) Post #AjMr2XrkaRMOyuUWpM by fancysandwiches@urbanists.social
2024-06-27T22:40:05Z
0 likes, 0 repeats
@adiz @yogthos A piece of technology created to destroy human lives or ruin the environment probably shouldn't be improved upon. So, yeah, pretty easy to think about a few cases where technology shouldn't be made more efficiently or capable, but go off king.
(DIR) Post #AjMr2ZFXRTyzGyd2Xo by adiz@soc0.outrnat.nl
2024-06-27T23:05:16.305Z
0 likes, 0 repeats
@fancysandwiches@urbanists.social I don't think AI was created with the ulterior motives you ascribe to it. @yogthos@mas.to
(DIR) Post #AjMr2aErlT2ULBK18S by fancysandwiches@urbanists.social
2024-06-27T22:40:57Z
0 likes, 0 repeats
@adiz @yogthos Here's a piece of technology that shouldn't have its algorithm improved, instead, it should be removed from existence: https://prospect.org/infrastructure/housing/2024-06-18-how-algorithm-turned-apartment-pools-green/
(DIR) Post #AjMr8Xyh5Dwz4AbKIS by adiz@soc0.outrnat.nl
2024-06-27T23:06:22.220Z
0 likes, 0 repeats
@fancysandwiches@urbanists.social We should just destroy computers and any writing or maths systems altogether because they will be misused. @yogthos@mas.to
(DIR) Post #AjMrB35oN0k4987hPU by yogthos@mas.to
2024-06-27T22:44:34Z
0 likes, 0 repeats
@fancysandwiches @adiz claiming that ML is created to destroy human lives is the height of idiocy.AI has plenty of legitimate applications when used in a sane society.For example, an AI system in Beijing is processing vast amounts of real-time data from across the country and can alert maintenance teams of abnormal situations within 40 minutes, with an accuracy as high as 95%.https://www.scmp.com/news/china/science/article/3255039/china-puts-trust-ai-maintain-largest-high-speed-rail-network-earth
(DIR) Post #AjMrrUPdBctF2UdB4q by fancysandwiches@urbanists.social
2024-06-27T23:13:50Z
0 likes, 0 repeats
@adiz @yogthos you made a blanket statement about technology, and I gave you an example of bad technology that shouldn't be improved. I didn't specifically mention AI. I'm sorry you don't have very good reading comprehension.
(DIR) Post #AjMrrVUdAWU2OHygVc by adiz@soc0.outrnat.nl
2024-06-27T23:14:28.589Z
0 likes, 0 repeats
@fancysandwiches@urbanists.social Why are you so aggressive? @yogthos@mas.to