Subj : AI could help turbocharge your SSDs effective storage by compress
To   : All
From : TechnologyDaily
Date : Fri Oct 13 2023 04:45:04

AI could help turbocharge your SSDs effective storage by compressing data 
even further  but just dont delete 7zip just yet

Date:
Fri, 13 Oct 2023 03:26:12 +0000

Description:
Researchers trained Chinchilla 70B to compress images and audio files far 
more effectively than conventional algorithms.

FULL STORY
======================================================================

DeepMind scientists have treated compression technology to a major upgrade 
thanks to a large language model (LLM) that has achieved astonishing lossless 
compression rates with image and audio data. 

Thanks to the companys Chinchilla 70B LLM, the researchers used a special 
compression algorithm to reduce images to 43.4% and audio files to 16.4% of 
their original sizes, as detailed in their paper - making it better than some 
of the best compression software out there. 

By contrast, standard image compression algorithm PNG reduces images to 58.5% 
and FLAC compressors shrink audio to 30.3% of their original file sizes. It 
means storing so much more on any one of the best SSDs . 

Although Chinchilla 70B is trained mainly on text, they achieved these 
results by leaning on the predictive capabilities of the model, and framed 
the prediction problem through the lens of file compression. In other words, 
they retooled the best qualities of an LLM and found these traits also serve 
to compress large files. AI is great at compression  up to a point 

The DeepMind researchers showed that due to this equivalence between 
prediction and compression, any compressor can be used as a conditional 
generative model  and even the other way around. 

But, they added, they can only achieve such compression results up to a 
certain file size, meaning using generative AI as a compression solution may 
not be practical for everyone. 

We evaluated large pretrained models used as compressors against various 
standard compressors, and showed they are competitive not only on text but 
also on modalities they have never been trained on, the researchers noted. 

We showed that the compression viewpoint provides novel insights on scaling 
laws since it takes the model size into account, unlike the log-loss 
objective, which is standard in current language modeling research. 

Due to this scaling limitation, the models used in this research arent better 
than, say, the likes of 7zip when youre looking at files above a certain 
threshold. They may not compress as impressively as the results show, and 
they may also not be as fast as conventional compression algorithms. More 
from TechRadar Pro We've rounded up the best AI tools you can try today Check 
out the best ways to send big files right now These are the best free WinZip 
alternatives out there



======================================================================
Link to news story:
https://www.techradar.com/pro/ai-could-help-turbocharge-your-ssds-effective-st
orage-by-compressing-data-even-further-but-just-dont-delete-7zip-just-yet


--- Mystic BBS v1.12 A47 (Linux/64)
 * Origin: tqwNet Technology News (1337:1/100)

.