pavnilschanda@lemmy.world to Technology@lemmy.worldEnglish · 11 months agoLLMs are surprisingly great at compressing images and audio, DeepMind researchers findventurebeat.comexternal-linkmessage-square12fedilinkarrow-up1102arrow-down15
arrow-up197arrow-down1external-linkLLMs are surprisingly great at compressing images and audio, DeepMind researchers findventurebeat.compavnilschanda@lemmy.world to Technology@lemmy.worldEnglish · 11 months agomessage-square12fedilink
minus-squareNaibofTabr@infosec.publinkfedilinkEnglisharrow-up9·11 months agoDo you need the dataset to do the compression? Is the trained model not effective on its own?
minus-squareTibert@compuverse.uklinkfedilinkEnglisharrow-up13·11 months agoWell from the article a dataset is required, but not always the heavier one. Tho it doesn’t solve the speed issue, where the llm will take a lot more time to do the compression. gzip can compress 1GB of text in less than a minute on a CPU, an LLM with 3.2 million parameters requires an hour to compress
Do you need the dataset to do the compression? Is the trained model not effective on its own?
Well from the article a dataset is required, but not always the heavier one.
Tho it doesn’t solve the speed issue, where the llm will take a lot more time to do the compression.
deleted by creator