Comment on Could you compress text files by mapping a word to how commonly it is used and translating it with an application?
kozel@lemmy.world 9 months ago
To get the data, search “frequency list (of English)”.
Computers are quick enough nowadays its better to just count how many of each word in a block, then use it as indices. Saves from having a dictionary the size of the English language for decompression
Sethayy@sh.itjust.works 9 months ago
Computers are quick enough nowadays its better to just count how many of each word in a block, then use it as indices. Saves from having a dictionary the size of the English language for decompression