rubikcuber

@rubikcuber@programming.dev

• ⁨Comment⁩ on ⁨Humble Choice October 2023 Review - A spooky month⁩ ⁨⁨1⁩ ⁨year⁩ ago⁩:

  I really enjoyed The Quarry. Although I killed pretty much everyone.

• ⁨Comment⁩ on ⁨LLMs are surprisingly great at compressing images and audio, DeepMind researchers find⁩ ⁨⁨1⁩ ⁨year⁩ ago⁩:

  The research specifically looked at lossless algorithms, so gzip

  “For example, the 70-billion parameter Chinchilla model impressively compressed data to 8.3% of its original size, significantly outperforming gzip and LZMA2, which managed 32.3% and 23% respectively.”

  However they do say that it’s not especially practical at the moment, given that gzip is a tiny executable compared to the many gigabytes of the LLM’s dataset.