yes! tinyllama is somewhere around 600MB. it’s hilariously inept. it’s like someone jpeg-compressed a robot.
Comment on Seems legit
khepri@lemmy.world 21 hours ago
Could you crunch an LLM into 700Mb that was still functional? Cause this looks like a fun thing to actually do as a joke.
lime@feddit.nu 19 hours ago
yellowbadbeast@lemmy.blahaj.zone 18 hours ago
Qwen3-0.6B is about 400 MB at Q4 and is surprisingly coherent for what it is.
khepri@lemmy.world 18 hours ago
That’s so crazy that an LLM capable of doing anything at all can be that small! That’s leaves room for like an entire .avi episode of family guy at dvd resolution on there, which is the natural choice for the remaining space of course
tetris11@feddit.uk 3 hours ago
a 4k episode of family guy using H265 (HEVC) and assuming not too many cutaway gags could produce a file about 240MB. You could probably fit a 480i episode of south park in the remaining 60MB
khepri@lemmy.world 17 hours ago
Wow, just popped it onto my very slow desktop and this little model rips haha. I really think tiny LLMs with a good LoRA on top are going to be a huge deal going forward