mlflexer

@mlflexer@lemm.ee

• ⁨Comment⁩ on ⁨Consumer GPUs to run LLMs⁩ ⁨⁨1⁩ ⁨week⁩ ago⁩:

  It all depends on the size of the model you are running, if it cannot fit in GPU memory, then it has to go back and forth with the host (cpu memory or even disk) and the GPU. This is extremely slow. This is why some people are running LLMs on macs, as they can have a large amount of memory shared between the GPU and CPU, making it viable to fit some larger models in memory.

• ⁨Comment⁩ on ⁨- Buy Once Software⁩ ⁨⁨1⁩ ⁨week⁩ ago⁩:

  Thanks for sharing, I find it hard to discover new “lemmy spaces”??? On here

• ⁨Comment⁩ on ⁨Self-hosting minecraft⁩ ⁨⁨5⁩ ⁨weeks⁩ ago⁩:

  You should only need to have Java and then download the server and open the port if they want to play vanilla mc. If they want modded then idk.

  You might also want to check this out, haven’t used it myself but it looks cool if you don’t like wasting server resources: github.com/timvisee/lazymc