Comment on Even Apple finally admits that 8GB RAM isn't enough

ssebastianoo@programming.dev ⁨4⁩ ⁨months⁩ ago

• sverit@lemmy.ml ⁨4⁩ ⁨months⁩ ago

  Which model with how many parameters du you use in ollama? With 8GB you should only be able to use the smallest models, which ist faaaar from ideal:

  You should have at least 8 GB of RAM available to run the 7B models, 16 GB to run the 13B models, and 32 GB to run the 33B models.

  source

  • ssebastianoo@programming.dev ⁨4⁩ ⁨months⁩ ago

    llama3:8b, I know it’s “far from ideal” but only really specific use cases require more advanced models to run locally, if you do software development, graphic design or video editing 8gb is enough

    source
• yournamehere@lemm.ee ⁨4⁩ ⁨months⁩ ago

  maybe in a browser using external resources. open some chrometabs to feel the pain. apple is a joke.

  source

  • ssebastianoo@programming.dev ⁨4⁩ ⁨months⁩ ago

    here you are

    vscode + photoshop + illustrator + discord + arc + chrome + screen recording and still no lag

    source

    • yournamehere@lemm.ee ⁨4⁩ ⁨months⁩ ago

      so not a single cool app and yet you own a computer

      source

      • ssebastianoo@programming.dev ⁨4⁩ ⁨months⁩ ago

        wtf does that mean

        source