Comment on [deleted]
Naz@sh.itjust.works 3 weeks agoIf you are using CPU only, you need to look at very small models or the 2-bit quants.
Everything will be extremely slow otherwise.
Comment on [deleted]
Naz@sh.itjust.works 3 weeks agoIf you are using CPU only, you need to look at very small models or the 2-bit quants.
Everything will be extremely slow otherwise.
fishynoob@infosec.pub 3 weeks ago
Yeah I’m not going to run them on CPUs, that’s not going to be very good. I’ll buy the GPUs when I can.