Comment on Spread Your Wings: Falcon 180B is here

<- View Parent
BadRS@lemmy.world ⁨1⁩ ⁨year⁩ ago

The model is the brain, you use something like Kobold.cpp to load the model. You’ll have to work with the settings and try different models to get the right load on your GPU.

source
Sort:hotnewtop