Comment on ELI5 How does chatgpt do its shit?
It’s that why is compute heavy ?
Correct, and the massive databases of long-length context associations are why you need tens to hundreds of gigabytes worth of ram/vram. Disk would be too slow
Dran_Arcana@lemmy.world 5 months ago
Correct, and the massive databases of long-length context associations are why you need tens to hundreds of gigabytes worth of ram/vram. Disk would be too slow