donatas
@donatas@feddit.uk
This is a remote user, information on this page may be incomplete. View at Source ↗
- Comment on Some local LLMs tested on an average gaming PC 1 week ago:
128GB won’t make any difference in gaming when compared to, say, 32GB, so it’s just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.
- Comment on Some local LLMs tested on an average gaming PC 1 week ago:
Performance/vision based tests have tokens/s at the end of tables.
- Submitted 1 week ago to selfhosted@lemmy.world | 17 comments