Comment on Selfhosted & AI
nullpotential@lemmy.dbzer0.com 2 days ago It is not ‘just a tool.’ It is not “great.” Too many people focus on how it is used and not how it is created, how it affects us, and how it affects the world.
nullpotential@lemmy.dbzer0.com 2 days ago
curbstickle@anarchist.nexus 2 days ago
I’m just going to shortcut this and say two things:
I can guarantee the overwhelming majority (if not all) of your issues have nothing to actually do with LLMs and everything to do with corporations. Power use, data center buildouts, market impact, whatever - none it is an an llm problem. LLMs are just another piece of software, thats all.
Your personal opinion on this, as well as mine, does not change the overall conversation here. So how about we just stick to the topic at hand?
midribbon_action@lemmy.blahaj.zone 1 day ago
LLMs are inextricably tied to nvidia gpus. Local or cloud, the technology exists to help the shovel salespeople. The gold diggers, everyone this tag is supposed to segregate, have been misled by corporations. Without their lies, and a pliant media, this tag would be unnecessary, and llms would be rolled out in a more limited and responsible way. To promote different uses of gold during a gold rush is going to inflate the bubble and enrich the rich, unless it is properly contextualized. Technology does not exist in a void, pretending it does digs us a deeper hole.
curbstickle@anarchist.nexus 23 hours ago
I run my local models on a Mac mini m2, but I could also be using AMD (ROCm), Intel with OpenVINO, or just CPU. Simple edge applications I could even use something like an RK3588.
Being tied to NVidia is marketing from NVidia, not the reality of LLMs.
midribbon_action@lemmy.blahaj.zone 23 hours ago
Congrats, you are in the 1%. And that is exactly the type of additional context I think is necessary when discussing it.