I’ve really been mulling one of those over with 128GB. I’m on Claude Max and Cerebras $50 so I’m using a good amount of $200/mo for coding and Openclaw. Is it worth it for light coding, or are you only doing SD with it?
It would not be worth it as a replacement for Claude.
80% of my issue is that it’s AMD and their drivers are still awful. 20% is that the token generation speed very slow, especially compared to commercial models running on dedicated hardware. MOE models are fine, dense models are too slow for meaningful workflows. ComfyUI is decent, but I’m not seriously into image gen.
I have a lot of fun with it, but I have not been able to use it for any actual AI dev.
I use it as a server and it’s very very fast, especially threaded workflows, and IO is fast.
Just don’t buy it expecting to replace paid AI services. And don’t buy it for AI dev, on paper it should be good, but driver issues. DGX Spark is better if yo want an AI dev machine.
ikidd@lemmy.world 2 months ago
I’ve really been mulling one of those over with 128GB. I’m on Claude Max and Cerebras $50 so I’m using a good amount of $200/mo for coding and Openclaw. Is it worth it for light coding, or are you only doing SD with it?
panda_abyss@lemmy.ca 2 months ago
It would not be worth it as a replacement for Claude.
80% of my issue is that it’s AMD and their drivers are still awful. 20% is that the token generation speed very slow, especially compared to commercial models running on dedicated hardware. MOE models are fine, dense models are too slow for meaningful workflows. ComfyUI is decent, but I’m not seriously into image gen.
I have a lot of fun with it, but I have not been able to use it for any actual AI dev.
ikidd@lemmy.world 2 months ago
Thanks for the feedback. That was precisely my worry about outlaying that money and not being happy with the result.
panda_abyss@lemmy.ca 2 months ago
It’s still a fantastic computer.
I use it as a server and it’s very very fast, especially threaded workflows, and IO is fast.
Just don’t buy it expecting to replace paid AI services. And don’t buy it for AI dev, on paper it should be good, but driver issues. DGX Spark is better if yo want an AI dev machine.