Comment on DeepSeek might not be such good news for energy after all
JohnDClay@sh.itjust.works 3 weeks ago
The original claims of energy efficiency came from mixing up the energy usage of their much smaller model with their big model I think.
Comment on DeepSeek might not be such good news for energy after all
JohnDClay@sh.itjust.works 3 weeks ago
The original claims of energy efficiency came from mixing up the energy usage of their much smaller model with their big model I think.
peanuts4life@lemmy.blahaj.zone 3 weeks ago
This article is comparing apples to oranges here. The deepseek R1 model is a mixture of experts, reasoning model with 600 billion parameters, and the meta model is a dense 70 billion parameter model without reasoning which preforms much worse.
They should be comparing deepseek to reasoning models such as openai’s O1. They are comparable with results, but O1 cost significantly more to run. It’s impossible to know how much energy it uses because it’s a closed source model and openai doesn’t publish that information, but they charge a lot for it on their API.
Tldr: It’s a bad faith comparison. Like comparing a train to a car and complaining about how much more diesel the train used on a 3 mile trip between stations.