Comment

Comment on Microsoft CTO Kevin Scott thinks LLM “scaling laws” will hold despite criticism

Alphane_Moon@lemmy.world ⁨4⁩ ⁨months⁩ ago

Microsoft CTO Kevin Scott is of course not a reliable source due to conflict of interest and his position in the US corporate world.

If anything, the fact that he is doing damage control PR around “LLM scaling laws” suggests something is amiss. Let’s see how things develop.

source

Sort:hotnew top

ItsComplicated@sh.itjust.works ⁨4⁩ ⁨months⁩ ago

Given Microsoft’s investment in OpenAI and strong marketing of its own Microsoft Copilot AI features, the company has a strong interest in maintaining the perception of continued progress, even if the tech stalls.

I believe this sums it up.

source
MajorHavoc@programming.dev ⁨4⁩ ⁨months⁩ ago
Yeah. There’s a very narrow corner that demands huge models, and that’s use cases where there’s no room for mistakes. That space is exciting, but also deeply bogged down in uncertainty, due both to laws and as-yet-undelivered, but 100% certainly coming-soon, law-creating-disasters.

Everywhere else, I suspect we’ve seen as good as we’re going to get, from current generation AI.

They know this too, but there’s not much interesting on the table to “bet the farm” on to court “swing for the fences” investors (gullible suckers) right now.

source
Peanutbjelly@sopuli.xyz ⁨4⁩ ⁨months⁩ ago
While I agree about the conflict of interest, I would largely say the same thing. However I see intelligence as a modular and many dimensional chip concept. If it scales as anticipated, it will still need to be organized into different forms of informational or computational flow for anything reassembling an actively intelligent system.

On that note, the recent developments with six like RXinfer are astonishing given the current level of attention being paid. Seeing how llms are being treated, I’m almost glad it’s not being absorbed into the hype and hate cycle.

source