That and re-training the models once the code is rewritten. Presumably MS doesn’t have access to the same training sets (they almost certainly have their own, but we don’t know the breadth or quality by comparison to OpenAIs data sets)
Comment on Microsoft stock hits all-time high after hiring former OpenAI CEO Sam Altman
Ghostalmedia@lemmy.world 11 months agoMostly starting over code wise.
I’ve had to rebuild a thing or two in my day, and building it the second time is always faster, but still, you’ve got to write all the crap over again.
This will undoubtedly be way faster than doing a startup from scratch, but they’re literally starting from a position of having no code checked in at all.
kautau@lemmy.world 11 months ago
bassomitron@lemmy.world 11 months ago
They don’t need to start over. Have you been following the open source model progression the last 5-6 months? Those LLMs have made crazy progress in such a short span of time. They can easily take one of those existing models and improve upon them or at least borrow as much as needed. And I also find it hard to believe that Microsoft hasn’t been secretly developing their own model(s) at all.
I agree that losing their original egg is definitely a setback, but for all we know this fresh start with Microsoft may allow them to try some new and better ideas they couldn’t afford to do at ChatGPT due to the sunk investment costs they had in their original tool.
Anywho, time will tell!