Comment on China solves 'century-old problem' with new analog chip that is 1,000 times faster than high-end Nvidia GPUs
But it only does 16x16 matrix inversion.
Oh noes, how could that -possibly- scale?
To a billion parameter matrix inverter? Probably not too hard, maybe not at those speeds.
To a GPU, or even just the functions used in GenAI? We don’t even know if those are possible with analog computers to begin with.
@TheBlackLounge @kalkulat LLM inference is definitely theoretically possible on analog chips. They just may not scale :v
kalkulat@lemmy.world 1 day ago
Oh noes, how could that -possibly- scale?
TheBlackLounge@lemmy.zip 21 hours ago
To a billion parameter matrix inverter? Probably not too hard, maybe not at those speeds.
To a GPU, or even just the functions used in GenAI? We don’t even know if those are possible with analog computers to begin with.
fcalva@cyberplace.social 13 hours ago
@TheBlackLounge @kalkulat LLM inference is definitely theoretically possible on analog chips. They just may not scale :v