Comment on China solves 'century-old problem' with new analog chip that is 1,000 times faster than high-end Nvidia GPUs
Oh noes, how could that -possibly- scale?
To a billion parameter matrix inverter? Probably not too hard, maybe not at those speeds.
To a GPU, or even just the functions used in GenAI? We don’t even know if those are possible with analog computers to begin with.
@TheBlackLounge @kalkulat LLM inference is definitely theoretically possible on analog chips. They just may not scale :v
TheBlackLounge@lemmy.zip 15 hours ago
To a billion parameter matrix inverter? Probably not too hard, maybe not at those speeds.
To a GPU, or even just the functions used in GenAI? We don’t even know if those are possible with analog computers to begin with.
fcalva@cyberplace.social 7 hours ago
@TheBlackLounge @kalkulat LLM inference is definitely theoretically possible on analog chips. They just may not scale :v