DeepInfer is the high-performance inference framework that powers DeepSeek's large-scale production services. This open-source release provides offline inference with the core features needed for serv

Submitted ⁨⁨1⁩ ⁨hour⁩ ago⁩ by ⁨eifachposte@lemmy.durstig.online [bot]⁩ to ⁨ai_reddit@lemmy.durstig.online⁩

https://github.com/deepseek-ai/DeepInfer