DeepSeek has released DeepInfer, an open-source, high-performance framework designed for large-scale inference of DeepSeek models. The framework aims to optimize inference efficiency and scalability, enabling faster and more cost-effective deployment of DeepSeek's language models. This release also provides valuable insights for the community to enhance custom inference engines by studying DeepInfer's implementation.