Skip to content
Hacker News · AI·· 2 h agoAI score60

DeepSeek releases DeepEP-Ascend, an expert-parallel communication library for Huawei Ascend NPUs

Training and Inference on Huawei Ascend NPUs

AI summary

DeepSeek released DeepEP-Ascend, an open-source communication library for training and inference on Huawei Ascend NPUs, offering expert-parallel all-to-all for MoE dispatch and combine with FP8 dispatch and deferred epilogues, plus experimental PP, Bucket CP/DP collectives and Engram remote memory access. Measured on Ascend 950DT with CANN 9.2.0, dispatch reaches 373–375 GB/s at EP8 and 313–320 GB/s at EP128, while combine drops from 345–347 GB/s to 272–278 GB/s. The public buffer APIs align with the NVIDIA version of DeepEP, and the authors note that larger EP sizes and combine are still under optimization.

Source:Hacker News · AI · github.com