#Pipeline Parallelism

2026

• 05-14 EN

  DisagMoE: Disaggregating Attention and FFN to Beat the MoE All-to-All Bottleneck

• 05-14 中

  DisagMoE：用解耦 Attention 和 FFN 打通 MoE 训练的 all-to-all 瓶颈

• 05-07 EN

  Piper: Efficient Large-Scale MoE Training via Resource Modeling and Pipelined Hybrid Parallelism

• 04-16 EN

  PipeDream: Turning Pipeline Parallelism into a Practical Training System — Deep Technical Review

• 04-16 中

  PipeDream：把 Pipeline Parallelism 做成真正可训练系统——深度阅读笔记

• 04-02 EN

  GPipe: Easy Scaling with Micro-Batch Pipeline Parallelism — In-Depth Technical Review

• 04-02 中

  GPipe：微批次流水线并行的大规模模型训练 — 深度阅读笔记