DeepSpeed v0.19.8 expands AutoTP, AutoEP, and accelerator support

News LLM Training Infrastructure

  • DeepSpeed v0.19.8 adds AutoTP support for vocabulary-parallel LM heads and embeddings, and extends support for tied models and row-parallel output-head training.
  • AutoEP changes include sharing a DeepEP buffer across MoE layers, optional regional compilation, fused operations, and updates to checkpoint placement and dispatch replay.
  • The release adds graph operations and FusedLion, FusedLamb, and Quantizer operations for NPU, and introduces the KLXPU accelerator.
  • DeepSpeed removes elastic training, Progressive Layer Dropping, and graph harvesting, while deprecating APEX amp.

Our take

Teams that rely on removed features will need to revise their training setup or consider staying on an earlier release; users of APEX amp should also plan for migration. The release notes do not identify replacements, so the migration path for these workflows remains unclear.

Sources

  1. DeepSpeed v0.19.8 Patch Release · DeepSpeed Releases

The summary and analysis were generated by AI. The original sources are authoritative. AI content policy