7+ hour, 54+ min ago  (379+ words) Before you begin, ensure you have the following: Universal Checkpointing uses the same high-level flow for dense models, Auto TP (Automatic Tensor Parallelism), and Auto EP (Automatic Expert Parallelism): save a regular Deep Speed Ze RO checkpoint, convert that checkpoint…...