## What's Changed * Update version by @sfc-gh-truwase in https://github.com/deepspeedai/DeepSpeed/pull/7719 * Disable deterministic option in compile tests by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7720 * Fix SuperOffloadOptimizer_Stage3 crash due to missing param_names parameter by @ImaGoodFella in https://github.com/deepspeedai/DeepSpeed/pull/7715 * [AMD][ROCm] Improve support of AMD by @k-artem in https://github.com/deepspeedai/DeepSpeed/pull/7448 * fix typo by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7722 * Skip none in backward hook by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7725 * [Engine] Only scale gradients if scale_wrt_gas is True by @kashif in https://github.com/deepspeedai/DeepSpeed/pull/7724 * Fix testcases that depends on triton by @k-artem in https://github.com/deepspeedai/DeepSpeed/pull/7731 * Fix rare hang in DeepSpeed Async I/O wait by releasing the Python GIL by @xylian86 in https://github.com/deepspeedai/DeepSpeed/pull/7727 * Fix #7733: Replace torch.sqrt with math.sqrt in scale_lr for sqrt method by @Rakshit-gen in https://github.com/deepspeedai/DeepSpeed/pull/7735 * replace moe checkpoint dp_world_size with seq_dp_world_size by @wukong1992 in https://github.com/deepspeedai/DeepSpeed/pull/7732 * [BUG] Fix UlyssesSPAttentionHF.register_with_transformers() crash with PEFT models by @Rakshit-gen in https://github.com/deepspeedai/DeepSpeed/pull/7737 * Add core api update blog by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7738 * Fix Nebula checkpoint engine commit() API mismatch by @Rakshit-gen in https://github.com/deepspeedai/DeepSpeed/pull/7740 * Fix DecoupledCheckpointEngine deadlock and improve reliability by @Rakshit-gen in https://github.com/deepspeedai/DeepSpeed/pull/7742 * Fix OnebitLamb NaN propagation with empty parameters by @Rakshit-gen in https://github.com/deepspeedai/DeepSpeed/pull/7736 * fix: remove premature MPI environment variable check in OpenMPIRunner by @leejianwoo-collab in https://github.com/deepspeedai/DeepSpeed/pull/7751 * Enable python 3.11 and 3.12 tests by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7007 * Add CI workflow to run tests on AWS by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7753 * Add fallback to BF16 support check by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7754 * Fix DeepCompile for PyTorch 2.8/2.9 compatibility by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7755 * Removed amp testcases by @k-artem in https://github.com/deepspeedai/DeepSpeed/pull/7745 * fix: avoid IndexError in BF16_Optimizer.destroy() when using DummyOptim by @leejianwoo-collab in https://github.com/deepspeedai/DeepSpeed/pull/7763 ## New Contributors * @ImaGoodFella made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7715 * @k-artem made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7448 * @kashif made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7724 * @Rakshit-gen made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7735 * @leejianwoo-collab made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7751 **Full Changelog**: https://github.com/deepspeedai/DeepSpeed/compare/v0.18.3...v0.18.4

## What's Changed * Update version.txt after release by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7675 * [modal ci] fixes by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7676 * leaf modules: explain better by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7674 * disable nv-lightning-v100.yml cI by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7681 * allow seperate learning rate "muon_lr" and "adam_lr" for muon optimizer by @delock in https://github.com/deepspeedai/DeepSpeed/pull/7658 * see_mem_usage: make always work by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7688 * make debug utils more resilient by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7690 * zero stage 1-2: don't pin memory if not configured by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7689 * modal ci: fix group concurrency by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7691 * Use pytorch utils to detect ninja by @Emrys-Merlin in https://github.com/deepspeedai/DeepSpeed/pull/7687 * Update SECURITY.md to point to GitHub reporting rather than Microsoft by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7692 * Add Qwen2.5 to AutoTP model list by @delock in https://github.com/deepspeedai/DeepSpeed/pull/7696 * Trust intel server for XPU tests by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7698 * PyTorch-compatible backward API by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7665 * Add news about Ray x DeepSpeed Meetup by @PKUWZP in https://github.com/deepspeedai/DeepSpeed/pull/7704 * Put Muon optimizer momentum buffer on GPU by @delock in https://github.com/deepspeedai/DeepSpeed/pull/7648 * [ROCm] Relax tolerances for FP8 unit test for fp16 and bf16 cases by @rraminen in https://github.com/deepspeedai/DeepSpeed/pull/7655 * Fix that ds_secondary_tensor may be dirty when loading the model or zero checkpoint for zero++. by @zhengchenyu in https://github.com/deepspeedai/DeepSpeed/pull/7707 * fix: skip aio wait when swap tensors is empty by @xylian86 in https://github.com/deepspeedai/DeepSpeed/pull/7712 * Low-precision master params/grads/optimizer states by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7700 * Enabled compiled autograd for backward pass by @deepcharm in https://github.com/deepspeedai/DeepSpeed/pull/7667 * Wall clock timers API by @sfc-gh-truwase in https://github.com/deepspeedai/DeepSpeed/pull/7714 ## New Contributors * @Emrys-Merlin made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7687 **Full Changelog**: https://github.com/deepspeedai/DeepSpeed/compare/v0.18.2...v0.18.3

## What's Changed * Update version.txt post 0.17.6 release by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7572 * DeepCompile ZeRO-3: robust allgather for uneven shards; fix profiling… by @juyterman1000 in https://github.com/deepspeedai/DeepSpeed/pull/7489 * logging: Also set log level of logger handlers by @eternalNight in https://github.com/deepspeedai/DeepSpeed/pull/7576 * Deepcompile: Fix bugs when applying deepcompile to VLA-like models by @eternalNight in https://github.com/deepspeedai/DeepSpeed/pull/7569 * Broadcast fp16 overflow in Z1 by @sfc-gh-truwase in https://github.com/deepspeedai/DeepSpeed/pull/7580 * Deepcompile: Make size of activation to free configurable by @eternalNight in https://github.com/deepspeedai/DeepSpeed/pull/7582 * SuperOffload Release by @xylian86 in https://github.com/deepspeedai/DeepSpeed/pull/7559 * Include init file for superoffload folder by @nguyen599 in https://github.com/deepspeedai/DeepSpeed/pull/7591 * disables ZeRO checkpoint loading path when stage=0 by @therealnaveenkamal in https://github.com/deepspeedai/DeepSpeed/pull/7586 * Simplify leaf module hook by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7592 * Fix the universal checkpoint issue for stage3 when there are multiple subgroups. by @zhengchenyu in https://github.com/deepspeedai/DeepSpeed/pull/7585 * Change current_device() to current_device_name() by @delock in https://github.com/deepspeedai/DeepSpeed/pull/7600 * Fixed the problem of loading universal checkpoint error in multi-machine mode. by @zhengchenyu in https://github.com/deepspeedai/DeepSpeed/pull/7601 * DeepCompile: Specify tensor aliasing in C++ op schema by @eternalNight in https://github.com/deepspeedai/DeepSpeed/pull/7597 * DeepCompile: Fuse allgather and downcast by @eternalNight in https://github.com/deepspeedai/DeepSpeed/pull/7588 * Add blog for SuperOffload by @xylian86 in https://github.com/deepspeedai/DeepSpeed/pull/7594 * Add venv to .gitignore by @zhengchenyu in https://github.com/deepspeedai/DeepSpeed/pull/7605 * Handle the case of DeepCompile's enabled but not activated by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7603 * DeepCompile: Fix IPG bucket clearing by @eternalNight in https://github.com/deepspeedai/DeepSpeed/pull/7610 * Minor fix in the SuperOffload blog by @xylian86 in https://github.com/deepspeedai/DeepSpeed/pull/7612 * Fixed the issue that universal checkpoint cannot be loaded for stage3 when world size expansion. by @zhengchenyu in https://github.com/deepspeedai/DeepSpeed/pull/7599 * Fixed save_checkpoint race when consolidating NVMe offloaded tensors by @H1manshu21 in https://github.com/deepspeedai/DeepSpeed/pull/7613 * [wall_clock_breakdown] always log stats when enabled by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7617 * DeepCompile: Use min_cut_rematerialization for partitioning joint graphs by @eternalNight in https://github.com/deepspeedai/DeepSpeed/pull/7609 * Show mismatching values when DeepCompile test fails by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7618 * Improve leaf module interface (enable via config, relax matching criteria, add document, etc.) by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7604 * add print_dist util by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7621 * Super offload blog Chinese version by @delock in https://github.com/deepspeedai/DeepSpeed/pull/7620 * Enable grad scaler for ZeRO-0 + torch.autocast path by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7619 * Blog of zenflow binding study by @delock in https://github.com/deepspeedai/DeepSpeed/pull/7614 * Clarify document of leaf module config by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7623 * [TiledMLP] moe support by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7622 * Update email address by @sfc-gh-truwase in https://github.com/deepspeedai/DeepSpeed/pull/7624 ## New Contributors * @juyterman1000 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7489 * @nguyen599 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7591 * @zhengchenyu made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7585 * @H1manshu21 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7613 **Full Changelog**: https://github.com/deepspeedai/DeepSpeed/compare/v0.17.6...v0.18.0

## What's Changed * Update version.txt after 0.17.5 release by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7502 * Support DeepSpeed offload and reload states with ZeRO1 and ZeRO2 by @LYMDLUT in https://github.com/deepspeedai/DeepSpeed/pull/7421 * CI funding shout out to modal.com by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7503 * Fix assert when 'pp_int' object has no attribute 'custom_print_str' by @aeeeeeep in https://github.com/deepspeedai/DeepSpeed/pull/7507 * Update TSC Committers by @PKUWZP in https://github.com/deepspeedai/DeepSpeed/pull/7517 * Enabling Muon Optimizer in DeepSpeed by @PKUWZP in https://github.com/deepspeedai/DeepSpeed/pull/7509 * Enable non-ZeRO mode by @sfc-gh-truwase in https://github.com/deepspeedai/DeepSpeed/pull/7515 * Update README with ZenFlow release blog featured by PyTorch. by @Antlera in https://github.com/deepspeedai/DeepSpeed/pull/7520 * Add riscv64 cpu support in deepspeed_shm_comm op by @heyujiao99 in https://github.com/deepspeedai/DeepSpeed/pull/7519 * ZeRO3: Improve mismatch detection by @sfc-gh-truwase in https://github.com/deepspeedai/DeepSpeed/pull/7525 * fix typo s/1014 /1024 by @digger-yu in https://github.com/deepspeedai/DeepSpeed/pull/7528 * undo the revert by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7536 * [logging] less startup noise by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7526 * [doc] fixing moe tutorial by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7538 * docs typo: `lrrt.md`, reference to `cycle_min_lr` should be `cycle_max_lr` by @jakehemmerle in https://github.com/deepspeedai/DeepSpeed/pull/7530 * fixed DeepSpeedCPULion with ZeRO-Offload bug by @qibin0506 in https://github.com/deepspeedai/DeepSpeed/pull/7531 * Fix scaling and allgather with `torch.autocast` by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7534 * Fix zenflow_torch_adam.py by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7544 * Relax restrictions of torch.autocast integration by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7543 * Autotune ZenFlow affinity by @delock in https://github.com/deepspeedai/DeepSpeed/pull/7506 * fix get_cuda_compile_flag by @mingjielu in https://github.com/deepspeedai/DeepSpeed/pull/7521 * avoid setting device_id to `init_process_group` by @kaixuanliu in https://github.com/deepspeedai/DeepSpeed/pull/7542 * Improve error message and reduce validation in autocast test by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7547 * Revert "Add index to HPU devices (#7497)" by @deepcharm in https://github.com/deepspeedai/DeepSpeed/pull/7545 * [ALST tutorial] support bs>1 by @sfc-gh-sbekman in https://github.com/deepspeedai/DeepSpeed/pull/7550 * [MoE] Fix misuse of num_experts as expert parallel group size (ep_size) by @Flakes342 in https://github.com/deepspeedai/DeepSpeed/pull/7551 * Limit random seed range in tests by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7553 * Fix gradient buffer access for DeepCompile Z1/2 by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7548 * Move modal tests to tests/v1 by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7557 * Add dependency for deepcompile test by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7558 * deepcompile: Create dummy inputs using empty_strided by @eternalNight in https://github.com/deepspeedai/DeepSpeed/pull/7564 * deepcompile: Record graph order using OrderedDict by @eternalNight in https://github.com/deepspeedai/DeepSpeed/pull/7563 * deepcompile: Create a full list of no-copy ops by @eternalNight in https://github.com/deepspeedai/DeepSpeed/pull/7562 * fix npu device_id AttributeError issue by @we1sper in https://github.com/deepspeedai/DeepSpeed/pull/7560 * Make Muon optimizer easier to enable by @delock in https://github.com/deepspeedai/DeepSpeed/pull/7555 * scripts: Check .is_cuda only in non-C++ files by @eternalNight in https://github.com/deepspeedai/DeepSpeed/pull/7561 * [bugfix] fix partition context unpatch by @hjh0119 in https://github.com/deepspeedai/DeepSpeed/pull/7566 ## New Contributors * @LYMDLUT made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7421 * @aeeeeeep made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7507 * @heyujiao99 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7519 * @jakehemmerle made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7530 * @qibin0506 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7531 * @mingjielu made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7521 * @kaixuanliu made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7542 * @sfc-gh-sbekman made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7550 * @Flakes342 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7551 * @we1sper made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7560 * @hjh0119 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7566 **Full Changelog**: https://github.com/deepspeedai/DeepSpeed/compare/v0.17.5...v0.17.6

## What's Changed * Update version.txt after 0.17.3 release. by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7455 * Fix: UnboundLocalError for variable 'dim' about issue by @weeknan in https://github.com/deepspeedai/DeepSpeed/pull/7449 * adding TiledFusedLogitsLoss by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7437 * `TiledFusedLogitsLoss` bug fix by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7459 ## New Contributors * @weeknan made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7449 **Full Changelog**: https://github.com/deepspeedai/DeepSpeed/compare/v0.17.3...v0.17.4

## What's Changed * Update version after 0.17.1 release by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7345 * s/UlyssesPlus/Arctic Long Sequence Training (ALST)/ by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7348 * Don't break set_start_method by @tjruwase in https://github.com/deepspeedai/DeepSpeed/pull/7349 * Fix error of <glog/logging.h> by @Freed-Wu in https://github.com/deepspeedai/DeepSpeed/pull/7351 * Improve padding util for compile by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7355 * Fix 404s by @tjruwase in https://github.com/deepspeedai/DeepSpeed/pull/7363 * Fix tutorial title by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7365 * Restore real inputs for recompilation by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7356 * Fix(scheduler): WarmupLR inherits optimizer lr when not specified by @Flink-ddd in https://github.com/deepspeedai/DeepSpeed/pull/7360 * sequence parallel default dtype by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7364 * Enable torch.autocast with ZeRO by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/6993 * add Arctic Long Sequence Training paper reference by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7372 * Flops profiler support for F.interpolate by @sfc-gh-truwase in https://github.com/deepspeedai/DeepSpeed/pull/7353 * Relax tolerances for FP8 unit test only for ROCm + FP16 by @rraminen in https://github.com/deepspeedai/DeepSpeed/pull/7373 * Update latest news with DeepNVMe by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7375 * Fix release of IPG buffer by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7376 * fix wandb.log() call by removing `sync` kwarg by @ned2 in https://github.com/deepspeedai/DeepSpeed/pull/7383 * Fix dtype mismatch in `TestParamPartitioningSkipInit` by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7377 * Add support for ws=1 scenario by @NirSonnenschein in https://github.com/deepspeedai/DeepSpeed/pull/7379 * fix(inference): Add missing dtype attribute to ParameterBase setter by @Flink-ddd in https://github.com/deepspeedai/DeepSpeed/pull/7378 * add blog link by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7385 * fix broken url by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7390 * add support for CUDAtk12.9 by @loscrossos in https://github.com/deepspeedai/DeepSpeed/pull/7394 * Fix unbound local error for `return_val` by @HollowMan6 in https://github.com/deepspeedai/DeepSpeed/pull/7395 * Fix ZeRO stage 1 and add stage 2 support with DeepCompile by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7366 * Improve coverage of DeepCompile by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7386 * Added device detection to communication logging by @alexk101 in https://github.com/deepspeedai/DeepSpeed/pull/7398 * fix: Add `csrc/compile` to include paths for DeepCompile builder by @HollowMan6 in https://github.com/deepspeedai/DeepSpeed/pull/7401 * fix: DeepCompile for torch 2.8 by @HollowMan6 in https://github.com/deepspeedai/DeepSpeed/pull/7402 * fix(comm): Expose GradBucket in deepspeed.comm API by @Flink-ddd in https://github.com/deepspeedai/DeepSpeed/pull/7400 * fix: fix FileNotFoundError for build_win.bat by @gjj2828 in https://github.com/deepspeedai/DeepSpeed/pull/7399 * fix: engine initializes optimizer attributes at the beginning by @HollowMan6 in https://github.com/deepspeedai/DeepSpeed/pull/7410 ## New Contributors * @Freed-Wu made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7351 * @Flink-ddd made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7360 * @ned2 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7383 * @alexk101 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7398 * @gjj2828 made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7399 **Full Changelog**: https://github.com/deepspeedai/DeepSpeed/compare/v0.17.1...v0.17.2

## What's Changed * Update version.txt after v0.17.0 release by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7326 * Ulysses Plus Docs by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7331 * UlyssesPlus Docs take 2 by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7332 * Improve Ulysses Plus Docs by @cynricfu in https://github.com/deepspeedai/DeepSpeed/pull/7335 * Update config_utils.py by @qgallouedec in https://github.com/deepspeedai/DeepSpeed/pull/7333 * Fix pytest version to 8.3.5 in hpu-gaudi actions by @raza-sikander in https://github.com/deepspeedai/DeepSpeed/pull/7337 * Fix issue with symint input by @tohtana in https://github.com/deepspeedai/DeepSpeed/pull/7243 * fp16 optimizer timers fix - TypeError: 'NoneType' object is not callable by @rraminen in https://github.com/deepspeedai/DeepSpeed/pull/7330 * DeepNVMe update by @tjruwase in https://github.com/deepspeedai/DeepSpeed/pull/7215 * fixed: Modified the topkgating function and modified the test_moe file for testing by @xiongjyu in https://github.com/deepspeedai/DeepSpeed/pull/7163 * Fix LoRA arxiv reference by @emmanuel-ferdman in https://github.com/deepspeedai/DeepSpeed/pull/7340 * Update folder name by @sfc-gh-truwase in https://github.com/deepspeedai/DeepSpeed/pull/7343 * Improve overflow handling in ZeRO by @tjruwase in https://github.com/deepspeedai/DeepSpeed/pull/6976 * Fix docs that are rendering Incorrectly by @felixgondwe in https://github.com/deepspeedai/DeepSpeed/pull/7344 * Move pytest pinning from individual tests to requirements-dev.txt until fixed. by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7327 ## New Contributors * @cynricfu made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7335 * @xiongjyu made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7163 * @sfc-gh-truwase made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7343 * @felixgondwe made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7344 **Full Changelog**: https://github.com/deepspeedai/DeepSpeed/compare/v0.17.0...v0.17.1

## What's Changed * Update next version in version.txt after 0.16.9 release. by @loadams in https://github.com/deepspeedai/DeepSpeed/pull/7306 * Update COMMITTERS.md by @PKUWZP in https://github.com/deepspeedai/DeepSpeed/pull/7305 * Fix AutoTP gathering replaced layer params when bias is not None by @HollowMan6 in https://github.com/deepspeedai/DeepSpeed/pull/7257 * Fix the GPU memory usage of ZeRO-Offload (only update stage_1_and_2.py) by @arminzhu in https://github.com/deepspeedai/DeepSpeed/pull/7309 * Fix: Update grad norm calculation for CPU offload by @therealnaveenkamal in https://github.com/deepspeedai/DeepSpeed/pull/7302 * CI: prefer bf16 over fp16 by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7304 * `tests/conftest.py`: automatically add local deepspeed repo when running tests by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7317 * Update gaudi2 nightly,ci to latest 1.21.0 build by @raza-sikander in https://github.com/deepspeedai/DeepSpeed/pull/7313 * anchor transformers version by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7316 * fix asymmetric in dequantize by @pencil-hub in https://github.com/deepspeedai/DeepSpeed/pull/7283 * Ulysses SP for HF Integration by @stas00 in https://github.com/deepspeedai/DeepSpeed/pull/7268 * Fix ci hang in torch2.7& improve ut by @inkcherry in https://github.com/deepspeedai/DeepSpeed/pull/7321 * Bump to v0.17.0 by @sfc-gh-mwyatt in https://github.com/deepspeedai/DeepSpeed/pull/7324 ## New Contributors * @PKUWZP made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7305 * @arminzhu made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7309 * @therealnaveenkamal made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7302 * @pencil-hub made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7283 * @sfc-gh-mwyatt made their first contribution in https://github.com/deepspeedai/DeepSpeed/pull/7324 **Full Changelog**: https://github.com/deepspeedai/DeepSpeed/compare/v0.16.9...v0.17.0