Mosaicml

Composer now supports the recently-released PyTorch [version 2.3.0](https://dev-discuss.pytorch.org/t/pytorch-2-3-0-general-availability/2033)! Please raise any issues with us so we can address them.

Bug Fixes
* Fixing checks for device microbatch size for sequence parallelism in [3200](https://github.com/mosaicml/composer/pull/3200)
* Fixing token logging in [3206](https://github.com/mosaicml/composer/pull/3206)
* Search for run name in MLFlowLogger in [3215](https://github.com/mosaicml/composer/pull/3215)
* Fix FQN names with activation checkpointing in [3210](https://github.com/mosaicml/composer/pull/3210)
* Strict weight matching for checkpoint loading in [3219](https://github.com/mosaicml/composer/pull/3219)

What's Changed
* Bump transformers by dakinggg in https://github.com/mosaicml/composer/pull/3197
* Add deprecation warnings for ICL datasets/helper functions/metrics by bmosaicml in https://github.com/mosaicml/composer/pull/3125
* Bump traitlets from 5.14.2 to 5.14.3 by dependabot in https://github.com/mosaicml/composer/pull/3204
* Raise LR schedule warnings only when necessary by snarayan21 in https://github.com/mosaicml/composer/pull/3207
* Add torch 2.3 support by mvpatel2000 in https://github.com/mosaicml/composer/pull/3209
* Add torch 2.3 CI/CD by mvpatel2000 in https://github.com/mosaicml/composer/pull/3211
* Fix daily test images by mvpatel2000 in https://github.com/mosaicml/composer/pull/3212
* Try FAv2 2.5.7 from source by mvpatel2000 in https://github.com/mosaicml/composer/pull/3213
* Update tests by mvpatel2000 in https://github.com/mosaicml/composer/pull/3217
* Fix torch 2.3 GPU tests by mvpatel2000 in https://github.com/mosaicml/composer/pull/3218
* Use flash-attn 2.5.8 with no build isolation in docker images by snarayan21 in https://github.com/mosaicml/composer/pull/3224
* Add a torch.cuda.empty_cache() in utils.save_checkpoint by bfontain in https://github.com/mosaicml/composer/pull/3216
* Require 2 steps for GS object store by mvpatel2000 in https://github.com/mosaicml/composer/pull/3228
* Add `rename_metrics` to Mlflow logger by hanlint in https://github.com/mosaicml/composer/pull/3225
* Fix daily tests by mvpatel2000 in https://github.com/mosaicml/composer/pull/3229
* Change precision for daily tests by mvpatel2000 in https://github.com/mosaicml/composer/pull/3231
* Create new Mlflow run by default and introduce `run_group` by chenmoneygithub in https://github.com/mosaicml/composer/pull/3208
* Fix daily test pt 4 by mvpatel2000 in https://github.com/mosaicml/composer/pull/3233
* Deprecate and bump version to 0.22 by mvpatel2000 in https://github.com/mosaicml/composer/pull/3230
* Fix daily tests v5 by mvpatel2000 in https://github.com/mosaicml/composer/pull/3234
* Fix daily v6 by mvpatel2000 in https://github.com/mosaicml/composer/pull/3235
* fix daily tests v7 by mvpatel2000 in https://github.com/mosaicml/composer/pull/3236
* Raise the daily test timeout by dakinggg in https://github.com/mosaicml/composer/pull/3241
* Accelerate GPU tests by mvpatel2000 in https://github.com/mosaicml/composer/pull/3237
* Make sharded checkpoint loading backwards-compatible by snarayan21 in https://github.com/mosaicml/composer/pull/3240


**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.21.3...v0.22.0

Deprecations
1. `device_transforms` param in `DataSpec` has been deprecated (https://github.com/mosaicml/composer/pull/3770)

Composer no longer supports the `device_transforms` parameter in `DataSpec`. Instead, `DataSpec` supports `batch_transforms` for batch level transformations on CPU and `microbatch_transforms` for micro-batch level transformations on target device.

What's Changed
* Add checkpoint BC tests for 0.27.0 and 0.28.0 by snarayan21 in https://github.com/mosaicml/composer/pull/3735
* Address sklearn device issues by snarayan21 in https://github.com/mosaicml/composer/pull/3748
* Update FAQ with hf-transfer info by KuuCi in https://github.com/mosaicml/composer/pull/3745
* Fix MLFlow logger CI error by ignoring UserWarning by j316chuck in https://github.com/mosaicml/composer/pull/3758
* Bump ci to v0.3.3 by j316chuck in https://github.com/mosaicml/composer/pull/3759
* Fix order of arguments to `loss` by gsganden in https://github.com/mosaicml/composer/pull/3754
* fix: make JSONTraceHandler.batch_end robust to /tmp/ being on diff mount to dest by thundergolfer in https://github.com/mosaicml/composer/pull/3766
* Bump pytorch to 2.6.0 by rithwik-db in https://github.com/mosaicml/composer/pull/3763
* Bump databricks-sdk from 0.38.0 to 0.44.1 by dependabot in https://github.com/mosaicml/composer/pull/3765
* Version bump to v0.30.0.dev0 by rithwik-db in https://github.com/mosaicml/composer/pull/3770

New Contributors
* gsganden made their first contribution in https://github.com/mosaicml/composer/pull/3754
* thundergolfer made their first contribution in https://github.com/mosaicml/composer/pull/3766
* rithwik-db made their first contribution in https://github.com/mosaicml/composer/pull/3763

**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.28.0...v0.29.0

Deprecations
1. Deepspeed Deprecation (https://github.com/mosaicml/composer/pull/3732)
Composer no longer supports the Deepspeed deep learning library. Support has shifted to PyTorch-native solutions such as FSDP and DDP only. Please use Composer v0.27.0 or before to continue using Deepspeed!

What's Changed
* Fix composer gpu daily test to use torch 2.5.1 by j316chuck in https://github.com/mosaicml/composer/pull/3712
* Bump coverage[toml] from 7.6.4 to 7.6.7 by dependabot in https://github.com/mosaicml/composer/pull/3713
* Update torchmetrics requirement from <1.5.3,>=1.0 to >=1.0,<1.6.1 by dependabot in https://github.com/mosaicml/composer/pull/3714
* Bump ubuntu 22.04 + fix CI mlflow tests by KuuCi in https://github.com/mosaicml/composer/pull/3716
* Bump databricks-sdk from 0.36.0 to 0.37.0 by dependabot in https://github.com/mosaicml/composer/pull/3715
* Bump mosaicml/pytorch images to use new mosaicml/pytorch images with updated ubuntu 22.04 by KuuCi in https://github.com/mosaicml/composer/pull/3718
* migrated all possible assets from GCP to repo by ethantang-db in https://github.com/mosaicml/composer/pull/3717
* Bump databricks-sdk from 0.37.0 to 0.38.0 by dependabot in https://github.com/mosaicml/composer/pull/3720
* Bump coverage[toml] from 7.6.7 to 7.6.8 by dependabot in https://github.com/mosaicml/composer/pull/3721
* Expose `DistributedSampler` RNG seed argument by janEbert in https://github.com/mosaicml/composer/pull/3724
* Fix netifaces install in Dockerfile by j316chuck in https://github.com/mosaicml/composer/pull/3726
* Update protobuf requirement from <5.29 to <5.30 by dependabot in https://github.com/mosaicml/composer/pull/3728
* Bump cryptography from 43.0.3 to 44.0.0 by dependabot in https://github.com/mosaicml/composer/pull/3731
* Speed up CI tests :) by KuuCi in https://github.com/mosaicml/composer/pull/3727
* Remove deepspeed completely by snarayan21 in https://github.com/mosaicml/composer/pull/3732
* Fix daily test failures by snarayan21 in https://github.com/mosaicml/composer/pull/3733
* Version bump to v0.29.0.dev0 by snarayan21 in https://github.com/mosaicml/composer/pull/3734

New Contributors
* janEbert made their first contribution in https://github.com/mosaicml/composer/pull/3724

**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.27.0...v0.28.0

What's New
1. Torch 2.5.1 Compatibility (https://github.com/mosaicml/composer/pull/3701)
We've added support for torch 2.5.1, including checkpointing bug fixes from PyTorch.

2. Add batch/microbatch transforms (https://github.com/mosaicml/composer/pull/3703)
Sped up device transformations by doing batch transform on CPU and microbatch transforms on GPU

Deprecations and Breaking Changes
1. MLFlow Metrics Deduplication (https://github.com/mosaicml/composer/pull/3678)
We added a metric de-duplication feature for the MLflow logger in Composer. Metrics that remain unchanged since the last step are not logged unless specific conditions are met, which by default is if we've reached a 100th multiple of duplicated metric steps. This optimizes logging storage by reducing redundant entries, balancing detailed sampling with efficiency.

Example:

MlflowLogger(..., log_duplicated_metric_every_n_steps=100)


What's Changed
* Metrics dedup for MLflow logger by chenmoneygithub in https://github.com/mosaicml/composer/pull/3678
* Bump databricks-sdk from 0.33.0 to 0.36.0 by dependabot in https://github.com/mosaicml/composer/pull/3686
* Update pillow requirement from <11,>=10.3.0 to >=10.3.0,<12 by dependabot in https://github.com/mosaicml/composer/pull/3684
* Lower min torchmetrics version by mvpatel2000 in https://github.com/mosaicml/composer/pull/3691
* Private link error handling by nancyhung in https://github.com/mosaicml/composer/pull/3689
* Update checkpoint tests to use new version 0.26.0 by irenedea in https://github.com/mosaicml/composer/pull/3683
* Bump coverage[toml] from 7.6.3 to 7.6.4 by dependabot in https://github.com/mosaicml/composer/pull/3694
* Pin checkpoint state dict flattening patch by b-chu in https://github.com/mosaicml/composer/pull/3700
* Torch bump to 2.5.1 by mvpatel2000 in https://github.com/mosaicml/composer/pull/3701
* Fix typo in trainer doc by XiaohanZhangCMU in https://github.com/mosaicml/composer/pull/3702
* Update packaging requirement from <24.2,>=21.3.0 to >=21.3.0,<24.3 by dependabot in https://github.com/mosaicml/composer/pull/3707
* Update torchmetrics requirement from <1.4.1,>=1.0 to >=1.0,<1.5.3 by dependabot in https://github.com/mosaicml/composer/pull/3706
* Add batch/microbatch transforms by mvpatel2000 in https://github.com/mosaicml/composer/pull/3703
* Bump version to 0.28.0.dev0 by j316chuck in https://github.com/mosaicml/composer/pull/3709
* Add torch 2.5.1 composer tests by j316chuck in https://github.com/mosaicml/composer/pull/3710


**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.26.1...v0.27.0

What's Changed
* Private link error handling by nancyhung in https://github.com/mosaicml/composer/pull/3689

**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.26.0...v0.26.1