Mosaicml

What's New

1. Improved DTensor Support
Composer now supports elastic saving and loading of DTensors at various mesh sizes.

2. Checkpoint Saving and Loading from Databricks MLFlow
Composer now supports saving and loading checkpoints to Databricks-managed MLFlow.


composer_model = MyComposerModel(...)

trainer = Trainer(
model=composer_model,
save_folder= 'dbfs:/databricks/mlflow-tracking/{mlflow_experiment_id}/{mlflow_run_id}/artifacts',
logger=MLFlowLogger(...),
load_path= 'dbfs:/databricks/mlflow-tracking/{mlflow_experiment_id}/{mlflow_run_id}/artifacts',
...
)

3. Better Communication Computation Overlap in FSDP
Composer now has improved communication/computation overlap in our FSDP code which should improve MFU across several architectures.

4. Python3.11 + Torch2.2 Support
Initial support of Python3.11 + Torch2.2 added in Composer.

5. PEFT LoRA
PEFT LoRA is now supported in the HuggingFaceModel class.

6. Refactored Evaluation
`in_context_learning_evaluation.py` has a new design with cleaner abstractions and easier interfaces to work wtih.

7. Azure Checkpointing
Composer now supports saving your model in Azure.

8. MLFlow Checkpointing
Composer now supports saving your model in MLFlow.


Bug Fixes
* Fix MLFlowLogger test by ngcgarcia in https://github.com/mosaicml/composer/pull/2912
* Fix bug with CoT early stopping and LLama2 tokenizer by bmosaicml in https://github.com/mosaicml/composer/pull/2902
* Fix split_batch bug with empty generation_kwargs by maxisawesome in https://github.com/mosaicml/composer/pull/2913
* Only load RNG keys that exist by mvpatel2000 in https://github.com/mosaicml/composer/pull/2901
* Fix daily tests by mvpatel2000 in https://github.com/mosaicml/composer/pull/2891
* Fix seed for FSDP wrap by mvpatel2000 in https://github.com/mosaicml/composer/pull/2833
* Fix load_ignore_keys with rng by mvpatel2000 in https://github.com/mosaicml/composer/pull/2803
* Fix mosaicml logger on close by mvpatel2000 in https://github.com/mosaicml/composer/pull/2816
* Fix torch profiler error on close by mvpatel2000 in https://github.com/mosaicml/composer/pull/2818
* Fix import for daily test by snarayan21 in https://github.com/mosaicml/composer/pull/2826
* Fix how single value tensors are logged by aspfohl in https://github.com/mosaicml/composer/pull/2831
* Fix torch bump by j316chuck in https://github.com/mosaicml/composer/pull/2855
* Fix MPS with sequence loss by JAEarly in https://github.com/mosaicml/composer/pull/2834


What's Changed
* Bump transformers version by dakinggg in https://github.com/mosaicml/composer/pull/2781
* Bump sphinxext-opengraph from 0.9.0 to 0.9.1 by dependabot in https://github.com/mosaicml/composer/pull/2784
* Bump coverage[toml] from 7.3.0 to 7.3.3 by dependabot in https://github.com/mosaicml/composer/pull/2783
* Update torch requirement from <2.1.2,>=1.13.1 to >=1.13.1,<2.1.3 by dependabot in https://github.com/mosaicml/composer/pull/2785
* [UCVolumes] Rely on databricks-sdk auth for the right requirements by panchalhp-db in https://github.com/mosaicml/composer/pull/2789
* Enable system metrics in mosaic mlflow logger by chenmoneygithub in https://github.com/mosaicml/composer/pull/2775
* Update parse_uri by irenedea in https://github.com/mosaicml/composer/pull/2787
* default to no torch profiler memory timeline by cli99 in https://github.com/mosaicml/composer/pull/2790
* Add eot token to ICL generate kwargs by bmosaicml in https://github.com/mosaicml/composer/pull/2782
* Add nightly image for torch 2.2.0-12-20-23 by j316chuck in https://github.com/mosaicml/composer/pull/2791
* Add torch nightly 12-13 by j316chuck in https://github.com/mosaicml/composer/pull/2792
* Add process group as arg to FSDP by mvpatel2000 in https://github.com/mosaicml/composer/pull/2794
* Bump coverage[toml] from 7.3.3 to 7.3.4 by dependabot in https://github.com/mosaicml/composer/pull/2798
* Bump ipykernel from 6.26.0 to 6.28.0 by dependabot in https://github.com/mosaicml/composer/pull/2806
* Bump junitparser from 3.1.0 to 3.1.1 by dependabot in https://github.com/mosaicml/composer/pull/2805
* Bump pytest from 7.4.3 to 7.4.4 by dependabot in https://github.com/mosaicml/composer/pull/2807
* Avoid futures on close for MosaicML logger by mvpatel2000 in https://github.com/mosaicml/composer/pull/2804
* Require sync module states with HSDP by mvpatel2000 in https://github.com/mosaicml/composer/pull/2812
* Better communication computation overlap by snarayan21 in https://github.com/mosaicml/composer/pull/2811
* Improve error message for speed monitor by mvpatel2000 in https://github.com/mosaicml/composer/pull/2801
* Bump torch version -- DO NOT RELEASE by mvpatel2000 in https://github.com/mosaicml/composer/pull/2814
* Bump torchvision for nightly by mvpatel2000 in https://github.com/mosaicml/composer/pull/2815
* Correct multi-unshard stream patching for torch 2.2.0dev, and stream waiting correctness. by snarayan21 in https://github.com/mosaicml/composer/pull/2817
* Bump traitlets from 5.13.0 to 5.14.1 by dependabot in https://github.com/mosaicml/composer/pull/2822
* All unshard streams wait on computation every step by snarayan21 in https://github.com/mosaicml/composer/pull/2823
* Add encoding=utf-8 by dakinggg in https://github.com/mosaicml/composer/pull/2824
* [MLFlowObjectStore] [1/2] Base implementation for MLFlowObjectStore by jerrychen109 in https://github.com/mosaicml/composer/pull/2802
* Remove fused layernorm (already deprecated for 2 versions) by mvpatel2000 in https://github.com/mosaicml/composer/pull/2827
* checkpoint saver tracks all checkpoints/intervals in state by aspfohl in https://github.com/mosaicml/composer/pull/2819
* code-quality timeout update by aspfohl in https://github.com/mosaicml/composer/pull/2830
* Adds DTensor Support by mvpatel2000 in https://github.com/mosaicml/composer/pull/2821
* Remove duplicate checkpoint verifications by eracah in https://github.com/mosaicml/composer/pull/2828
* Remove fsdp patch for comm overlap by mvpatel2000 in https://github.com/mosaicml/composer/pull/2836
* Allow hsdp by mvpatel2000 in https://github.com/mosaicml/composer/pull/2838
* Bump torch 2.1.2 by mvpatel2000 in https://github.com/mosaicml/composer/pull/2840
* Upgrade pyright to 1.1.310 by b-chu in https://github.com/mosaicml/composer/pull/2841
* [MLFlowObjectStore] [2/2] Support checkpointing with MLFlow by jerrychen109 in https://github.com/mosaicml/composer/pull/2810
* update nightly to torch 2.3 by j316chuck in https://github.com/mosaicml/composer/pull/2842
* Pin sphinxcontrib applehelp by mvpatel2000 in https://github.com/mosaicml/composer/pull/2854
* Torch 2.3 patch by dakinggg in https://github.com/mosaicml/composer/pull/2849
* Update mosaicml-cli requirement from <0.6,>=0.5.25 to >=0.5.25,<0.7 by dependabot in https://github.com/mosaicml/composer/pull/2866
* Rewrite to use individual state functions by mvpatel2000 in https://github.com/mosaicml/composer/pull/2860
* Add custom stopping criteria to ICL generate tasks by bmosaicml in https://github.com/mosaicml/composer/pull/2800
* Add save_ignore_keys by mvpatel2000 in https://github.com/mosaicml/composer/pull/2868
* Remome log debug by mvpatel2000 in https://github.com/mosaicml/composer/pull/2871
* Update monkeypatch to put barrier in optim load by mvpatel2000 in https://github.com/mosaicml/composer/pull/2874
* Remove toml by b-chu in https://github.com/mosaicml/composer/pull/2872
* Update license by b-chu in https://github.com/mosaicml/composer/pull/2875
* Add ignore_metrics field to the MLflow logger by ngcgarcia in https://github.com/mosaicml/composer/pull/2869
* Convert print to log.info by mvpatel2000 in https://github.com/mosaicml/composer/pull/2876
* Bump version to 0.18.0 by irenedea in https://github.com/mosaicml/composer/pull/2877
* Removed commented-out unshard streams patching. by snarayan21 in https://github.com/mosaicml/composer/pull/2873
* Make code quality workflow reusable by b-chu in https://github.com/mosaicml/composer/pull/2878
* Bump gitpython from 3.1.40 to 3.1.41 by dependabot in https://github.com/mosaicml/composer/pull/2885
* Bump torchmetrics by mvpatel2000 in https://github.com/mosaicml/composer/pull/2890
* Bump transformers to 4.37 by dakinggg in https://github.com/mosaicml/composer/pull/2894
* Azure checkpointing support by mvpatel2000 in https://github.com/mosaicml/composer/pull/2893
* Pass PG into checkpoint load and load rng with state_dict by mvpatel2000 in https://github.com/mosaicml/composer/pull/2897
* Remove monkeypatch and new state dict APIs for torch 2.2 by mvpatel2000 in https://github.com/mosaicml/composer/pull/2899
* Bump version to 0.18.1 by b-chu in https://github.com/mosaicml/composer/pull/2905
* Refactor in_context_learning_evaluation.py by maxisawesome in https://github.com/mosaicml/composer/pull/2713
* Fix FP8 checkpoint resumption with onnx export flag by j316chuck in https://github.com/mosaicml/composer/pull/2907
* Add Python 3.11 + FA 2.5.0 + Torch 2.3.0 Image by KuuCi in https://github.com/mosaicml/composer/pull/2898
* Add yamllint to pre commit by b-chu in https://github.com/mosaicml/composer/pull/2909
* Add ignore_hyperparameters to MLFlowLogger by ngcgarcia in https://github.com/mosaicml/composer/pull/2908
* Bump coverage[toml] from 7.3.4 to 7.4.1 by dependabot in https://github.com/mosaicml/composer/pull/2915
* Add checkpoint test for 0.18.1 by b-chu in https://github.com/mosaicml/composer/pull/2906
* Integrate PEFT LoRA with HuggingFaceModel by dakinggg in https://github.com/mosaicml/composer/pull/2829

New Contributors
* jerrychen109 made their first contribution in https://github.com/mosaicml/composer/pull/2802
* JAEarly made their first contribution in https://github.com/mosaicml/composer/pull/2834
* maxisawesome made their first contribution in https://github.com/mosaicml/composer/pull/2713

**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.17.2...v0.19.0

Bug Fixes
* Fix lp layernorm weight by snarayan21 in https://github.com/mosaicml/composer/pull/2954

What's Changed
* Fix lp layernorm weight by snarayan21 in https://github.com/mosaicml/composer/pull/2954
* Bump version to 0.18.2 by b-chu

**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.18.1...v0.18.2

Bug Fixes
* Fix MPS with sequence loss by JAEarly in https://github.com/mosaicml/composer/pull/2834
* Fix daily tests by mvpatel2000 in https://github.com/mosaicml/composer/pull/2891
* Remove monkeypatch and new state dict APIs for torch 2.2 by mvpatel2000 in https://github.com/mosaicml/composer/pull/2899
* Only load RNG keys that exist by mvpatel2000 in https://github.com/mosaicml/composer/pull/2901

What's Changed
* Bump version to 0.18.0 by irenedea in https://github.com/mosaicml/composer/pull/2877
* Removed commented-out unshard streams patching. by snarayan21 in https://github.com/mosaicml/composer/pull/2873
* Make code quality workflow reusable by b-chu in https://github.com/mosaicml/composer/pull/2878
* Bump gitpython from 3.1.40 to 3.1.41 by dependabot in https://github.com/mosaicml/composer/pull/2885
* Fix MPS with sequence loss by JAEarly in https://github.com/mosaicml/composer/pull/2834
* Bump torchmetrics by mvpatel2000 in https://github.com/mosaicml/composer/pull/2890
* Fix daily tests by mvpatel2000 in https://github.com/mosaicml/composer/pull/2891
* Bump transformers to 4.37 by dakinggg in https://github.com/mosaicml/composer/pull/2894
* Azure checkpointing support by mvpatel2000 in https://github.com/mosaicml/composer/pull/2893
* Pass PG into checkpoint load and load rng with state_dict by mvpatel2000 in https://github.com/mosaicml/composer/pull/2897
* Remove monkeypatch and new state dict APIs for torch 2.2 by mvpatel2000 in https://github.com/mosaicml/composer/pull/2899
* Only load RNG keys that exist by mvpatel2000 in https://github.com/mosaicml/composer/pull/2901
* Bump version to 0.18.1 by b-chu in https://github.com/mosaicml/composer/pull/2905

New Contributors
* JAEarly made their first contribution in https://github.com/mosaicml/composer/pull/2834

**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.18.0...v0.18.1

**This release has been yanked, please skip directly to Composer v0.18.1**

New Features
1. Improved DTensor Support
Composer now supports elastic saving and loading of DTensors at various mesh sizes.

2. Checkpoint Saving and Loading from Databricks MLFlow
Composer now supports saving and loading checkpoints to Databricks-managed MLFlow.


composer_model = MyComposerModel(...)

trainer = Trainer(
model=composer_model,
save_folder= 'dbfs:/databricks/mlflow-tracking/{mlflow_experiment_id}/{mlflow_run_id}/artifacts',
logger=MLFlowLogger(...),
load_path= 'dbfs:/databricks/mlflow-tracking/{mlflow_experiment_id}/{mlflow_run_id}/artifacts',
...
)


Bug Fixes
* Fix load_ignore_keys with rng by mvpatel2000 in https://github.com/mosaicml/composer/pull/2803
* Fix mosaicml logger on close by mvpatel2000 in https://github.com/mosaicml/composer/pull/2816
* Fix torch profiler error on close by mvpatel2000 in https://github.com/mosaicml/composer/pull/2818
* Fix import for daily test by snarayan21 in https://github.com/mosaicml/composer/pull/2826
* [S] Fix how single value tensors are logged by aspfohl in https://github.com/mosaicml/composer/pull/2831

Deprecations
* Remove fused layernorm (already deprecated for 2 versions) by mvpatel2000 in https://github.com/mosaicml/composer/pull/2827

What's Changed
* Bump transformers version by dakinggg in https://github.com/mosaicml/composer/pull/2781
* Bump sphinxext-opengraph from 0.9.0 to 0.9.1 by dependabot in https://github.com/mosaicml/composer/pull/2784
* Bump coverage[toml] from 7.3.0 to 7.3.3 by dependabot in https://github.com/mosaicml/composer/pull/2783
* Update torch requirement from <2.1.2,>=1.13.1 to >=1.13.1,<2.1.3 by dependabot in https://github.com/mosaicml/composer/pull/2785
* [UCVolumes] Rely on databricks-sdk auth for the right requirements by panchalhp-db in https://github.com/mosaicml/composer/pull/2789
* Enable system metrics in mosaic mlflow logger by chenmoneygithub in https://github.com/mosaicml/composer/pull/2775
* Update parse_uri by irenedea in https://github.com/mosaicml/composer/pull/2787
* default to no torch profiler memory timeline by cli99 in https://github.com/mosaicml/composer/pull/2790
* Add eot token to ICL generate kwargs by bmosaicml in https://github.com/mosaicml/composer/pull/2782
* Add nightly image for torch 2.2.0-12-20-23 by j316chuck in https://github.com/mosaicml/composer/pull/2791
* Add torch nightly 12-13 by j316chuck in https://github.com/mosaicml/composer/pull/2792
* Add process group as arg to FSDP by mvpatel2000 in https://github.com/mosaicml/composer/pull/2794
* Bump coverage[toml] from 7.3.3 to 7.3.4 by dependabot in https://github.com/mosaicml/composer/pull/2798
* Fix load_ignore_keys with rng by mvpatel2000 in https://github.com/mosaicml/composer/pull/2803
* Bump ipykernel from 6.26.0 to 6.28.0 by dependabot in https://github.com/mosaicml/composer/pull/2806
* Bump junitparser from 3.1.0 to 3.1.1 by dependabot in https://github.com/mosaicml/composer/pull/2805
* Bump pytest from 7.4.3 to 7.4.4 by dependabot in https://github.com/mosaicml/composer/pull/2807
* Avoid futures on close for MosaicML logger by mvpatel2000 in https://github.com/mosaicml/composer/pull/2804
* Require sync module states with HSDP by mvpatel2000 in https://github.com/mosaicml/composer/pull/2812
* Better communication computation overlap by snarayan21 in https://github.com/mosaicml/composer/pull/2811
* Improve error message for speed monitor by mvpatel2000 in https://github.com/mosaicml/composer/pull/2801
* Bump torch version -- DO NOT RELEASE by mvpatel2000 in https://github.com/mosaicml/composer/pull/2814
* Bump torchvision for nightly by mvpatel2000 in https://github.com/mosaicml/composer/pull/2815
* Fix mosaicml logger on close by mvpatel2000 in https://github.com/mosaicml/composer/pull/2816
* Correct multi-unshard stream patching for torch 2.2.0dev, and stream waiting correctness. by snarayan21 in https://github.com/mosaicml/composer/pull/2817
* Fix torch profiler error on close by mvpatel2000 in https://github.com/mosaicml/composer/pull/2818
* Bump traitlets from 5.13.0 to 5.14.1 by dependabot in https://github.com/mosaicml/composer/pull/2822
* All unshard streams wait on computation every step by snarayan21 in https://github.com/mosaicml/composer/pull/2823
* Add encoding=utf-8 by dakinggg in https://github.com/mosaicml/composer/pull/2824
* Fix import for daily test by snarayan21 in https://github.com/mosaicml/composer/pull/2826
* [MLFlowObjectStore] [1/2] Base implementation for MLFlowObjectStore by jerrychen109 in https://github.com/mosaicml/composer/pull/2802
* Remove fused layernorm (already deprecated for 2 versions) by mvpatel2000 in https://github.com/mosaicml/composer/pull/2827
* checkpoint saver tracks all checkpoints/intervals in state by aspfohl in https://github.com/mosaicml/composer/pull/2819
* code-quality timeout update by aspfohl in https://github.com/mosaicml/composer/pull/2830
* [S] Fix how single value tensors are logged by aspfohl in https://github.com/mosaicml/composer/pull/2831
* Adds DTensor Support by mvpatel2000 in https://github.com/mosaicml/composer/pull/2821
* Remove duplicate checkpoint verifications by eracah in https://github.com/mosaicml/composer/pull/2828
* Fix seed for FSDP wrap by mvpatel2000 in https://github.com/mosaicml/composer/pull/2833
* Remove fsdp patch for comm overlap by mvpatel2000 in https://github.com/mosaicml/composer/pull/2836
* Allow hsdp by mvpatel2000 in https://github.com/mosaicml/composer/pull/2838
* Bump torch 2.1.2 by mvpatel2000 in https://github.com/mosaicml/composer/pull/2840
* Upgrade pyright to 1.1.310 by b-chu in https://github.com/mosaicml/composer/pull/2841
* [MLFlowObjectStore] [2/2] Support checkpointing with MLFlow by jerrychen109 in https://github.com/mosaicml/composer/pull/2810
* update nightly to torch 2.3 by j316chuck in https://github.com/mosaicml/composer/pull/2842
* Pin sphinxcontrib applehelp by mvpatel2000 in https://github.com/mosaicml/composer/pull/2854
* Fix torch bump by j316chuck in https://github.com/mosaicml/composer/pull/2855
* Torch 2.3 patch by dakinggg in https://github.com/mosaicml/composer/pull/2849
* Update mosaicml-cli requirement from <0.6,>=0.5.25 to >=0.5.25,<0.7 by dependabot in https://github.com/mosaicml/composer/pull/2866
* Rewrite to use individual state functions by mvpatel2000 in https://github.com/mosaicml/composer/pull/2860
* Add custom stopping criteria to ICL generate tasks by bmosaicml in https://github.com/mosaicml/composer/pull/2800
* Add save_ignore_keys by mvpatel2000 in https://github.com/mosaicml/composer/pull/2868
* Remome log debug by mvpatel2000 in https://github.com/mosaicml/composer/pull/2871
* Update monkeypatch to put barrier in optim load by mvpatel2000 in https://github.com/mosaicml/composer/pull/2874
* Remove toml by b-chu in https://github.com/mosaicml/composer/pull/2872
* Update license by b-chu in https://github.com/mosaicml/composer/pull/2875
* Add ignore_metrics field to the MLflow logger by ngcgarcia in https://github.com/mosaicml/composer/pull/2869
* Convert print to log.info by mvpatel2000 in https://github.com/mosaicml/composer/pull/2876

New Contributors
* jerrychen109 made their first contribution in https://github.com/mosaicml/composer/pull/2802

**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.17.2...v0.18.0

New Features

**1. Torch 2.1.1 Support**

Composer now supports torch 2.1.1! This new release primarily fixes several small bugs that we had previously monkeypatched in Composer.

**2. Faster OCI Upload/Download**

Composer now supports multi-part upload/download to OCI, which should speedup object store times.

**3. Memory Profiling**

We've expanded the torch profiler integration to support memory profiling. Now, when the profile is enabled, you will get a trace showing how memory utilization is broken down by various components on your GPUs.

Bug Fixes

**1. FSDP Initialization with Meta**

Previously, our FSDP integration had a bug with initializing weights when using `device=meta`, which resulted in an additional scaling. This has now been fixed, so `device` and distributed strategies should not affect parallelization strategy.


What's Changed
* Override NVIDIA environment variable for CUDA 12.1 images by bandish-shah in https://github.com/mosaicml/composer/pull/2742
* Add NVIDIA_REQUIRE_CUDA_OVERRIDE env variable to Composer and Torch nightly Docker images by bandish-shah in https://github.com/mosaicml/composer/pull/2744
* Remove duplicated for loop in lr_monitor.py by priba in https://github.com/mosaicml/composer/pull/2738
* Fix console logger for small datasets. by mvpatel2000 in https://github.com/mosaicml/composer/pull/2746
* Add metadata logging for wandb by jjanezhang in https://github.com/mosaicml/composer/pull/2747
* Ignore load ignore keys by mvpatel2000 in https://github.com/mosaicml/composer/pull/2748
* Bump torch to 2.1.1 version by j316chuck in https://github.com/mosaicml/composer/pull/2717
* Add more info when run doesnt complete by aspfohl in https://github.com/mosaicml/composer/pull/2751
* Lower sequence generation length on code gen to be dependent on max canonical solution length by bmosaicml in https://github.com/mosaicml/composer/pull/2682
* Remove flatten params by mvpatel2000 in https://github.com/mosaicml/composer/pull/2761
* Fix GPU tests by mvpatel2000 in https://github.com/mosaicml/composer/pull/2767
* Fix GPU v2 by mvpatel2000 in https://github.com/mosaicml/composer/pull/2768
* Use time.tokens for speedmonitor instead of dataset length by mvpatel2000 in https://github.com/mosaicml/composer/pull/2762
* Remove BreakEpochException by mvpatel2000 in https://github.com/mosaicml/composer/pull/2759
* time to clean up time parsing 😉 by aspfohl in https://github.com/mosaicml/composer/pull/2770
* Upgrade RunConfig compute specification by aspfohl in https://github.com/mosaicml/composer/pull/2772
* Use async logging in MLflowLogger by chenmoneygithub in https://github.com/mosaicml/composer/pull/2693
* Fix FSDP _param_init_fn to not reinit parameters multiple times by dakinggg in https://github.com/mosaicml/composer/pull/2765
* Gate FSDP param init test on torch 2.1 by dakinggg in https://github.com/mosaicml/composer/pull/2774
* Parallelize OCI multipart download by coryMosaicML in https://github.com/mosaicml/composer/pull/2750
* [UCVolumes] Add support for list API by panchalhp-db in https://github.com/mosaicml/composer/pull/2769
* Add the memory timeline profiling support through the PyTorch profiler. by cli99 in https://github.com/mosaicml/composer/pull/2771
* Improve torch memory profiling arguments processing by cli99 in https://github.com/mosaicml/composer/pull/2777
* Bump aws of nccl version and enable aws platform support by willgleich in https://github.com/mosaicml/composer/pull/2776
* Extend checkpoint loading to accept a validation function by irenedea in https://github.com/mosaicml/composer/pull/2726
* Fix checkpoint validation tests for torch 1.13 by irenedea in https://github.com/mosaicml/composer/pull/2779
* Bump version to 0.17.2 by mvpatel2000 in https://github.com/mosaicml/composer/pull/2780

New Contributors
* chenmoneygithub made their first contribution in https://github.com/mosaicml/composer/pull/2693

**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.17.1...v0.17.2

What's New
Datasets version upgrade (1724)
We've upgraded the version of Hugging Face datasets library to include a fix for a common issue of the multiprocessing pool hanging after tokenization or filtering.

What's Changed
* Update accelerate requirement from <1.2,>=0.25 to >=0.25,<1.4 by dependabot in https://github.com/mosaicml/llm-foundry/pull/1714
* Bump datasets version by dakinggg in https://github.com/mosaicml/llm-foundry/pull/1724


**Full Changelog**: https://github.com/mosaicml/llm-foundry/compare/v0.17.0...v0.17.1