Mosaicml

What's New

**1. Aggregate Memory Monitoring (3042)**

The Memory Monitor callback now supports aggregating memory statistics across nodes. Getting summary stats for a run's memory usage across the cluster can dramatically help debug straggler nodes or non-homogenous workloads. The memory monitor can now aggregate and log combined values at a user specified frequency.

Example:

from composer import Trainer
from composer.callbacks import MemoryMonitor

trainer = Trainer(
model=model,
train_dataloader=train_dataloader,
optimizers=optimizer,
max_duration="1ep",
callbacks=[
MemoryMonitor(
dist_aggregate_batch_interval=10, aggregate every 10 batches
)
],
)


**2. Advanced Compression Options (3118)**

Large model checkpoints can be expensive to store and transfer. In this release, we've upgraded our compression support to accept several new formats which result in better compression-time tradeoffs using CLI tools. In order to use compression, you can post-fix your checkpoint name with a compression path. We know support the following extensions:
- bz2
- gz
- lz4
- lzma
- lzo
- xz
- zst

Example:

from composer import Trainer
from composer.callbacks import MemoryMonitor

trainer = Trainer(
model=model,
train_dataloader=train_dataloader,
optimizers=optimizer,
max_duration="1ep",
save_filename='ep{epoch}-ba{batch}-rank{rank}.pt.lz4',
)


Thank you to mbway for adding this support!

What's Changed
* Rename composer_run_name tag to run_name when logging to MLflow by jerrychen109 in https://github.com/mosaicml/composer/pull/3040
* enable aggregate mem monitoring by vchiley in https://github.com/mosaicml/composer/pull/3042
* Bump junitparser from 3.1.1 to 3.1.2 by dependabot in https://github.com/mosaicml/composer/pull/3056
* Add SHARD_GRAD_OP to device mesh error check by mvpatel2000 in https://github.com/mosaicml/composer/pull/3058
* Add torch 2.2.1 support by mvpatel2000 in https://github.com/mosaicml/composer/pull/3059
* Use testing repo actions for linting by b-chu in https://github.com/mosaicml/composer/pull/3060
* Link autoresume docs back to watchdog by aspfohl in https://github.com/mosaicml/composer/pull/3052
* Deprecate get_state and remove deprecations by b-chu in https://github.com/mosaicml/composer/pull/3017
* Bump version to 0.20.1 by mvpatel2000 in https://github.com/mosaicml/composer/pull/3061
* Remove s3_bucket pytest cli flag by b-chu in https://github.com/mosaicml/composer/pull/3064
* Remove s3_bucket flag from gpu test by b-chu in https://github.com/mosaicml/composer/pull/3065
* Clean Up OOM Observer Remote Uploader Download path by j316chuck in https://github.com/mosaicml/composer/pull/3070
* Fix daily test for iteration by b-chu in https://github.com/mosaicml/composer/pull/3068
* Remove "generation_length" in favor of "generation_kwargs" by maxisawesome in https://github.com/mosaicml/composer/pull/3014
* Bump packaging by mvpatel2000 in https://github.com/mosaicml/composer/pull/3072
* Use ci-testing repo for CPU and GPU tests by b-chu in https://github.com/mosaicml/composer/pull/3062
* Add new torch monkeypatches to Composer by mvpatel2000 in https://github.com/mosaicml/composer/pull/3063
* Add initial support for neuron devices by bfontain in https://github.com/mosaicml/composer/pull/3049
* Stripping whitespaces as default for QATask ICL eval by ksreenivasan in https://github.com/mosaicml/composer/pull/3073
* Add ICL base class to __all__ by mvpatel2000 in https://github.com/mosaicml/composer/pull/3079
* pass prelimiter into ALL ICL datasets by eitanturok in https://github.com/mosaicml/composer/pull/3069
* Bump sentencepiece from 0.1.99 to 0.2.0 by dependabot in https://github.com/mosaicml/composer/pull/3083
* Add Iteration related Events to callbacks by b-chu in https://github.com/mosaicml/composer/pull/3077
* Add Iteration related Events by b-chu in https://github.com/mosaicml/composer/pull/3076
* Bump CI/CD to v3 by mvpatel2000 in https://github.com/mosaicml/composer/pull/3086
* Add docstring to _iteration_length by b-chu in https://github.com/mosaicml/composer/pull/3088
* Check FSDP module has _device_mesh before getting it by eracah in https://github.com/mosaicml/composer/pull/3091
* Bump minor version in base image by mvpatel2000 in https://github.com/mosaicml/composer/pull/3092
* Enforce async logging flush in mlflow logger at `post_close` call by chenmoneygithub in https://github.com/mosaicml/composer/pull/3093
* Warning log to info log by aspfohl in https://github.com/mosaicml/composer/pull/3096
* Bump transformers by dakinggg in https://github.com/mosaicml/composer/pull/3095
* Change style for splitting on commas by b-chu in https://github.com/mosaicml/composer/pull/3078
* Remove slash by b-chu in https://github.com/mosaicml/composer/pull/3098
* Allowing for fractional number of samples per rank by ShashankMosaicML in https://github.com/mosaicml/composer/pull/3075
* Output eval logging (batch level) by maxisawesome in https://github.com/mosaicml/composer/pull/2977
* Replace errors with warnings for eval args by mvpatel2000 in https://github.com/mosaicml/composer/pull/3100
* Ability to load sharded checkpoints with remote symlink load_path by eracah in https://github.com/mosaicml/composer/pull/3097
* Improvements to `NeptuneLogger` by AleksanderWWW in https://github.com/mosaicml/composer/pull/3085
* Revert "Improvements to `NeptuneLogger`" by mvpatel2000 in https://github.com/mosaicml/composer/pull/3111
* Bump mlflow min pin by dakinggg in https://github.com/mosaicml/composer/pull/3110
* Fix rounding issue in interval calculation by dakinggg in https://github.com/mosaicml/composer/pull/3109
* Bump coverage[toml] from 7.4.1 to 7.4.3 by dependabot in https://github.com/mosaicml/composer/pull/3102
* Uses v0.0.4 of ci-testing by b-chu in https://github.com/mosaicml/composer/pull/3112
* Add versioned deprecation warning by irenedea in https://github.com/mosaicml/composer/pull/2984
* Update Flash Attention to 2.5.5 by Skylion007 in https://github.com/mosaicml/composer/pull/3113
* Setting the max duration to current timestamp in the same units as cu… by ShashankMosaicML in https://github.com/mosaicml/composer/pull/3090
* Making default_split_batch public by ShashankMosaicML in https://github.com/mosaicml/composer/pull/3116
* Adding log exception to Mosaic Logger by jjanezhang in https://github.com/mosaicml/composer/pull/3089
* Add checks to schedulers by b-chu in https://github.com/mosaicml/composer/pull/3115
* Removed default attrs from exception class in the attrs dict by jjanezhang in https://github.com/mosaicml/composer/pull/3126
* Bump coverage[toml] from 7.4.3 to 7.4.4 by dependabot in https://github.com/mosaicml/composer/pull/3121
* Refactor initialization by Practicinginhell in https://github.com/mosaicml/composer/pull/3127
* Bump databricks sdk version by dakinggg in https://github.com/mosaicml/composer/pull/3128
* Update packaging requirement from <23.3,>=21.3.0 to >=21.3.0,<24.1 by dependabot in https://github.com/mosaicml/composer/pull/3122
* Remove rng from save_weights_only ckpt by eracah in https://github.com/mosaicml/composer/pull/3129
* More compression options by mbway in https://github.com/mosaicml/composer/pull/3118
* Only broadcast distcp files by mvpatel2000 in https://github.com/mosaicml/composer/pull/3130
* Bump version to 0.21 by mvpatel2000 in https://github.com/mosaicml/composer/pull/3132

New Contributors
* ksreenivasan made their first contribution in https://github.com/mosaicml/composer/pull/3073
* eitanturok made their first contribution in https://github.com/mosaicml/composer/pull/3069
* Practicinginhell made their first contribution in https://github.com/mosaicml/composer/pull/3127
* mbway made their first contribution in https://github.com/mosaicml/composer/pull/3118

**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.20.1...v0.21.0

What's New

1. Torch 2.2.1 Support

Composer now supports torch 2.2.1! We've raised the pin to allow the latest torch, and we've upstreamed all torch monkeypatches so Composer can run out of the box with the latest and greatest torch features.

What's Changed
* Add torch 2.2.1 support by mvpatel2000 in https://github.com/mosaicml/composer/pull/3059
* Bump version to 0.20.1 by mvpatel2000 in https://github.com/mosaicml/composer/pull/3061

What's New

1. New Neptune Logger
Composer now supports logging training data to [neptune.ai](https://neptune.ai/) using the `NeptuneLogger`. To get started:

python
neptune_project = 'test_project'
neptune_api_token = 'test_token'

neptune_logger = NeptuneLogger(
project=neptune_project,
api_token=neptune_api_token,
rank_zero_only=False,
mode='debug',
upload_artifacts=True,
)


We also have an [example project](https://app.neptune.ai/o/showcase/org/mosaicml-composer/runs/details?viewId=standard-view&detailsTab=dashboard&dashboardId=9b1f1fae-f543-41d1-a778-8604c9b6503d&shortId=MMLCOMP-3) demonstrating all the awesome things you can do with this integration!


Additional information on the `NeptuneLogger` can be found in the [docs](https://docs.mosaicml.com/projects/composer/en/latest/api_reference/generated/composer.loggers.NeptuneLogger.html).


2. OOM observer callback with memory visualizations

Composer now has an OOM observer callback. When a model runs out of memory, this callback helps produce a trace which identifies memory allocations, which can be critical to designing strategies to mitigate memory usage.

Example:
python
from composer import Trainer
from composer.callbacks import OOMObserver
constructing trainer object with this callback
trainer = Trainer(
model=model,
train_dataloader=train_dataloader,
eval_dataloader=eval_dataloader,
optimizers=optimizer,
max_duration="1ep",
callbacks=[
OOMObserver(
folder="traces",
overwrite=true,
filename="rank{rank}_oom",
remote_filename="oci://bucket_name/{run_name}/oom_traces/rank{rank}_oom",
)
],
)


OOM Visualization:



3. Log all gpu rank stdout/err to MosaicML platform

Composer has expanded it's integration with the MosaicML platform.. Now, we can view all gpu rank stdout/stderrs with MCLI logs to enable more comprehensive analysis of jobs.

Example:


mcli logs <run-name> --node x --gpu x

Note, this defaults to node rank 0 if `--node` is not provided.

Also, we can find the logs of any global gpu rank with the command:

mcli logs <run-name> --global-gpu-rank x


Bug Fixes
* Only save RNG on rank 0 by mvpatel2000 in https://github.com/mosaicml/composer/pull/2998
* [Auto-microbatch fix] FSDP reshard and cleanup after OOM to fix the cuda memory leak by bigning in https://github.com/mosaicml/composer/pull/3030
* Fix skip_first for profiler during resumption by bigning in https://github.com/mosaicml/composer/pull/2986
* Race condition fix in checkpoint loading util by jessechancy in https://github.com/mosaicml/composer/pull/3001

What's Changed
* Remove .ci folder and move FILE_HEADER and CODEOWNERS by irenedea in https://github.com/mosaicml/composer/pull/2957
* Modify UCObjectStore.list_objects to lists all files recursively by irenedea in https://github.com/mosaicml/composer/pull/2959
* Refactor MemorySnapshot by cli99 in https://github.com/mosaicml/composer/pull/2960
* Log all gpu rank stdout/err to MosaicML platform by jjanezhang in https://github.com/mosaicml/composer/pull/2839
* Add Torch 2.2 tests by mvpatel2000 in https://github.com/mosaicml/composer/pull/2970
* Memory snapshot dump pickle by cli99 in https://github.com/mosaicml/composer/pull/2968
* Neptune logger by AleksanderWWW in https://github.com/mosaicml/composer/pull/2447
* Fix torch pins in tests by mvpatel2000 in https://github.com/mosaicml/composer/pull/2973
* Add a register_model_with_run_id api to MLflowLogger by dakinggg in https://github.com/mosaicml/composer/pull/2967
* Remove bespoke codeowners by mvpatel2000 in https://github.com/mosaicml/composer/pull/2971
* Add a BEFORE_LOAD event by snarayan21 in https://github.com/mosaicml/composer/pull/2974
* More torch 2.2 fixes by mvpatel2000 in https://github.com/mosaicml/composer/pull/2975
* Adding the step argument to logger.log_table by ShashankMosaicML in https://github.com/mosaicml/composer/pull/2961
* Fix daily tests for torch 2.2 by mvpatel2000 in https://github.com/mosaicml/composer/pull/2980
* Format load_path with name by mvpatel2000 in https://github.com/mosaicml/composer/pull/2978
* Bump to 0.19.1 by mvpatel2000 in https://github.com/mosaicml/composer/pull/2979
* Fix UC object store bugfix by nancyhung in https://github.com/mosaicml/composer/pull/2982
* [Bugfix][UC] Add back the full object path by nancyhung in https://github.com/mosaicml/composer/pull/2988
* Minor cleanup of UC get_object_size by dakinggg in https://github.com/mosaicml/composer/pull/2989
* Pin UC to earlier version by dakinggg in https://github.com/mosaicml/composer/pull/2990
* Revert "fix skip_first for resumption" by bigning in https://github.com/mosaicml/composer/pull/2991
* Broadcast files for HSDP by mvpatel2000 in https://github.com/mosaicml/composer/pull/2914
* Bump ipykernel from 6.29.0 to 6.29.2 by dependabot in https://github.com/mosaicml/composer/pull/2994
* Bump yamllint from 1.33.0 to 1.34.0 by dependabot in https://github.com/mosaicml/composer/pull/2995
* Refactor `update_metric` by maxisawesome in https://github.com/mosaicml/composer/pull/2965
* Add azure integration test by mvpatel2000 in https://github.com/mosaicml/composer/pull/2996
* Fix Profiler schedule skip_first by bigning in https://github.com/mosaicml/composer/pull/2992
* Remove planner validation by mvpatel2000 in https://github.com/mosaicml/composer/pull/2985
* Fix load for non-HSDP device mesh by mvpatel2000 in https://github.com/mosaicml/composer/pull/2997
* Update NCCL arg since torch deprecated old one by mvpatel2000 in https://github.com/mosaicml/composer/pull/3000
* Add bias argument to LPLN by mvpatel2000 in https://github.com/mosaicml/composer/pull/2999
* Revert "Add bias argument to LPLN" by mvpatel2000 in https://github.com/mosaicml/composer/pull/3003
* Revert "Update NCCL arg since torch deprecated old one" by mvpatel2000 in https://github.com/mosaicml/composer/pull/3004
* Add torch 2.3 image for aws cluster by j316chuck in https://github.com/mosaicml/composer/pull/3002
* Patch torch 2.3 aws naming by j316chuck in https://github.com/mosaicml/composer/pull/3006
* Add debug log before training loop starts by mvpatel2000 in https://github.com/mosaicml/composer/pull/3005
* Deprecate ffcv code by j316chuck in https://github.com/mosaicml/composer/pull/3007
* Remove log for mosaicml logger by mvpatel2000 in https://github.com/mosaicml/composer/pull/3008
* [EASY] Always log 1st batch when resuming training by bigning in https://github.com/mosaicml/composer/pull/3009
* Use reusable actions for linting by b-chu in https://github.com/mosaicml/composer/pull/2948
* Make CodeEval respect device_eval_batch_size by josejg in https://github.com/mosaicml/composer/pull/2969
* Use Mosaic constant for GPU file prefix by jjanezhang in https://github.com/mosaicml/composer/pull/3018
* Fall back to normal logging when gpu prefix is not present by jjanezhang in https://github.com/mosaicml/composer/pull/3020
* Revert "Use reusable actions for linting" to fix CI/CD by mvpatel2000 in https://github.com/mosaicml/composer/pull/3023
* Change to pull_request_target by b-chu in https://github.com/mosaicml/composer/pull/3025
* Bump gitpython from 3.1.41 to 3.1.42 by dependabot in https://github.com/mosaicml/composer/pull/3031
* Bump yamllint from 1.34.0 to 1.35.1 by dependabot in https://github.com/mosaicml/composer/pull/3034
* Update torchmetrics requirement from <1.3.1,>=0.10.0 to >=0.10.0,<1.3.2 by dependabot in https://github.com/mosaicml/composer/pull/3035
* Bump pypandoc from 1.12 to 1.13 by dependabot in https://github.com/mosaicml/composer/pull/3033
* Add tensorboard images support by Menduist in https://github.com/mosaicml/composer/pull/3021
* Add sorted to logs for checkpoint broadcast by mvpatel2000 in https://github.com/mosaicml/composer/pull/3036
* Friendlier device mesh error by mvpatel2000 in https://github.com/mosaicml/composer/pull/3039
* Upgrade to python3.11 for torch nightly by j316chuck in https://github.com/mosaicml/composer/pull/3038
* Download symlink once by mvpatel2000 in https://github.com/mosaicml/composer/pull/3043
* Add min size to OCI download by mvpatel2000 in https://github.com/mosaicml/composer/pull/3044
* Lint fix by mvpatel2000 in https://github.com/mosaicml/composer/pull/3045
* Revert "Change to pull_request_target " by mvpatel2000 in https://github.com/mosaicml/composer/pull/3047
* Bump composer version 0.19.2 by j316chuck in https://github.com/mosaicml/composer/pull/3048
* Update XLA support by bfontain in https://github.com/mosaicml/composer/pull/2964
* Bump composer version 0.20.0 by j316chuck in https://github.com/mosaicml/composer/pull/3051
* Update ruff. Fix PLE & LOG lints by Skylion007 in https://github.com/mosaicml/composer/pull/3050

New Contributors
* AleksanderWWW made their first contribution in https://github.com/mosaicml/composer/pull/2447
* ShashankMosaicML made their first contribution in https://github.com/mosaicml/composer/pull/2961
* nancyhung made their first contribution in https://github.com/mosaicml/composer/pull/2982
* bigning made their first contribution in https://github.com/mosaicml/composer/pull/2986
* jessechancy made their first contribution in https://github.com/mosaicml/composer/pull/3001
* josejg made their first contribution in https://github.com/mosaicml/composer/pull/2969
* Menduist made their first contribution in https://github.com/mosaicml/composer/pull/3021
* bfontain made their first contribution in https://github.com/mosaicml/composer/pull/2964

**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.19.1...v0.20.0

What's New

**1. New Event: BEFORE_LOAD (2974)**

Composer now has the events `Event.BEFORE_LOAD`, which lets users modify state before a model is loaded. This is particularly useful for accessing certain attributes which may not exist at `Event.INIT`, such as the dataloader state.

**2. Registering model in MLFlow with run id (2967)**

The MLFlow logger now has `register_model_with_run_id`, which allows users to register a model based on the run_id. This is a different way of registering the model which preserves the link to the mlflow runs.

What's Changed
* before_load event added https://github.com/mosaicml/composer/pull/2974
* Add a register_model_with_run_id api to MLflowLogger https://github.com/mosaicml/composer/pull/2967

**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.19.0...v0.19.1

What's New

1. Improved DTensor Support
Composer now supports elastic saving and loading of DTensors at various mesh sizes.

2. Checkpoint Saving and Loading from Databricks MLFlow
Composer now supports saving and loading checkpoints to Databricks-managed MLFlow.


composer_model = MyComposerModel(...)

trainer = Trainer(
model=composer_model,
save_folder= 'dbfs:/databricks/mlflow-tracking/{mlflow_experiment_id}/{mlflow_run_id}/artifacts',
logger=MLFlowLogger(...),
load_path= 'dbfs:/databricks/mlflow-tracking/{mlflow_experiment_id}/{mlflow_run_id}/artifacts',
...
)

3. Better Communication Computation Overlap in FSDP
Composer now has improved communication/computation overlap in our FSDP code which should improve MFU across several architectures.

4. Python3.11 + Torch2.2 Support
Initial support of Python3.11 + Torch2.2 added in Composer.

5. PEFT LoRA
PEFT LoRA is now supported in the HuggingFaceModel class.

6. Refactored Evaluation
`in_context_learning_evaluation.py` has a new design with cleaner abstractions and easier interfaces to work wtih.

7. Azure Checkpointing
Composer now supports saving your model in Azure.

8. MLFlow Checkpointing
Composer now supports saving your model in MLFlow.


Bug Fixes
* Fix MLFlowLogger test by ngcgarcia in https://github.com/mosaicml/composer/pull/2912
* Fix bug with CoT early stopping and LLama2 tokenizer by bmosaicml in https://github.com/mosaicml/composer/pull/2902
* Fix split_batch bug with empty generation_kwargs by maxisawesome in https://github.com/mosaicml/composer/pull/2913
* Only load RNG keys that exist by mvpatel2000 in https://github.com/mosaicml/composer/pull/2901
* Fix daily tests by mvpatel2000 in https://github.com/mosaicml/composer/pull/2891
* Fix seed for FSDP wrap by mvpatel2000 in https://github.com/mosaicml/composer/pull/2833
* Fix load_ignore_keys with rng by mvpatel2000 in https://github.com/mosaicml/composer/pull/2803
* Fix mosaicml logger on close by mvpatel2000 in https://github.com/mosaicml/composer/pull/2816
* Fix torch profiler error on close by mvpatel2000 in https://github.com/mosaicml/composer/pull/2818
* Fix import for daily test by snarayan21 in https://github.com/mosaicml/composer/pull/2826
* Fix how single value tensors are logged by aspfohl in https://github.com/mosaicml/composer/pull/2831
* Fix torch bump by j316chuck in https://github.com/mosaicml/composer/pull/2855
* Fix MPS with sequence loss by JAEarly in https://github.com/mosaicml/composer/pull/2834


What's Changed
* Bump transformers version by dakinggg in https://github.com/mosaicml/composer/pull/2781
* Bump sphinxext-opengraph from 0.9.0 to 0.9.1 by dependabot in https://github.com/mosaicml/composer/pull/2784
* Bump coverage[toml] from 7.3.0 to 7.3.3 by dependabot in https://github.com/mosaicml/composer/pull/2783
* Update torch requirement from <2.1.2,>=1.13.1 to >=1.13.1,<2.1.3 by dependabot in https://github.com/mosaicml/composer/pull/2785
* [UCVolumes] Rely on databricks-sdk auth for the right requirements by panchalhp-db in https://github.com/mosaicml/composer/pull/2789
* Enable system metrics in mosaic mlflow logger by chenmoneygithub in https://github.com/mosaicml/composer/pull/2775
* Update parse_uri by irenedea in https://github.com/mosaicml/composer/pull/2787
* default to no torch profiler memory timeline by cli99 in https://github.com/mosaicml/composer/pull/2790
* Add eot token to ICL generate kwargs by bmosaicml in https://github.com/mosaicml/composer/pull/2782
* Add nightly image for torch 2.2.0-12-20-23 by j316chuck in https://github.com/mosaicml/composer/pull/2791
* Add torch nightly 12-13 by j316chuck in https://github.com/mosaicml/composer/pull/2792
* Add process group as arg to FSDP by mvpatel2000 in https://github.com/mosaicml/composer/pull/2794
* Bump coverage[toml] from 7.3.3 to 7.3.4 by dependabot in https://github.com/mosaicml/composer/pull/2798
* Bump ipykernel from 6.26.0 to 6.28.0 by dependabot in https://github.com/mosaicml/composer/pull/2806
* Bump junitparser from 3.1.0 to 3.1.1 by dependabot in https://github.com/mosaicml/composer/pull/2805
* Bump pytest from 7.4.3 to 7.4.4 by dependabot in https://github.com/mosaicml/composer/pull/2807
* Avoid futures on close for MosaicML logger by mvpatel2000 in https://github.com/mosaicml/composer/pull/2804
* Require sync module states with HSDP by mvpatel2000 in https://github.com/mosaicml/composer/pull/2812
* Better communication computation overlap by snarayan21 in https://github.com/mosaicml/composer/pull/2811
* Improve error message for speed monitor by mvpatel2000 in https://github.com/mosaicml/composer/pull/2801
* Bump torch version -- DO NOT RELEASE by mvpatel2000 in https://github.com/mosaicml/composer/pull/2814
* Bump torchvision for nightly by mvpatel2000 in https://github.com/mosaicml/composer/pull/2815
* Correct multi-unshard stream patching for torch 2.2.0dev, and stream waiting correctness. by snarayan21 in https://github.com/mosaicml/composer/pull/2817
* Bump traitlets from 5.13.0 to 5.14.1 by dependabot in https://github.com/mosaicml/composer/pull/2822
* All unshard streams wait on computation every step by snarayan21 in https://github.com/mosaicml/composer/pull/2823
* Add encoding=utf-8 by dakinggg in https://github.com/mosaicml/composer/pull/2824
* [MLFlowObjectStore] [1/2] Base implementation for MLFlowObjectStore by jerrychen109 in https://github.com/mosaicml/composer/pull/2802
* Remove fused layernorm (already deprecated for 2 versions) by mvpatel2000 in https://github.com/mosaicml/composer/pull/2827
* checkpoint saver tracks all checkpoints/intervals in state by aspfohl in https://github.com/mosaicml/composer/pull/2819
* code-quality timeout update by aspfohl in https://github.com/mosaicml/composer/pull/2830
* Adds DTensor Support by mvpatel2000 in https://github.com/mosaicml/composer/pull/2821
* Remove duplicate checkpoint verifications by eracah in https://github.com/mosaicml/composer/pull/2828
* Remove fsdp patch for comm overlap by mvpatel2000 in https://github.com/mosaicml/composer/pull/2836
* Allow hsdp by mvpatel2000 in https://github.com/mosaicml/composer/pull/2838
* Bump torch 2.1.2 by mvpatel2000 in https://github.com/mosaicml/composer/pull/2840
* Upgrade pyright to 1.1.310 by b-chu in https://github.com/mosaicml/composer/pull/2841
* [MLFlowObjectStore] [2/2] Support checkpointing with MLFlow by jerrychen109 in https://github.com/mosaicml/composer/pull/2810
* update nightly to torch 2.3 by j316chuck in https://github.com/mosaicml/composer/pull/2842
* Pin sphinxcontrib applehelp by mvpatel2000 in https://github.com/mosaicml/composer/pull/2854
* Torch 2.3 patch by dakinggg in https://github.com/mosaicml/composer/pull/2849
* Update mosaicml-cli requirement from <0.6,>=0.5.25 to >=0.5.25,<0.7 by dependabot in https://github.com/mosaicml/composer/pull/2866
* Rewrite to use individual state functions by mvpatel2000 in https://github.com/mosaicml/composer/pull/2860
* Add custom stopping criteria to ICL generate tasks by bmosaicml in https://github.com/mosaicml/composer/pull/2800
* Add save_ignore_keys by mvpatel2000 in https://github.com/mosaicml/composer/pull/2868
* Remome log debug by mvpatel2000 in https://github.com/mosaicml/composer/pull/2871
* Update monkeypatch to put barrier in optim load by mvpatel2000 in https://github.com/mosaicml/composer/pull/2874
* Remove toml by b-chu in https://github.com/mosaicml/composer/pull/2872
* Update license by b-chu in https://github.com/mosaicml/composer/pull/2875
* Add ignore_metrics field to the MLflow logger by ngcgarcia in https://github.com/mosaicml/composer/pull/2869
* Convert print to log.info by mvpatel2000 in https://github.com/mosaicml/composer/pull/2876
* Bump version to 0.18.0 by irenedea in https://github.com/mosaicml/composer/pull/2877
* Removed commented-out unshard streams patching. by snarayan21 in https://github.com/mosaicml/composer/pull/2873
* Make code quality workflow reusable by b-chu in https://github.com/mosaicml/composer/pull/2878
* Bump gitpython from 3.1.40 to 3.1.41 by dependabot in https://github.com/mosaicml/composer/pull/2885
* Bump torchmetrics by mvpatel2000 in https://github.com/mosaicml/composer/pull/2890
* Bump transformers to 4.37 by dakinggg in https://github.com/mosaicml/composer/pull/2894
* Azure checkpointing support by mvpatel2000 in https://github.com/mosaicml/composer/pull/2893
* Pass PG into checkpoint load and load rng with state_dict by mvpatel2000 in https://github.com/mosaicml/composer/pull/2897
* Remove monkeypatch and new state dict APIs for torch 2.2 by mvpatel2000 in https://github.com/mosaicml/composer/pull/2899
* Bump version to 0.18.1 by b-chu in https://github.com/mosaicml/composer/pull/2905
* Refactor in_context_learning_evaluation.py by maxisawesome in https://github.com/mosaicml/composer/pull/2713
* Fix FP8 checkpoint resumption with onnx export flag by j316chuck in https://github.com/mosaicml/composer/pull/2907
* Add Python 3.11 + FA 2.5.0 + Torch 2.3.0 Image by KuuCi in https://github.com/mosaicml/composer/pull/2898
* Add yamllint to pre commit by b-chu in https://github.com/mosaicml/composer/pull/2909
* Add ignore_hyperparameters to MLFlowLogger by ngcgarcia in https://github.com/mosaicml/composer/pull/2908
* Bump coverage[toml] from 7.3.4 to 7.4.1 by dependabot in https://github.com/mosaicml/composer/pull/2915
* Add checkpoint test for 0.18.1 by b-chu in https://github.com/mosaicml/composer/pull/2906
* Integrate PEFT LoRA with HuggingFaceModel by dakinggg in https://github.com/mosaicml/composer/pull/2829

New Contributors
* jerrychen109 made their first contribution in https://github.com/mosaicml/composer/pull/2802
* JAEarly made their first contribution in https://github.com/mosaicml/composer/pull/2834
* maxisawesome made their first contribution in https://github.com/mosaicml/composer/pull/2713

**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.17.2...v0.19.0

Bug Fixes
* Fix lp layernorm weight by snarayan21 in https://github.com/mosaicml/composer/pull/2954

What's Changed
* Fix lp layernorm weight by snarayan21 in https://github.com/mosaicml/composer/pull/2954
* Bump version to 0.18.2 by b-chu

**Full Changelog**: https://github.com/mosaicml/composer/compare/v0.18.1...v0.18.2