Litgpt

What's Changed
* Post-release setup for 0.5.3.dev1 by rasbt in https://github.com/Lightning-AI/litgpt/pull/1799
* Add Phi 3 128k model by deveworld in https://github.com/Lightning-AI/litgpt/pull/1800
* Add token counts to compute performance by rasbt in https://github.com/Lightning-AI/litgpt/pull/1801
* Fixed the issue that precision is always "32-true". by jianpingw in https://github.com/Lightning-AI/litgpt/pull/1802
* Add Nvidia Llama 3.1 70B Nemotron weights by rasbt in https://github.com/Lightning-AI/litgpt/pull/1803
* Choose evaluation example from test set by rasbt in https://github.com/Lightning-AI/litgpt/pull/1804
* Pretrain tok sec by rasbt in https://github.com/Lightning-AI/litgpt/pull/1805
* typo in convert_to_litgpt command by wasifferoze in https://github.com/Lightning-AI/litgpt/pull/1807
* Move distributed all_reduce import into a function by IvanYashchuk in https://github.com/Lightning-AI/litgpt/pull/1810
* Remove hardcoded 32-precision conversion by rasbt in https://github.com/Lightning-AI/litgpt/pull/1814

New Contributors
* deveworld made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1800
* jianpingw made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1802
* wasifferoze made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1807
* IvanYashchuk made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1810

**Full Changelog**: https://github.com/Lightning-AI/litgpt/compare/v0.5.2...v0.5.3

What's Changed
* Fix prompt style usage in evaluation example by rasbt in https://github.com/Lightning-AI/litgpt/pull/1790
* Pin to PyTorch 2.4.1 by rasbt in https://github.com/Lightning-AI/litgpt/pull/1796
* Fix step iteration bug in finetuning scripts by rasbt in https://github.com/Lightning-AI/litgpt/pull/1794
* Housekeeping: remove unused code and fix tests by rasbt in https://github.com/Lightning-AI/litgpt/pull/1795


**Full Changelog**: https://github.com/Lightning-AI/litgpt/compare/v0.5.1...v0.5.2

What's Changed

What's Changed
* Post 0.4.13 release set up by rasbt in https://github.com/Lightning-AI/litgpt/pull/1755
* Add missing explanation on how to use a finetuned model by rasbt in https://github.com/Lightning-AI/litgpt/pull/1756
* Bump lightning version to latest stable release (2.4.0) by rasbt in https://github.com/Lightning-AI/litgpt/pull/1765
* Improve rope by rasbt in https://github.com/Lightning-AI/litgpt/pull/1745
* Add bnb.nn.StableEmbedding for quantized training by rasbt in https://github.com/Lightning-AI/litgpt/pull/1770
* [fix][1760] Added fix for the missing `context` key issue in dolly! by pytholic in https://github.com/Lightning-AI/litgpt/pull/1766
* Fix Llama 3.2 tokenizer by rasbt in https://github.com/Lightning-AI/litgpt/pull/1772

New Contributors
* pytholic made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1766

**Full Changelog**: https://github.com/Lightning-AI/litgpt/compare/v0.4.13...v0.5.0

What's Changed
* Make 0.4.13.dev1 version by rasbt in https://github.com/Lightning-AI/litgpt/pull/1722
* Enable MPS support for LitGPT by rasbt in https://github.com/Lightning-AI/litgpt/pull/1724
* Simplify MPS support by rasbt in https://github.com/Lightning-AI/litgpt/pull/1726
* Add Chainlit Studio by rasbt in https://github.com/Lightning-AI/litgpt/pull/1728
* Fixing the tokenizer for slimpajama data preparation by tomaslaz in https://github.com/Lightning-AI/litgpt/pull/1734
* Add pretrain conversion by rasbt in https://github.com/Lightning-AI/litgpt/pull/1735
* Typo fix and formatting improvements in API Trainer docs by rasbt in https://github.com/Lightning-AI/litgpt/pull/1736
* bump macos to m1 by t-vi in https://github.com/Lightning-AI/litgpt/pull/1725
* Improve filepath handling in unit tests by rasbt in https://github.com/Lightning-AI/litgpt/pull/1737
* Add a more informative message in case text exceeds context size by rasbt in https://github.com/Lightning-AI/litgpt/pull/1738
* Update Thunder README.md by rasbt in https://github.com/Lightning-AI/litgpt/pull/1740
* Add sliding window attention to Mistral and Phi 3 by rasbt in https://github.com/Lightning-AI/litgpt/pull/1741
* Extend context length for sliding window tests by rasbt in https://github.com/Lightning-AI/litgpt/pull/1742
* Fix jsonarparse version by rasbt in https://github.com/Lightning-AI/litgpt/pull/1748
* Update RoPE tests by rasbt in https://github.com/Lightning-AI/litgpt/pull/1746
* Make json parsing more robust by rasbt in https://github.com/Lightning-AI/litgpt/pull/1749
* Support for optimizers which don't have "fused" parameter such as grokadamw and 8bit bnb by mtasic85 in https://github.com/Lightning-AI/litgpt/pull/1744
* Increase rtol and atol in Gemma 2 for macOS by rasbt in https://github.com/Lightning-AI/litgpt/pull/1751
* Repair json files by rasbt in https://github.com/Lightning-AI/litgpt/pull/1752
* Llama 3.2 weights by rasbt in https://github.com/Lightning-AI/litgpt/pull/1750
* Bump version to 0.4.13 for new release by rasbt in https://github.com/Lightning-AI/litgpt/pull/1753
* Temporarily take out thunder dependency for deployment by rasbt in https://github.com/Lightning-AI/litgpt/pull/1754

New Contributors
* tomaslaz made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1734
* mtasic85 made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1744

**Full Changelog**: https://github.com/Lightning-AI/litgpt/compare/v0.4.12...v0.4.13

What's Changed
* Preserve eos in encoding when max_seq_length = -1 by sanderland in https://github.com/Lightning-AI/litgpt/pull/1694
* Add `batched_next_token()` and `batched_sample()` by apaz-cli in https://github.com/Lightning-AI/litgpt/pull/1693
* bump thunder dependency to main by t-vi in https://github.com/Lightning-AI/litgpt/pull/1701
* add support for batched input_pos to model by t-vi in https://github.com/Lightning-AI/litgpt/pull/1700
* Add `batched_generate_fn()` by apaz-cli in https://github.com/Lightning-AI/litgpt/pull/1702
* minor Readme update/typos by Borda in https://github.com/Lightning-AI/litgpt/pull/1710
* Fix device Error in Decode Stream by Motsepe-Jr in https://github.com/Lightning-AI/litgpt/pull/1707
* Temporarily remove MPS device support by rasbt in https://github.com/Lightning-AI/litgpt/pull/1718
* Add uvloop as a dependency by rasbt in https://github.com/Lightning-AI/litgpt/pull/1719
* Change default precision on macOS by rasbt in https://github.com/Lightning-AI/litgpt/pull/1720
* Bump for v0.4.12 by rasbt in https://github.com/Lightning-AI/litgpt/pull/1721

New Contributors
* Motsepe-Jr made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1707

**Full Changelog**: https://github.com/Lightning-AI/litgpt/compare/v0.4.11...v0.4.12