Litgpt

What's Changed
* Update LitData to latest version 0.2.16 by awaelchli in https://github.com/Lightning-AI/litgpt/pull/1573
* Fixed warning during model download and conversion. by bhargavyagnik in https://github.com/Lightning-AI/litgpt/pull/1574
* Bump lightning version by awaelchli in https://github.com/Lightning-AI/litgpt/pull/1579
* chat/base.py: extend checkpoint_dir before accessing it by Andrei-Aksionov in https://github.com/Lightning-AI/litgpt/pull/1575
* Chat: dynamically set kv-cache size by Andrei-Aksionov in https://github.com/Lightning-AI/litgpt/pull/1583
* Add slow interconnect warning by rasbt in https://github.com/Lightning-AI/litgpt/pull/1577
* Mathstral checkpoints by rasbt in https://github.com/Lightning-AI/litgpt/pull/1587
* Make sure quantization is used correctly by rasbt in https://github.com/Lightning-AI/litgpt/pull/1585
* Improve mathstral tests by rasbt in https://github.com/Lightning-AI/litgpt/pull/1589
* Fixes an issue where the LitGPT Python API was consuming too much memory by rasbt in https://github.com/Lightning-AI/litgpt/pull/1590
* Increase version number for 0.4.5 release by rasbt in https://github.com/Lightning-AI/litgpt/pull/1591

New Contributors
* bhargavyagnik made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1574

**Full Changelog**: https://github.com/Lightning-AI/litgpt/compare/v0.4.4...v0.4.5

What's Changed
* Tokenizer: fix issue when decoding a single token at a time by Andrei-Aksionov in https://github.com/Lightning-AI/litgpt/pull/1559
* Filter out false positive PyTorch scheduler warning by rasbt in https://github.com/Lightning-AI/litgpt/pull/1562
* Add an explanation on how to evaluate on a custom test set by rasbt in https://github.com/Lightning-AI/litgpt/pull/1564
* Remove duplicated bos_token for CodeLlama by alealv in https://github.com/Lightning-AI/litgpt/pull/1566
* Fix SFTDataset sample generation by alealv in https://github.com/Lightning-AI/litgpt/pull/1568
* Add Python API section to 0 to LitGPT docs by rasbt in https://github.com/Lightning-AI/litgpt/pull/1570
* Fix multi-turn prompting error handling and extra newline by apaz-cli in https://github.com/Lightning-AI/litgpt/pull/1569
* Add automatic downloading to CLI by rasbt in https://github.com/Lightning-AI/litgpt/pull/1571
* Bumb version for 0.4.4 release by rasbt in https://github.com/Lightning-AI/litgpt/pull/1572

New Contributors
* alealv made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1566
* apaz-cli made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1569

**Full Changelog**: https://github.com/Lightning-AI/litgpt/compare/v0.4.3...v0.4.4

What's Changed
* Fix Twine Build Issue by rasbt in https://github.com/Lightning-AI/litgpt/pull/1530
* Fix Mixtral prompt style by janEbert in https://github.com/Lightning-AI/litgpt/pull/1531
* Raise warning when loading a large model on a CPU device by rasbt in https://github.com/Lightning-AI/litgpt/pull/1532
* Tutorial `convert_from_litgpt` doc fix to remove `output_dir` command argument by jentfoo in https://github.com/Lightning-AI/litgpt/pull/1533
* Test against eager attention on GPTNeoX by rasbt in https://github.com/Lightning-AI/litgpt/pull/1537
* Bump to 0.4.3.dev0 version by rasbt in https://github.com/Lightning-AI/litgpt/pull/1536
* Fix for LM Eval harness 0.4.3 by rasbt in https://github.com/Lightning-AI/litgpt/pull/1542
* Add `Phi-3-mini-4k-instruct` checkpoint by rasbt in https://github.com/Lightning-AI/litgpt/pull/1341
* Update phi-3 prompt template by rasbt in https://github.com/Lightning-AI/litgpt/pull/1544
* Add progress bar for weight loading by rasbt in https://github.com/Lightning-AI/litgpt/pull/1534
* Remove redundant code in checkpoint conversion script by rasbt in https://github.com/Lightning-AI/litgpt/pull/1547
* Update how evaluate tasks are listed by rasbt in https://github.com/Lightning-AI/litgpt/pull/1550
* Fix generate issue in finetuning script when finetuning with small datasets by rasbt in https://github.com/Lightning-AI/litgpt/pull/1551
* Tokenizer: check that `bos` and `eos` tokens are applied w.r.t. to a provided config/args by Andrei-Aksionov in https://github.com/Lightning-AI/litgpt/pull/1527
* Add num_nodes argument by janEbert in https://github.com/Lightning-AI/litgpt/pull/1546
* Add Phi-3 Configs by rasbt in https://github.com/Lightning-AI/litgpt/pull/1553
* Update to version 0.4.3 for new release by rasbt in https://github.com/Lightning-AI/litgpt/pull/1554

New Contributors
* janEbert made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1531
* jentfoo made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1533

**Full Changelog**: https://github.com/Lightning-AI/litgpt/compare/v0.4.2...v0.4.3

What's Changed
* Disable "validating ..." comment if initial_validation is False by rasbt in https://github.com/Lightning-AI/litgpt/pull/1499
* Add simple issue templates by rasbt in https://github.com/Lightning-AI/litgpt/pull/1501
* Add note about dependencies by rasbt in https://github.com/Lightning-AI/litgpt/pull/1502
* Update test_readme.py by Andrei-Aksionov in https://github.com/Lightning-AI/litgpt/pull/1505
* Print message when unnecessary can't be deleted by rasbt in https://github.com/Lightning-AI/litgpt/pull/1507
* Bumb version by rasbt in https://github.com/Lightning-AI/litgpt/pull/1509
* LitGPT Python API v1 by rasbt in https://github.com/Lightning-AI/litgpt/pull/1463
* Fix pip upgrade command on windows by rasbt in https://github.com/Lightning-AI/litgpt/pull/1513
* add `LLM.generate` with streaming by aniketmaurya in https://github.com/Lightning-AI/litgpt/pull/1511
* Fix and update Python API docs by rasbt in https://github.com/Lightning-AI/litgpt/pull/1514
* Update LLM import and make stream/non-stream option consistent by rasbt in https://github.com/Lightning-AI/litgpt/pull/1515
* Extend Python API to initialize model with random weights by rasbt in https://github.com/Lightning-AI/litgpt/pull/1512
* Add Python API download option by rasbt in https://github.com/Lightning-AI/litgpt/pull/1516
* Add Rope group size as constexpr to fix thunder tests by rasbt in https://github.com/Lightning-AI/litgpt/pull/1520
* Explain how to access pretraining dataset options by rasbt in https://github.com/Lightning-AI/litgpt/pull/1510
* Bump thunder by rasbt in https://github.com/Lightning-AI/litgpt/pull/1519
* Add automatic checkpoint downloading in Python API by rasbt in https://github.com/Lightning-AI/litgpt/pull/1521
* Tokenizer: prefer HF Tokenizer by Andrei-Aksionov in https://github.com/Lightning-AI/litgpt/pull/1518
* iterate response from streaming server by aniketmaurya in https://github.com/Lightning-AI/litgpt/pull/1523
* Add new python API to readme by williamFalcon in https://github.com/Lightning-AI/litgpt/pull/1525
* Remove `init="local"` option by rasbt in https://github.com/Lightning-AI/litgpt/pull/1524
* Readme improvements by rasbt in https://github.com/Lightning-AI/litgpt/pull/1526
* Add `evaluate` to Readme by rasbt in https://github.com/Lightning-AI/litgpt/pull/1528


**Full Changelog**: https://github.com/Lightning-AI/litgpt/compare/v0.4.1...v0.4.2

What's Changed
* Fix typos in Download Model Weights documentation by rasbt in https://github.com/Lightning-AI/litgpt/pull/1477
* 'Add models' docs by rasbt in https://github.com/Lightning-AI/litgpt/pull/1478
* Exclude prompt from generated response by rasbt in https://github.com/Lightning-AI/litgpt/pull/1485
* Make litgpt serve consistent with LitServe by rasbt in https://github.com/Lightning-AI/litgpt/pull/1466
* add multi turn prompt by aniketmaurya in https://github.com/Lightning-AI/litgpt/pull/1487
* Add docs explaining the streaming mode by rasbt in https://github.com/Lightning-AI/litgpt/pull/1484
* Fix Mistral 7B v0.3 weight download by davmacario in https://github.com/Lightning-AI/litgpt/pull/1486
* Fixes for latest lm_eval by rasbt in https://github.com/Lightning-AI/litgpt/pull/1489
* bugfix: LLM generated text with containing `{KEY}` would result in error by aniketmaurya in https://github.com/Lightning-AI/litgpt/pull/1490
* Add SAMBA to project gallery by rasbt in https://github.com/Lightning-AI/litgpt/pull/1493
* Add `resume="auto"` by awaelchli in https://github.com/Lightning-AI/litgpt/pull/1492
* Fix imports by rasbt in https://github.com/Lightning-AI/litgpt/pull/1491
* Pin NumPy version by rasbt in https://github.com/Lightning-AI/litgpt/pull/1495
* Version bump for new release to fix NumPy issue by rasbt in https://github.com/Lightning-AI/litgpt/pull/1496


**Full Changelog**: https://github.com/Lightning-AI/litgpt/compare/v0.4.0...v0.4.1

What's Changed
* Set litdata < 0.2.6 by carmocca in https://github.com/Lightning-AI/litgpt/pull/1400
* Remove per-file CLIs by carmocca in https://github.com/Lightning-AI/litgpt/pull/1397
* Simillar -> Similar by rasbt in https://github.com/Lightning-AI/litgpt/pull/1405
* LitData: set `iterate_over_all` to False for `CombinedStreamingDataset` by Andrei-Aksionov in https://github.com/Lightning-AI/litgpt/pull/1404
* Allow multiline prompts by rasbt in https://github.com/Lightning-AI/litgpt/pull/1279
* Explain dataset options by rasbt in https://github.com/Lightning-AI/litgpt/pull/1407
* Support `no_sync` with Thunder FSDP by carmocca in https://github.com/Lightning-AI/litgpt/pull/1414
* Minimal Python example by rasbt in https://github.com/Lightning-AI/litgpt/pull/1410
* Fix bug where LitData doesn't use seed by bradfordlynch in https://github.com/Lightning-AI/litgpt/pull/1425
* Add prompt style mapping for llama3 by davmacario in https://github.com/Lightning-AI/litgpt/pull/1406
* Simplify code by rasbt in https://github.com/Lightning-AI/litgpt/pull/1429
* OptimizerArgs by rasbt in https://github.com/Lightning-AI/litgpt/pull/1409
* Fix optimizer init with fused=True by carmocca in https://github.com/Lightning-AI/litgpt/pull/1434
* Fix learning rate calculation in pretrain by rasbt in https://github.com/Lightning-AI/litgpt/pull/1435
* Align readme by rasbt in https://github.com/Lightning-AI/litgpt/pull/1438
* Pin litdata by rasbt in https://github.com/Lightning-AI/litgpt/pull/1440
* Fix README.md alignment by rasbt in https://github.com/Lightning-AI/litgpt/pull/1439
* Update README.md for one last time by rasbt in https://github.com/Lightning-AI/litgpt/pull/1442
* A more centered look by rasbt in https://github.com/Lightning-AI/litgpt/pull/1449
* New CLI by rasbt in https://github.com/Lightning-AI/litgpt/pull/1437
* Update error message by rasbt in https://github.com/Lightning-AI/litgpt/pull/1453
* Explain how to list all available models by rasbt in https://github.com/Lightning-AI/litgpt/pull/1455
* Detect tensor cores by rasbt in https://github.com/Lightning-AI/litgpt/pull/1456
* Check checkpoint_dir and add `checkpoints` to path by rasbt in https://github.com/Lightning-AI/litgpt/pull/1454
* Add MicroLlama training support by keeeeenw in https://github.com/Lightning-AI/litgpt/pull/1457
* Streaming for serving with chat's generate function by rasbt in https://github.com/Lightning-AI/litgpt/pull/1426
* Fix sequence length bug by rasbt in https://github.com/Lightning-AI/litgpt/pull/1462
* Add `lr_warmup_steps`, `max_steps` values validation by shenxiangzhuang in https://github.com/Lightning-AI/litgpt/pull/1460
* Fix issue where path in merge_lora is overwritten by rasbt in https://github.com/Lightning-AI/litgpt/pull/1465
* Option to skip expensive final validation by rasbt in https://github.com/Lightning-AI/litgpt/pull/1372
* Allow batch size "auto" setting in evaluate by rasbt in https://github.com/Lightning-AI/litgpt/pull/1469
* Warn users when there is a bnb mismatch by rasbt in https://github.com/Lightning-AI/litgpt/pull/1468
* Allow batch argument with batch recomputation by rasbt in https://github.com/Lightning-AI/litgpt/pull/1470
* LitGPT Python API draft by rasbt in https://github.com/Lightning-AI/litgpt/pull/1459
* Bump version for PyPI release by rasbt in https://github.com/Lightning-AI/litgpt/pull/1476

New Contributors
* bradfordlynch made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1425
* davmacario made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1406
* keeeeenw made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1457

**Full Changelog**: https://github.com/Lightning-AI/litgpt/compare/v0.3.1...v0.4.0