Litgpt

What's Changed
* Disable "validating ..." comment if initial_validation is False by rasbt in https://github.com/Lightning-AI/litgpt/pull/1499
* Add simple issue templates by rasbt in https://github.com/Lightning-AI/litgpt/pull/1501
* Add note about dependencies by rasbt in https://github.com/Lightning-AI/litgpt/pull/1502
* Update test_readme.py by Andrei-Aksionov in https://github.com/Lightning-AI/litgpt/pull/1505
* Print message when unnecessary can't be deleted by rasbt in https://github.com/Lightning-AI/litgpt/pull/1507
* Bumb version by rasbt in https://github.com/Lightning-AI/litgpt/pull/1509
* LitGPT Python API v1 by rasbt in https://github.com/Lightning-AI/litgpt/pull/1463
* Fix pip upgrade command on windows by rasbt in https://github.com/Lightning-AI/litgpt/pull/1513
* add `LLM.generate` with streaming by aniketmaurya in https://github.com/Lightning-AI/litgpt/pull/1511
* Fix and update Python API docs by rasbt in https://github.com/Lightning-AI/litgpt/pull/1514
* Update LLM import and make stream/non-stream option consistent by rasbt in https://github.com/Lightning-AI/litgpt/pull/1515
* Extend Python API to initialize model with random weights by rasbt in https://github.com/Lightning-AI/litgpt/pull/1512
* Add Python API download option by rasbt in https://github.com/Lightning-AI/litgpt/pull/1516
* Add Rope group size as constexpr to fix thunder tests by rasbt in https://github.com/Lightning-AI/litgpt/pull/1520
* Explain how to access pretraining dataset options by rasbt in https://github.com/Lightning-AI/litgpt/pull/1510
* Bump thunder by rasbt in https://github.com/Lightning-AI/litgpt/pull/1519
* Add automatic checkpoint downloading in Python API by rasbt in https://github.com/Lightning-AI/litgpt/pull/1521
* Tokenizer: prefer HF Tokenizer by Andrei-Aksionov in https://github.com/Lightning-AI/litgpt/pull/1518
* iterate response from streaming server by aniketmaurya in https://github.com/Lightning-AI/litgpt/pull/1523
* Add new python API to readme by williamFalcon in https://github.com/Lightning-AI/litgpt/pull/1525
* Remove `init="local"` option by rasbt in https://github.com/Lightning-AI/litgpt/pull/1524
* Readme improvements by rasbt in https://github.com/Lightning-AI/litgpt/pull/1526
* Add `evaluate` to Readme by rasbt in https://github.com/Lightning-AI/litgpt/pull/1528


**Full Changelog**: https://github.com/Lightning-AI/litgpt/compare/v0.4.1...v0.4.2

What's Changed
* Fix typos in Download Model Weights documentation by rasbt in https://github.com/Lightning-AI/litgpt/pull/1477
* 'Add models' docs by rasbt in https://github.com/Lightning-AI/litgpt/pull/1478
* Exclude prompt from generated response by rasbt in https://github.com/Lightning-AI/litgpt/pull/1485
* Make litgpt serve consistent with LitServe by rasbt in https://github.com/Lightning-AI/litgpt/pull/1466
* add multi turn prompt by aniketmaurya in https://github.com/Lightning-AI/litgpt/pull/1487
* Add docs explaining the streaming mode by rasbt in https://github.com/Lightning-AI/litgpt/pull/1484
* Fix Mistral 7B v0.3 weight download by davmacario in https://github.com/Lightning-AI/litgpt/pull/1486
* Fixes for latest lm_eval by rasbt in https://github.com/Lightning-AI/litgpt/pull/1489
* bugfix: LLM generated text with containing `{KEY}` would result in error by aniketmaurya in https://github.com/Lightning-AI/litgpt/pull/1490
* Add SAMBA to project gallery by rasbt in https://github.com/Lightning-AI/litgpt/pull/1493
* Add `resume="auto"` by awaelchli in https://github.com/Lightning-AI/litgpt/pull/1492
* Fix imports by rasbt in https://github.com/Lightning-AI/litgpt/pull/1491
* Pin NumPy version by rasbt in https://github.com/Lightning-AI/litgpt/pull/1495
* Version bump for new release to fix NumPy issue by rasbt in https://github.com/Lightning-AI/litgpt/pull/1496


**Full Changelog**: https://github.com/Lightning-AI/litgpt/compare/v0.4.0...v0.4.1

What's Changed
* Set litdata < 0.2.6 by carmocca in https://github.com/Lightning-AI/litgpt/pull/1400
* Remove per-file CLIs by carmocca in https://github.com/Lightning-AI/litgpt/pull/1397
* Simillar -> Similar by rasbt in https://github.com/Lightning-AI/litgpt/pull/1405
* LitData: set `iterate_over_all` to False for `CombinedStreamingDataset` by Andrei-Aksionov in https://github.com/Lightning-AI/litgpt/pull/1404
* Allow multiline prompts by rasbt in https://github.com/Lightning-AI/litgpt/pull/1279
* Explain dataset options by rasbt in https://github.com/Lightning-AI/litgpt/pull/1407
* Support `no_sync` with Thunder FSDP by carmocca in https://github.com/Lightning-AI/litgpt/pull/1414
* Minimal Python example by rasbt in https://github.com/Lightning-AI/litgpt/pull/1410
* Fix bug where LitData doesn't use seed by bradfordlynch in https://github.com/Lightning-AI/litgpt/pull/1425
* Add prompt style mapping for llama3 by davmacario in https://github.com/Lightning-AI/litgpt/pull/1406
* Simplify code by rasbt in https://github.com/Lightning-AI/litgpt/pull/1429
* OptimizerArgs by rasbt in https://github.com/Lightning-AI/litgpt/pull/1409
* Fix optimizer init with fused=True by carmocca in https://github.com/Lightning-AI/litgpt/pull/1434
* Fix learning rate calculation in pretrain by rasbt in https://github.com/Lightning-AI/litgpt/pull/1435
* Align readme by rasbt in https://github.com/Lightning-AI/litgpt/pull/1438
* Pin litdata by rasbt in https://github.com/Lightning-AI/litgpt/pull/1440
* Fix README.md alignment by rasbt in https://github.com/Lightning-AI/litgpt/pull/1439
* Update README.md for one last time by rasbt in https://github.com/Lightning-AI/litgpt/pull/1442
* A more centered look by rasbt in https://github.com/Lightning-AI/litgpt/pull/1449
* New CLI by rasbt in https://github.com/Lightning-AI/litgpt/pull/1437
* Update error message by rasbt in https://github.com/Lightning-AI/litgpt/pull/1453
* Explain how to list all available models by rasbt in https://github.com/Lightning-AI/litgpt/pull/1455
* Detect tensor cores by rasbt in https://github.com/Lightning-AI/litgpt/pull/1456
* Check checkpoint_dir and add `checkpoints` to path by rasbt in https://github.com/Lightning-AI/litgpt/pull/1454
* Add MicroLlama training support by keeeeenw in https://github.com/Lightning-AI/litgpt/pull/1457
* Streaming for serving with chat's generate function by rasbt in https://github.com/Lightning-AI/litgpt/pull/1426
* Fix sequence length bug by rasbt in https://github.com/Lightning-AI/litgpt/pull/1462
* Add `lr_warmup_steps`, `max_steps` values validation by shenxiangzhuang in https://github.com/Lightning-AI/litgpt/pull/1460
* Fix issue where path in merge_lora is overwritten by rasbt in https://github.com/Lightning-AI/litgpt/pull/1465
* Option to skip expensive final validation by rasbt in https://github.com/Lightning-AI/litgpt/pull/1372
* Allow batch size "auto" setting in evaluate by rasbt in https://github.com/Lightning-AI/litgpt/pull/1469
* Warn users when there is a bnb mismatch by rasbt in https://github.com/Lightning-AI/litgpt/pull/1468
* Allow batch argument with batch recomputation by rasbt in https://github.com/Lightning-AI/litgpt/pull/1470
* LitGPT Python API draft by rasbt in https://github.com/Lightning-AI/litgpt/pull/1459
* Bump version for PyPI release by rasbt in https://github.com/Lightning-AI/litgpt/pull/1476

New Contributors
* bradfordlynch made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1425
* davmacario made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1406
* keeeeenw made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1457

**Full Changelog**: https://github.com/Lightning-AI/litgpt/compare/v0.3.1...v0.4.0

What's Changed
* Streaming for serving with chat's generate function by rasbt in [1426](https://github.com/Lightning-AI/litgpt/pull/1426)
* Add MicroLlama training support by keeeeenw in [1457](https://github.com/Lightning-AI/litgpt/pull/1457)
* Check checkpoint_dir and add `checkpoints` to path by rasbt in [1454](https://github.com/Lightning-AI/litgpt/pull/1454)
* Detect tensor cores by rasbt in [1456](https://github.com/Lightning-AI/litgpt/pull/1456)
* Explain how to list all available models by rasbt in [1455](https://github.com/Lightning-AI/litgpt/pull/1455)
* Update error message by rasbt in [1453](https://github.com/Lightning-AI/litgpt/pull/1453)
* New CLI by rasbt in [1437](https://github.com/Lightning-AI/litgpt/pull/1437)
* A more centered look by rasbt in [1449](https://github.com/Lightning-AI/litgpt/pull/1449)
* Update README.md for one last time by rasbt in [1442](https://github.com/Lightning-AI/litgpt/pull/1442)
* Fix README.md alignment by rasbt in [1439](https://github.com/Lightning-AI/litgpt/pull/1439)
* Pin litdata by rasbt in [1440](https://github.com/Lightning-AI/litgpt/pull/1440)
* Align readme by rasbt in [1438](https://github.com/Lightning-AI/litgpt/pull/1438)
* Fix learning rate calculation in pretrain by rasbt in [1435](https://github.com/Lightning-AI/litgpt/pull/1435)
* Fix optimizer init with fused=True by carmocca in [1434](https://github.com/Lightning-AI/litgpt/pull/1434)
* OptimizerArgs by rasbt in [1409](https://github.com/Lightning-AI/litgpt/pull/1409)
* Simplify code by rasbt in [1429](https://github.com/Lightning-AI/litgpt/pull/1429)
* Add prompt style mapping for llama3 by davmacario in [1406](https://github.com/Lightning-AI/litgpt/pull/1406)
* Fix bug where LitData doesn't use seed by bradfordlynch in [1425](https://github.com/Lightning-AI/litgpt/pull/1425)
* Minimal Python example by rasbt in [1410](https://github.com/Lightning-AI/litgpt/pull/1410)
* Support `no_sync` with Thunder FSDP by carmocca in [1414](https://github.com/Lightning-AI/litgpt/pull/1414)
* Explain dataset options by rasbt in [1407](https://github.com/Lightning-AI/litgpt/pull/1407)
* Allow multiline prompts by rasbt in [1279](https://github.com/Lightning-AI/litgpt/pull/1279)
* LitData: set `iterate_over_all` to False for `CombinedStreamingDataset` by Andrei-Aksionov in [1404](https://github.com/Lightning-AI/litgpt/pull/1404)
* Simillar -> Similar by rasbt in [1405](https://github.com/Lightning-AI/litgpt/pull/1405)
* Remove per-file CLIs by carmocca in [1397](https://github.com/Lightning-AI/litgpt/pull/1397)
* Set litdata < 0.2.6 by carmocca in [1400](https://github.com/Lightning-AI/litgpt/pull/1400)

**Full Changelog**: [View on GitHub](https://github.com/Lightning-AI/litgpt/commits/0.4.0.dev0)