Mlora

What's Changed
* fix tokenizer by mikecovlee in https://github.com/scukdde-llm/mlora/pull/43
* Support More LoRA MoEs by mikecovlee in https://github.com/scukdde-llm/mlora/pull/44
* Support SIQA, HellaSwag and WinoGrande Dataset by mikecovlee in https://github.com/scukdde-llm/mlora/pull/47
* Fix Load Balance Loss of MixLoRA by mikecovlee in https://github.com/scukdde-llm/mlora/pull/46


**Full Changelog**: https://github.com/scukdde-llm/mlora/compare/0.3.0.post1...0.3.1

What's Changed
* Support LLaMA 3 by mikecovlee in https://github.com/scukdde-llm/mlora/pull/42


**Full Changelog**: https://github.com/scukdde-llm/mlora/compare/0.3.0...0.3.0.post1

What's Changed
* Support Phi and Gemma models, refactoring framework by mikecovlee in https://github.com/scukdde-llm/mlora/pull/29
* Support cpu as backend by mikecovlee in https://github.com/scukdde-llm/mlora/pull/32
* Reads hidden act from configuration by mikecovlee in https://github.com/scukdde-llm/mlora/pull/31
* Improve inference experience by mikecovlee in https://github.com/scukdde-llm/mlora/pull/33
* Fix Tokenizer by mikecovlee in https://github.com/scukdde-llm/mlora/pull/34
* fix mmlu evaluator by mikecovlee in https://github.com/scukdde-llm/mlora/pull/38
* Fix bugs by mikecovlee in https://github.com/scukdde-llm/mlora/pull/39


**Full Changelog**: https://github.com/scukdde-llm/mlora/compare/0.2.1.post1...0.3.0

What's Changed
* Support Phi and Gemma models, refactoring framework by mikecovlee in https://github.com/scukdde-llm/mlora/pull/29
* Support CPU as backend by mikecovlee in https://github.com/scukdde-llm/mlora/pull/32


**Full Changelog**: https://github.com/scukdde-llm/mlora/compare/0.2.1.post1...0.3.0.dev1

**Full Changelog**: https://github.com/scukdde-llm/mlora/compare/0.2.1...0.2.1.post1

What's Changed
* Classification by mikecovlee in https://github.com/scukdde-llm/mlora/pull/5
* fix bug, add dropout by mikecovlee in https://github.com/scukdde-llm/mlora/pull/6
* Integrate evaluation methods and supports for LLaMA compatible models by mikecovlee in https://github.com/scukdde-llm/mlora/pull/7
* update with tudb:main, remove old componments by mikecovlee in https://github.com/scukdde-llm/mlora/pull/8
* Support DoRA by mikecovlee in https://github.com/scukdde-llm/mlora/pull/11
* Update MixLoRA by mikecovlee in https://github.com/scukdde-llm/mlora/pull/9
* improve dora performance by mikecovlee in https://github.com/scukdde-llm/mlora/pull/12
* sync useful changes from improve_mixlora by mikecovlee in https://github.com/scukdde-llm/mlora/pull/13
* Bugfix by mikecovlee in https://github.com/scukdde-llm/mlora/pull/14
* Integrated Evaluate Methods by mikecovlee in https://github.com/scukdde-llm/mlora/pull/10
* support lora+ by mikecovlee in https://github.com/scukdde-llm/mlora/pull/15
* Lora variance by mikecovlee in https://github.com/scukdde-llm/mlora/pull/16
* Refractor attention into separate block, support flash attention. by mikecovlee in https://github.com/scukdde-llm/mlora/pull/17
* Apple MPS Support by mikecovlee in https://github.com/scukdde-llm/mlora/pull/18
* Fix Checkpoint Recompute on Apple MPS by mikecovlee in https://github.com/scukdde-llm/mlora/pull/19
* Update Documents by mikecovlee in https://github.com/scukdde-llm/mlora/pull/20
* Support Windows by mikecovlee in https://github.com/scukdde-llm/mlora/pull/21
* performance: add batch lora function by mikecovlee in https://github.com/scukdde-llm/mlora/pull/22
* Fix CI Scripts by mikecovlee in https://github.com/scukdde-llm/mlora/pull/24


**Full Changelog**: https://github.com/scukdde-llm/mlora/commits/0.2.1