Mlora

**Full Changelog**: https://github.com/mikecovlee/mLoRA/compare/0.3.5...0.3.5.post1

What's Changed
* Enhance API of m-LoRA by mikecovlee in https://github.com/scukdde-llm/mLoRA/pull/70
* Make notebook can run directly with colab by mikecovlee in https://github.com/scukdde-llm/mLoRA/pull/71
* Fix adapter init by mikecovlee in https://github.com/scukdde-llm/mLoRA/pull/72


**Full Changelog**: https://github.com/scukdde-llm/mLoRA/compare/0.3.4...0.3.5

What's Changed
* Remove Medical QA, Modify Documents by mikecovlee in https://github.com/scukdde-llm/mLoRA/pull/57
* Fix performance of LoRA Function on non-apple devices by mikecovlee in https://github.com/scukdde-llm/mLoRA/pull/59
* Support ChatGLM by mikecovlee in https://github.com/scukdde-llm/mLoRA/pull/60
* Refactoring by mikecovlee in https://github.com/scukdde-llm/mLoRA/pull/62
* Synchronize patches of DoRA from PEFT by mikecovlee in https://github.com/scukdde-llm/mLoRA/pull/63
* Add Dockerfile by mikecovlee in https://github.com/scukdde-llm/mLoRA/pull/66
* Support Flash Attention for ChatGLM by mikecovlee in https://github.com/scukdde-llm/mLoRA/pull/67
* GLM4 support by Filtee in https://github.com/scukdde-llm/mLoRA/pull/68


**Full Changelog**: https://github.com/scukdde-llm/mLoRA/compare/0.3.3...0.3.4

What's Changed
* remove xformers by mikecovlee in https://github.com/scukdde-llm/mLoRA/pull/52
* Fix router loss of switch transformers by mikecovlee in https://github.com/scukdde-llm/mLoRA/pull/55
* Update Requirements by mikecovlee in https://github.com/scukdde-llm/mLoRA/pull/56


**Full Changelog**: https://github.com/scukdde-llm/mLoRA/compare/0.3.2...0.3.3

What's Changed
* Fix CI and update docs by mikecovlee in https://github.com/scukdde-llm/mlora/pull/48
* Support Medical QA Datasets by mikecovlee in https://github.com/scukdde-llm/mlora/pull/50
* Optimize the Performance of MixLoRA by mikecovlee in https://github.com/scukdde-llm/mlora/pull/51


**Full Changelog**: https://github.com/scukdde-llm/mlora/compare/0.3.1...0.3.2

What's Changed
* fix tokenizer by mikecovlee in https://github.com/scukdde-llm/mlora/pull/43
* Support More LoRA MoEs by mikecovlee in https://github.com/scukdde-llm/mlora/pull/44
* Support SIQA, HellaSwag and WinoGrande Dataset by mikecovlee in https://github.com/scukdde-llm/mlora/pull/47
* Fix Load Balance Loss of MixLoRA by mikecovlee in https://github.com/scukdde-llm/mlora/pull/46


**Full Changelog**: https://github.com/scukdde-llm/mlora/compare/0.3.0.post1...0.3.1