Panml

What's changed

wanoz
- updated tokenizer to set with proper pad token
- suppress fast tokenizer warning upon setting tokenizer prior to training

What's changed

wanoz
- fixed issue with tokenzier padding not set and not saved
- updated setup.py

What's changed

Major release

wanoz
- added text generation streaming for OpenAI
- refactored import dependencies to manage package imports related to each base level LLM class
- refactored folder structure to reduce one middle layer
- refactored default LoRA argument values
- fixed LoRA exception catching variable
- minor update in readme
- added RedPajama 7b models
- added Dolly models
- updated setup.py to increment to major change

What's changed

wanoz
- added loRA methods for fine tuning
- added Bloom and more GPT-Neo variants models
- minor comments update
- minor fix of missing type hinting in ModelPack's model_args argument
- minor update of readme intro wording
- fixed spelling mistakes in error message

What's changed

wanoz
- updated readme intro sections for added clarity
- updated setup.py

What's changed

wanoz
- fixed bug where input argument for predict function was not working with list variables
- updated setup.py