Tensor-parallel

This release marks a huge improvement in dealing with replicated parameters and automatic parameters synchronization. The `Sharded` class has been made private and it's functions have been hidden by the modules' interfaces, making it easier to deal with.

Backwards compatibility with older version has been maintained with warnings notifying about changes in interfaces and deprecations.

What's Changed
* ZeRO-3 refactoring (sharding) by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/106


**Full Changelog**: https://github.com/BlackSamorez/tensor_parallel/compare/v1.3.2...v2.0.0

What's Changed
* Forwarding _prepare_model_inputs by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/113


**Full Changelog**: https://github.com/BlackSamorez/tensor_parallel/compare/v1.3.1...v1.3.2

What's Changed
* Testing interfaces (soon to be refactored) by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/109
* Fix get_llama_config adding model attribute error. by tonywang16 in https://github.com/BlackSamorez/tensor_parallel/pull/108
* find_predefined_tensor_parallel_config try-except fix by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/110

New Contributors
* tonywang16 made their first contribution in https://github.com/BlackSamorez/tensor_parallel/pull/108

**Full Changelog**: https://github.com/BlackSamorez/tensor_parallel/compare/v1.3.0...v1.3.1

What's Changed
* explicitly choose whether or not to use torch.distribute by tomoki0924 in https://github.com/BlackSamorez/tensor_parallel/pull/100
* Gpt2 fix by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/103

New Contributors
* tomoki0924 made their first contribution in https://github.com/BlackSamorez/tensor_parallel/pull/100

**Full Changelog**: https://github.com/BlackSamorez/tensor_parallel/compare/v1.2.9...v1.3.0

What's Changed
* readme fixes by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/93
* LLaMA-2 by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/101
* Version bump by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/102


**Full Changelog**: https://github.com/BlackSamorez/tensor_parallel/compare/v1.2.8...v1.2.9

What's Changed
* Falcon lm_head split hotfix by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/92


**Full Changelog**: https://github.com/BlackSamorez/tensor_parallel/compare/v1.2.7...v1.2.8