Tensor-parallel

Latest version: v2.0.0

Safety actively analyzes 688792 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 3 of 4

1.2.1

What's Changed
* Set seed for tests reproducibility by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/64
* Mention linear speedup in Readme by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/65
* LLaMa models by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/53


**Full Changelog**: https://github.com/BlackSamorez/tensor_parallel/compare/v1.2.0...v1.2.1

1.2.0

Config refactoring

`state_actions` are now interfaces:

class StateAction(ABC):
abstractclassmethod
def __call__(self, tensor: Tensor, rank: int) -> Tensor:
pass

abstractclassmethod
def undo(self, tensors: Sequence[Tensor]) -> Tensor:
pass


Callables and tuples of callables are still allowed but will produce deprecation warning.

**Full Changelog**: https://github.com/BlackSamorez/tensor_parallel/compare/v1.1.4...v1.2.0

1.1.4

What's Changed
* CodeGen config by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/61
* Added int8 LLMs demo link by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/62
* Converting state dicts without model creation by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/60


**Full Changelog**: https://github.com/BlackSamorez/tensor_parallel/compare/v1.1.3...v1.1.4

1.1.3

What's Changed
* Unpersistent buffers meta loading fix by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/57
* _reorder_cache fix for generation utils by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/56
* Shard parameters initial dispatch fix by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/58
* New version for dispatch hotfix by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/59


**Full Changelog**: https://github.com/BlackSamorez/tensor_parallel/compare/v1.1.1...v1.1.3

1.1.1

What's Changed
* GPT NeoX config by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/55
* Removing accelerate hooks before splitting the model by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/52
* Meta devices support by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/54


**Full Changelog**: https://github.com/BlackSamorez/tensor_parallel/compare/v1.1.0...v1.1.1

1.1.0

What's Changed
* Fixed PyPi link in readme by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/40
* Adding support for more model architectures by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/47
* Replace architecture with model_type by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/44
* Saving utilities by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/49
* Version update by BlackSamorez in https://github.com/BlackSamorez/tensor_parallel/pull/50


**Full Changelog**: https://github.com/BlackSamorez/tensor_parallel/compare/v1.0.25...v1.1.0

Page 3 of 4

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.