Onnxruntime-genai

Latest version: v0.3.0

Safety actively analyzes 641872 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

0.3.0

Release Notes
* Phi3-Vision model support for DML EP.
* Addressed DML memory leak issue and crashes on long prompts.
* Addressed crashes and slowness on CPU EP GQA on long prompts dur to integer overflow issues.
* Added the import lib for windows C API package.
* Addressed a bug with `get_output('logits')` so that it returns the logits for the entire prompt and not for the last generated token.
* Addressed a bug with querying the device type of the model so that it won't crash.
* Added NetStandard 2.0 compatibility.

0.3.0rc2

Release Notes
* Added support for the Phi-3-Vision model.
* Added support for the Phi-3-Small model.
* Removed usage of `std::filesystem` to avoid runtime issues when loading incompatible symbols from stdc++ and stdc++fs.

Links

Releases

Has known vulnerabilities

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.