Llmdk

Latest version: v1.2410.3

Safety actively analyzes 681812 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

1.2410.1

- Moved common `generate()` logic to `LlmInterface` base class for improved code reuse
- Introduced `_execute_request()` method to be implemented by subclasses, enhancing extensibility
- Removed duplicate code from provider-specific classes, reducing maintenance overhead
- Made `model_name` optional in `LlmInterface` for more flexible initialization
- Transitioned from `setup.py` to `pyproject.toml` for modern Python packaging
- Updated version import in `__init__.py` for consistent versioning
- Implemented streaming functionality across all supported providers
- Updated README with streaming examples and improved usage instructions for better developer experience
- Refactored `LlmInterface` to support both `generate` and `stream` methods, providing a unified API
- Removed vLLM provider since vLLM servers run preferably with the OpenAI-compatible API
- Updated imports, improved type hints and error handling for increased robustness

1.2410.0

- Update all provider classes to use a unified `generate` method signature
- Add support for system prompts and pre-defined message lists
- Implement flexible kwargs handling for provider-specific options
- Replace `max_tokens` and `temperature` params with more generic approach
- Update type hints and imports across all provider files
- Improve error handling and default values in provider initializations
- Standardize payload construction and API call patterns
- Remove unused parameters and simplify client instantiations

Links

Releases

Has known vulnerabilities

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.