Friendli-client

Latest version: v1.5.6

Safety actively analyzes 681866 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 7

1.5.6

- Update package dependencies with security warnings.
- Hotfix on `friendli endpoint list` command.
- Update styling for `AWAKING` and `UPDATING` endpoint status
- Fix descriptions of `friendli api` command: `--model` option is required for inference call.

1.5.5

- gRPC client support using the soft prompt.
- Resolve dependency issues.
- Update GraphQL schemas to handle resources of Friendli Dedicated Endpoints.

1.5.4

- `text-to-image` API is removed from the CLI command.
- Support cancelling gRPC stream.

1.5.3

- Support stream close and context manager.
- API E2E tests are added.

1.5.2

- Hotfix: Automatically close streaming response at the end of the stream.

1.5.1

Now it is available to use API calls to Friendli Dedicated Endpoints.

python
from friendli import Friendli

client = Friendli(use_dedicated_endpoint=True)
chat = client.chat.completions.create(
model="{endpoint_id}",
messages=[
{
"role": "user",
"content": "Give three tips for staying healthy.",
}
]
)


If you want to send a request to a specific adapter of the Multi-LoRA endpoint, provide "{endpoint_id}:{adapter_route}" to `model` argument:

python
from friendli import Friendli

client = Friendli(use_dedicated_endpoint=True)
chat = client.chat.completions.create(
model="{endpoint_id}:{adapter_route}",
messages=[
{
"role": "user",
"content": "Give three tips for staying healthy.",
}
]
)

Page 1 of 7

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.