Mlx-textgen

Latest version: v0.1.10

The latest version of mlx-textgen with no known security vulnerabilities is 0.1.10. We recommend installing version 0.1.10.

The information on this page was curated by experts in our Cybersecurity Intelligence Team.

Latest release: v0.1.10 at Dec. 11, 2024
License: MIT (MIT License)

Description

An OpenAI-compatible API LLM engine with smart prompt caching, batch processing, structured output with guided decoding, and function calling for all models using MLX.

Resources

PyPi

Vulnerabilities

See all vulnerabilities

No known vulnerabilities found

Versions (16)

See all versions

Has known vulnerabilities

0.1.10
0.1.9
0.1.8
0.1.7
0.1.5
0.1.4
0.1.3
0.1.2
0.1.1
0.1.0
0.0.6
0.0.5
0.0.4
0.0.3
0.0.2
0.0.1