Latest version: v0.1.1
The information on this page was curated by experts in our Cybersecurity Intelligence Team.
The OpenAI Load Balancer is a Python library designed to distribute API requests across multiple endpoints (supports both OpenAI and Azure OpenAI). It implements a round-robin mechanism for load balancing and includes exponential backoff for retrying failed requests.
No known vulnerabilities found