Aibrix

Automatically generated release for tag v0.1.0-rc.5.

What's Changed
* [doc] update runtime readme by brosoul in https://github.com/aibrix/aibrix/pull/318
* Add env for routing strategy override by varungup90 in https://github.com/aibrix/aibrix/pull/323
* Fix pod autoscaler enqueue issues by Jeffwan in https://github.com/aibrix/aibrix/pull/329
* Autoscaling benchmark by kr11 in https://github.com/aibrix/aibrix/pull/337
* Initial lora benchmark result by Jeffwan in https://github.com/aibrix/aibrix/pull/321
* Adding plotting script by happyandslow in https://github.com/aibrix/aibrix/pull/338
* Update the downloader performance plot by Jeffwan in https://github.com/aibrix/aibrix/pull/341
* Reduce pod metrics refresh interval by varungup90 in https://github.com/aibrix/aibrix/pull/343
* Enable ipv6 for envoy proxy by varungup90 in https://github.com/aibrix/aibrix/pull/342
* Add benchmark scrips for gateway client side changes by Jeffwan in https://github.com/aibrix/aibrix/pull/340
* Update the plots based on feedback by Jeffwan in https://github.com/aibrix/aibrix/pull/346
* [batch] use volcano TOS as batch storage by xinchen384 in https://github.com/aibrix/aibrix/pull/344
* Add check if no pods are present by varungup90 in https://github.com/aibrix/aibrix/pull/345
* Add model exists check by varungup90 in https://github.com/aibrix/aibrix/pull/353
* [Misc] Disable fastapi docs in runtime default action by brosoul in https://github.com/aibrix/aibrix/pull/350
* Add check for acceptable routing strategies by varungup90 in https://github.com/aibrix/aibrix/pull/352
* optimize PA messages: const 'HPA' -> actual pa type by kr11 in https://github.com/aibrix/aibrix/pull/354
* [Misc] Runtime server startup with args by brosoul in https://github.com/aibrix/aibrix/pull/355
* [Misc] Add python format script by brosoul in https://github.com/aibrix/aibrix/pull/357
* optimize benchmark scripts for autoscaler, add more logs by kr11 in https://github.com/aibrix/aibrix/pull/356
* Update the mocked app to cleaner state by Jeffwan in https://github.com/aibrix/aibrix/pull/361
* Update manifests & docs about service httproute naming trick by Jeffwan in https://github.com/aibrix/aibrix/pull/362
* Add reference grant to support httprouting for different namespace by varungup90 in https://github.com/aibrix/aibrix/pull/347
* Validate routing strategy bug fix by varungup90 in https://github.com/aibrix/aibrix/pull/364
* Bug fix for setting routing strategy via env var by varungup90 in https://github.com/aibrix/aibrix/pull/369
* Improve the routing env value & flag retrieval by Jeffwan in https://github.com/aibrix/aibrix/pull/373
* Sync main branch changes to release-0.1 branch by Jeffwan in https://github.com/aibrix/aibrix/pull/375
* Cut v0.1.0-rc.5 release by Jeffwan in https://github.com/aibrix/aibrix/pull/376


**Full Changelog**: https://github.com/aibrix/aibrix/compare/v0.1.0-rc.4...v0.1.0-rc.5

What's Changed

* [Misc] Add sync images step and scripts in release process by Jeffwan in https://github.com/aibrix/aibrix/pull/283
* [batch] E2E works with driver and request proxy by xinchen384 in https://github.com/aibrix/aibrix/pull/272
* Fix address already in use when AIRuntime start in pod by brosoul in https://github.com/aibrix/aibrix/pull/289
* Read model name from request body by varungup90 in https://github.com/aibrix/aibrix/pull/290
* Fix redis bootstrap flaky connection issue by varungup90 in https://github.com/aibrix/aibrix/pull/293
* skip docs CI if no changes in /docs dir by varungup90 in https://github.com/aibrix/aibrix/pull/294
* Improve Rayclusterreplicaset Status by Yicheng-Lu-llll in https://github.com/aibrix/aibrix/pull/295
* Add request trace for profiling by varungup90 in https://github.com/aibrix/aibrix/pull/291
* Update the crd definiton due to runtime upgrade by Jeffwan in https://github.com/aibrix/aibrix/pull/298
* Push images to Github registry in release pipeline by Jeffwan in https://github.com/aibrix/aibrix/pull/301
* Build autoscaler abstractions like fetcher, client and scaler by Jeffwan in https://github.com/aibrix/aibrix/pull/300
* Support pod autoscaler periodically check by Jeffwan in https://github.com/aibrix/aibrix/pull/306
* Add timeout in nc check for redis bootstrap by varungup90 in https://github.com/aibrix/aibrix/pull/309
* Refactor AutoScaler: metricClient, context, reconcile by kr11 in https://github.com/aibrix/aibrix/pull/308
* Cut v0.1.0-rc.4 release by Jeffwan in https://github.com/aibrix/aibrix/pull/314

New Contributors
* Yicheng-Lu-llll made their first contribution in https://github.com/aibrix/aibrix/pull/295

**Full Changelog**: https://github.com/aibrix/aibrix/compare/v0.1.0-rc.3...v0.1.0-rc.4

Automatically generated release for tag v0.1.0-rc.3.

What's Changed
* Add model adapter and multi-node inference docs by Jeffwan in https://github.com/aibrix/aibrix/pull/222
* add gateway docs by varungup90 in https://github.com/aibrix/aibrix/pull/232
* [Misc] add Runtime dependency for hf_transfer by brosoul in https://github.com/aibrix/aibrix/pull/240
* Add validation for username and rpm/tpm negative value by varungup90 in https://github.com/aibrix/aibrix/pull/241
* [CI] Merge python wheel publish process to release build pipeline by brosoul in https://github.com/aibrix/aibrix/pull/247
* [CI] Push images to Github container registry by Jeffwan in https://github.com/aibrix/aibrix/pull/246
* [CI] Fix post-submit container push failure by Jeffwan in https://github.com/aibrix/aibrix/pull/249
* [Misc] Infer model name from model_uri and check AWS credential by brosoul in https://github.com/aibrix/aibrix/pull/250
* [Misc ]Add runtime api metrics by brosoul in https://github.com/aibrix/aibrix/pull/251
* [doc] Update release/contribution/quickstart docs by Jeffwan in https://github.com/aibrix/aibrix/pull/242
* [batch] job FIFO scheduler as baseline by xinchen384 in https://github.com/aibrix/aibrix/pull/231
* [Misc] Improve the installation component sequence by Jeffwan in https://github.com/aibrix/aibrix/pull/252
* Fix concurrency issue with gateway RPM plugin by varungup90 in https://github.com/aibrix/aibrix/pull/244
* Improve model adapter reliability and stability by Jeffwan in https://github.com/aibrix/aibrix/pull/257
* Remove underscore from dir names and remove account word in rate limiter by varungup90 in https://github.com/aibrix/aibrix/pull/271
* [Misc] Use klog as the logr implementation by Jeffwan in https://github.com/aibrix/aibrix/pull/264
* [CI] Unify Dockerfile names and simplify the build scripts by Jeffwan in https://github.com/aibrix/aibrix/pull/263
* Improve model adapter reconcile workflow stability by Jeffwan in https://github.com/aibrix/aibrix/pull/260
* Add container override for images by varungup90 in https://github.com/aibrix/aibrix/pull/273
* Add AIBrix Custom Autoscaling Algorithm APA by kr11 in https://github.com/aibrix/aibrix/pull/223
* Use vllm metrics for routing by varungup90 in https://github.com/aibrix/aibrix/pull/274
* Update random routing section and add support for anonymous user by varungup90 in https://github.com/aibrix/aibrix/pull/276
* Add image build details and examples for multi-host inference by Jeffwan in https://github.com/aibrix/aibrix/pull/278
* Cut v0.1.0-rc.3 release by Jeffwan in https://github.com/aibrix/aibrix/pull/280


**Full Changelog**: https://github.com/aibrix/aibrix/compare/v0.1.0-rc.2...v0.1.0-rc.3

Automatically generated release for tag v0.1.0-rc.2.

What's Changed
* Fix kubeConfig redefined issue and update imagePullPolicy by Jeffwan in https://github.com/aibrix/aibrix/pull/158
* Add expectation lib to allows us to set and wait on expectations by Jeffwan in https://github.com/aibrix/aibrix/pull/164
* Add routing algorithms by varungup90 in https://github.com/aibrix/aibrix/pull/143
* Add readthedocs configuration for CI builds and update theme by Jeffwan in https://github.com/aibrix/aibrix/pull/169
* Add RayClusterReplicaSet initial implementation by Jeffwan in https://github.com/aibrix/aibrix/pull/165
* Add template page for the docs by Jeffwan in https://github.com/aibrix/aibrix/pull/170
* Remove myst_parser from sphinx extensions by Jeffwan in https://github.com/aibrix/aibrix/pull/172
* Update quickstart in the doc by Jeffwan in https://github.com/aibrix/aibrix/pull/174
* Metric standardizing in ai runtime by brosoul in https://github.com/aibrix/aibrix/pull/163
* [Misc] Rename env in runtime by brosoul in https://github.com/aibrix/aibrix/pull/176
* Add readiness check for redis in gateway plugin by varungup90 in https://github.com/aibrix/aibrix/pull/173
* [batch] job manager handles job state transition by xinchen384 in https://github.com/aibrix/aibrix/pull/180
* Add users CRUD API by varungup90 in https://github.com/aibrix/aibrix/pull/181
* Add routing for model adapter by varungup90 in https://github.com/aibrix/aibrix/pull/183
* Add installation tests and refactor some CI jobs by Jeffwan in https://github.com/aibrix/aibrix/pull/188
* Add release pipeline for images and manifests by Jeffwan in https://github.com/aibrix/aibrix/pull/189
* [Docs] Update Readme on project intro by xieus in https://github.com/aibrix/aibrix/pull/191
* [CI] Add AI Runtime test case by brosoul in https://github.com/aibrix/aibrix/pull/197
* Add AI Runtime exist model check by brosoul in https://github.com/aibrix/aibrix/pull/198
* Implement rayclusterfleet controller by Jeffwan in https://github.com/aibrix/aibrix/pull/194
* klog Level Standardization by kr11 in https://github.com/aibrix/aibrix/pull/202
* Fix RayClusterReplicaSet e2e running issues by Jeffwan in https://github.com/aibrix/aibrix/pull/200
* Add lora adapter management API by brosoul in https://github.com/aibrix/aibrix/pull/201
* Add kuberay manifest as installation dependencies by Jeffwan in https://github.com/aibrix/aibrix/pull/203
* [doc] fix autoscaling readme by kr11 in https://github.com/aibrix/aibrix/pull/215
* [doc] update runtime feature doc by brosoul in https://github.com/aibrix/aibrix/pull/216
* Fix the annotation missing issue for ray workload by Jeffwan in https://github.com/aibrix/aibrix/pull/218
* [CI]: Add python test on different python version by brosoul in https://github.com/aibrix/aibrix/pull/219
* Add Autoscaling Tutorials in format of rst by kr11 in https://github.com/aibrix/aibrix/pull/225
* [Misc] Check AI Runtime download env settings by brosoul in https://github.com/aibrix/aibrix/pull/221
* Cut v0.1.0-rc.2 release by Jeffwan in https://github.com/aibrix/aibrix/pull/226

New Contributors
* xieus made their first contribution in https://github.com/aibrix/aibrix/pull/191

**Full Changelog**: https://github.com/aibrix/aibrix/compare/v0.1.0-rc.1...v0.1.0-rc.2

What's Changed
* Add common project documents and skeleton folders by Jeffwan in https://github.com/aibrix/aibrix/pull/4
* Scaffolding aibrix project using kubebuilder by Jeffwan in https://github.com/aibrix/aibrix/pull/17
* Optimize project layouts by moving controllers to pkg folder by Jeffwan in https://github.com/aibrix/aibrix/pull/21
* Create Lora api and controller by Jeffwan in https://github.com/aibrix/aibrix/pull/23
* Rename LoraAdapter to ModelAdapter by Jeffwan in https://github.com/aibrix/aibrix/pull/25
* Add ModelAdapter API by Jeffwan in https://github.com/aibrix/aibrix/pull/26
* Use better way to set up controller with Manager by Jeffwan in https://github.com/aibrix/aibrix/pull/27
* Initial model adapter controller implementation by Jeffwan in https://github.com/aibrix/aibrix/pull/32
* Add mocked model container for lora adapter fast prototyping by Jeffwan in https://github.com/aibrix/aibrix/pull/33
* [Misc] Add the PR and issues template by jsw-zorro in https://github.com/aibrix/aibrix/pull/38
* [Docs] Add example to run vLLM distributed inference using Ray by Jeffwan in https://github.com/aibrix/aibrix/pull/39
* [Doc] Improve the model adapter mock service by Jeffwan in https://github.com/aibrix/aibrix/pull/45
* [Misc] Simplify the feature/bug/enhancement template. by jsw-zorro in https://github.com/aibrix/aibrix/pull/48
* [Misc] Make model adapter controller e2e work by Jeffwan in https://github.com/aibrix/aibrix/pull/50
* [Docs] A draft version of the contributing guideline document by kr11 in https://github.com/aibrix/aibrix/pull/47
* [Core] Improve model adapter controller by handling existing resources by Jeffwan in https://github.com/aibrix/aibrix/pull/54
* [Feat] Initial Implementation of PodAutoscaler Reconciler by kr11 in https://github.com/aibrix/aibrix/pull/55
* [Docs] Move the sample mocked application to common folder by Jeffwan in https://github.com/aibrix/aibrix/pull/64
* [Misc] Minor refactor the PodAutoscaler codes by Jeffwan in https://github.com/aibrix/aibrix/pull/68
* [Core] Add model router controller by varungup90 in https://github.com/aibrix/aibrix/pull/57
* Add rbac rules in model router by varungup90 in https://github.com/aibrix/aibrix/pull/71
* [bugs] Add autoscaler RBAC to successfully list horizontalpodautoscalers by kr11 in https://github.com/aibrix/aibrix/pull/72
* [Misc] Update license info; Add license check by happyandslow in https://github.com/aibrix/aibrix/pull/73
* add github workflow to lint & test code by M00nF1sh in https://github.com/aibrix/aibrix/pull/74
* [CI] Fix the golang lint issues by Jeffwan in https://github.com/aibrix/aibrix/pull/77
* [CI] fix the failures from make test by Jeffwan in https://github.com/aibrix/aibrix/pull/80
* [Misc] Add code-generator and openapi-gen as dependencies by Jeffwan in https://github.com/aibrix/aibrix/pull/59
* [Misc] Reconcile hpa, kpa and apa separately by Jeffwan in https://github.com/aibrix/aibrix/pull/83
* [feat] Add rpm/tpm extension proc plugin by varungup90 in https://github.com/aibrix/aibrix/pull/79
* Add kpa scale algorithm implementation by kr11 in https://github.com/aibrix/aibrix/pull/87
* Add host override to query specific pod by varungup90 in https://github.com/aibrix/aibrix/pull/86
* [Core] init aibrix runtime framework by brosoul in https://github.com/aibrix/aibrix/pull/88
* Support kpa/apa autoscaling workflow part I by Jeffwan in https://github.com/aibrix/aibrix/pull/85
* Fix Dockerfile Packaging Issues Related to Go Version and Missing Utils by kr11 in https://github.com/aibrix/aibrix/pull/92
* Autoscaling Workflow Enhancement - Part 2 by kr11 in https://github.com/aibrix/aibrix/pull/94
* Add custom CRD clientset by varungup90 in https://github.com/aibrix/aibrix/pull/97
* Autoscaling Workflow Enhancement - Part 3 by kr11 in https://github.com/aibrix/aibrix/pull/101
* [Core] Add Downloader implementation for runtime by brosoul in https://github.com/aibrix/aibrix/pull/96
* Add RayClusterReplicaSet and RayClusterFleet apis by Jeffwan in https://github.com/aibrix/aibrix/pull/103
* Apply crd:maxDescLen=0 in manifest generation by Jeffwan in https://github.com/aibrix/aibrix/pull/108
* Apply filter to objects owned by model adapters by varungup90 in https://github.com/aibrix/aibrix/pull/111
* Add custom cache and interface for model adapter scheduling by varungup90 in https://github.com/aibrix/aibrix/pull/100
* Refactor gateway package by varungup90 in https://github.com/aibrix/aibrix/pull/112
* BatchAPI storage component together with test by xinchen384 in https://github.com/aibrix/aibrix/pull/104
* Update the installation guidance and README.md by Jeffwan in https://github.com/aibrix/aibrix/pull/115
* [CI] Package AI Runtime by brosoul in https://github.com/aibrix/aibrix/pull/118
* Add gateway installation by varungup90 in https://github.com/aibrix/aibrix/pull/122
* [CI] Support container image build and push in CI by Jeffwan in https://github.com/aibrix/aibrix/pull/120
* [CI] Fix nightly image push error by Jeffwan in https://github.com/aibrix/aibrix/pull/127
* [Bug] Fix download bugs during download benchmark by brosoul in https://github.com/aibrix/aibrix/pull/134
* Autoscaling Workflow Enhancement - Part 4: Integrating MetricClient into Autoscaling Workflow by kr11 in https://github.com/aibrix/aibrix/pull/116
* Update make generate by varungup90 in https://github.com/aibrix/aibrix/pull/132
* Model adapter controller improvement and refactor by Jeffwan in https://github.com/aibrix/aibrix/pull/135
* Improve the aibrix installation scripts by Jeffwan in https://github.com/aibrix/aibrix/pull/141
* [CI] Support python package publish by brosoul in https://github.com/aibrix/aibrix/pull/138
* Fix some typo and naming issues by Jeffwan in https://github.com/aibrix/aibrix/pull/150
* Fix gateway bootstrap issues by varungup90 in https://github.com/aibrix/aibrix/pull/154
* Add kubeconfig flag for cache initialization by varungup90 in https://github.com/aibrix/aibrix/pull/155
* Using sphinx to generate html pages for our project static site by xinchen384 in https://github.com/aibrix/aibrix/pull/153
* Add finalizer and handle the model unload requests by Jeffwan in https://github.com/aibrix/aibrix/pull/152

New Contributors
* jsw-zorro made their first contribution in https://github.com/aibrix/aibrix/pull/38
* happyandslow made their first contribution in https://github.com/aibrix/aibrix/pull/73
* M00nF1sh made their first contribution in https://github.com/aibrix/aibrix/pull/74

**Full Changelog**: https://github.com/aibrix/aibrix/commits/v0.1.0-rc.1