Aibrix

Automatically generated release for tag v0.2.0.

🚀 New Features Highlights
- **Distributed KV Cache**: Implemented support for managing KV cache across multiple nodes, enhancing performance.
- **Cost-Driven Heterogenous Serving**: Improved scheduling and inference strategies for mixed GPU environments, optimizing cost and resource utilization. (371 430, 509, 598, 554, 598)
- **Optimizer Based Autoscaling**: Leverage offline profiles of inference server to calculate the number of replicas. (430, 500, 692, 508)
- **Prefix Cache Aware Routing**: Added support for routing decisions based on prefix cache hits, improving inference efficiency. (641, 657)

📊 Feature Enhancements
- **LoRA Scheduling Enhancements**: Introduced multiple scheduling strategies, including bin packing, least latency, least throughput, and random. (544)
- **Prefix Cache Aware Routing**: Added support for routing decisions based on prefix cache hits, improving inference efficiency. (641)
- **Gateway Enhancements**: Improved request handling efficiency by enabling streaming in the Envoy gateway. (377) Enhanced the handling of model registration and invalid cache scenarios. (542), Introduced fallback strategies to ensure robust request allocation. (445) Optimized cache store retrieval, reducing unnecessary overhead. (639) Addressed missing Prometheus config preventing gateway startup. (441)
- **PodAutoscaler Scaling improvements**: Improved scaling logic to handle edge cases more efficiently. (508, 515)

🛠Infrastructure & CI/CD Upgrades
- Parallelized Build Tasks: CI efficiency improvements by running builds in parallel. (398)
- CrashLoopBackOff Detection in CI: Added monitoring for pod failures in testing workflows. (444)
- Improved GitHub Actions Cost Efficiency: Optimized triggers and removed unnecessary nightly builds. (411, 422)
- Integration Tests for Core Components: Added integration tests for autoscalers, routing policies, and deployment configurations. (616, 620)


What's Changed
* Add envoy gateway streaming support by varungup90 in https://github.com/aibrix/aibrix/pull/377
* Add client traffic policy to increase per connection buffer size from 32kb to 256kb by varungup90 in https://github.com/aibrix/aibrix/pull/395
* Misc: add support to metricsSources property of podautoscaler by zhangjyr in https://github.com/aibrix/aibrix/pull/371
* [Misc] Update runtime server startup command in v0.1.0 by brosoul in https://github.com/aibrix/aibrix/pull/396
* [CI] improve the ci efficiency by parallelizing the build tasks by nwangfw in https://github.com/aibrix/aibrix/pull/398
* Fix the ticker interval by removing unnecessary ms by Jeffwan in https://github.com/aibrix/aibrix/pull/415
* [Misc] Disable specific endpoints logs by Jeffwan in https://github.com/aibrix/aibrix/pull/418
* [CI] Github Action trigger condition optimized for cost saving by nwangfw in https://github.com/aibrix/aibrix/pull/411
* [Misc] Fix the mocked app role permission issue by Jeffwan in https://github.com/aibrix/aibrix/pull/416
* [CI] Nightly tag removed for release branch by nwangfw in https://github.com/aibrix/aibrix/pull/422
* Enable setting PodAutoscaler configuration via YAML labels by kr11 in https://github.com/aibrix/aibrix/pull/409
* Update manifest to adopt v0.1.1 images by Jeffwan in https://github.com/aibrix/aibrix/pull/429
* [Bug]: duplicated http in rest metrics fetcher (408) by zhangjyr in https://github.com/aibrix/aibrix/pull/421
* [MISC]: Improve Request Trace Granularity with Version Control by zhangjyr in https://github.com/aibrix/aibrix/pull/431
* Support histogram metrics from engine in cache by Jeffwan in https://github.com/aibrix/aibrix/pull/424
* Support fetching metrics from remote Prometheus server by Jeffwan in https://github.com/aibrix/aibrix/pull/433
* [CI] Add python wheel to release artifact by Jeffwan in https://github.com/aibrix/aibrix/pull/434
* Fix update cache pod issue and refactor updatePod handler by Jeffwan in https://github.com/aibrix/aibrix/pull/439
* Extract common metrics structure to types and utils by Jeffwan in https://github.com/aibrix/aibrix/pull/438
* Fix gateway startup issue due to missing prometheus config by Jeffwan in https://github.com/aibrix/aibrix/pull/441
* [feat]: GPU Optimizer and Simulator development app by zhangjyr in https://github.com/aibrix/aibrix/pull/430
* Add selectrandom fallback in routing and only scraping healthy pods by Jeffwan in https://github.com/aibrix/aibrix/pull/445
* AIBrix Workload Generator / Scenario Simulator by happyandslow in https://github.com/aibrix/aibrix/pull/428
* CrashLoopBackOff status detection in CI by nwangfw in https://github.com/aibrix/aibrix/pull/444
* Support installing individual controllers from giant controller-manager by nwangfw in https://github.com/aibrix/aibrix/pull/442
* Refactor Scaler: Resolve Issues with Metric Parameter Updates in Multiple KPAs by kr11 in https://github.com/aibrix/aibrix/pull/437
* Support metrics multi labels for different models by brosoul in https://github.com/aibrix/aibrix/pull/450
* Add health check api interface for runtime by Jeffwan in https://github.com/aibrix/aibrix/pull/451
* Fix the service name override issue in rolebindings by Jeffwan in https://github.com/aibrix/aibrix/pull/453
* Reorganize docs/development and docs/tutorial structure by Jeffwan in https://github.com/aibrix/aibrix/pull/455
* Move tools to separate folders and update mocked app README.md by Jeffwan in https://github.com/aibrix/aibrix/pull/457
* Fix multi models metric result in PromQL by brosoul in https://github.com/aibrix/aibrix/pull/458
* Support Azure LLM trace in workload generator by happyandslow in https://github.com/aibrix/aibrix/pull/462
* Fix autoscaler scalingstrategy switching logic by nwangfw in https://github.com/aibrix/aibrix/pull/475
* Fix missing handle of PromQL scope is PodMetricScope by brosoul in https://github.com/aibrix/aibrix/pull/479
* [Misc] Consolidate app and simulator by zhangjyr in https://github.com/aibrix/aibrix/pull/477
* [Bug] Avoid including sensitive info in Dockerfile ENV by zhangjyr in https://github.com/aibrix/aibrix/pull/487
* Refactor generator to generate time-based traces by happyandslow in https://github.com/aibrix/aibrix/pull/478
* [CI] Update deploy workload script in installation test by nwangfw in https://github.com/aibrix/aibrix/pull/499
* [Bug] handle metricKey creation with MetricsSources by nwangfw in https://github.com/aibrix/aibrix/pull/498
* Adding Client for Workload Generator Workload File by happyandslow in https://github.com/aibrix/aibrix/pull/501
* [Feat] Integrate deployment configurations and fix autoscaler/gpu optimizer connectivity by zhangjyr in https://github.com/aibrix/aibrix/pull/500
* Fix some simulator format issue and add some TODOs by Jeffwan in https://github.com/aibrix/aibrix/pull/505
* [Bug] Fix the way how podautoscaler handle 0 pods. by zhangjyr in https://github.com/aibrix/aibrix/pull/508
* [Misc] Improve gpu optimizer debugging on podautoscaler. by zhangjyr in https://github.com/aibrix/aibrix/pull/509
* Optimize kustomize overlay for volcano engine deployment by Jeffwan in https://github.com/aibrix/aibrix/pull/512
* [perf] Refact tos downloader in Runtime by brosoul in https://github.com/aibrix/aibrix/pull/510
* Refactor metric source for customized protocol, port and path by kr11 in https://github.com/aibrix/aibrix/pull/511
* [Bug] Fixed the yaml of deployments in heterogenous GPU settings to make KPA scaling work as expected. by zhangjyr in https://github.com/aibrix/aibrix/pull/513
* [Misc] Heterogeneous GPU Optimizer Logging Clean Up by nwangfw in https://github.com/aibrix/aibrix/pull/514
* Fix KPA bug, and an elaborate KPA test case by kr11 in https://github.com/aibrix/aibrix/pull/515
* Cut v0.2.0-rc.1 release by Jeffwan in https://github.com/aibrix/aibrix/pull/516
* [Bug] Accumulated bug fix on controller manager, mock app configuration, and gpu optimizer. by zhangjyr in https://github.com/aibrix/aibrix/pull/522
* [Misc] Reduced runtime's container image size by nwangfw in https://github.com/aibrix/aibrix/pull/518
* clean memory scaler object when pa crd is deleted by kr11 in https://github.com/aibrix/aibrix/pull/520
* Configure autoscaler http client to skip certificate check by Jeffwan in https://github.com/aibrix/aibrix/pull/530
* [Doc] Update aibrix documentation by Jeffwan in https://github.com/aibrix/aibrix/pull/533
* Refactor the gateway-plugin and metadata service manifests by Jeffwan in https://github.com/aibrix/aibrix/pull/531
* Fix the GITHUB_WORKSPACE artifact sharing issue in release workflow by Jeffwan in https://github.com/aibrix/aibrix/pull/532
* [Misc] Polish the benchmark scripts by Jeffwan in https://github.com/aibrix/aibrix/pull/525
* Fix APA bugs in creation, add test and demo yaml by kr11 in https://github.com/aibrix/aibrix/pull/536
* Add VKE IPv4 Testing Cluster Config by nwangfw in https://github.com/aibrix/aibrix/pull/537
* Support for request length internal trace by happyandslow in https://github.com/aibrix/aibrix/pull/538
* [Feat] Add download status into runtime downloader by brosoul in https://github.com/aibrix/aibrix/pull/539
* [Feat] Add runtime model management api by brosoul in https://github.com/aibrix/aibrix/pull/540
* [gateway] handle the wrong model name and cache inconsistency case by Jeffwan in https://github.com/aibrix/aibrix/pull/542
* [Docs] fix: update the parameters instruction in readme by scarlet25151 in https://github.com/aibrix/aibrix/pull/548
* add lora schedulers - bin pack, least latency, least throughput, random by Aspirin96 in https://github.com/aibrix/aibrix/pull/544
* add request routers - least kv cache, least expected latency by Aspirin96 in https://github.com/aibrix/aibrix/pull/543
* [Docs] heterogenous gpu docs added by nwangfw in https://github.com/aibrix/aibrix/pull/545
* Fix race condition in cache by varungup90 in https://github.com/aibrix/aibrix/pull/550
* Fix pod internal cache delete handling by varungup90 in https://github.com/aibrix/aibrix/pull/552
* Handle terminating pod for request routing by varungup90 in https://github.com/aibrix/aibrix/pull/549
* Support absolute path as lora adapter artifact path by Jeffwan in https://github.com/aibrix/aibrix/pull/556
* Deadlock fix for cache by varungup90 in https://github.com/aibrix/aibrix/pull/557
* Mock app log fix for missing metrics warning by varungup90 in https://github.com/aibrix/aibrix/pull/564
* Add vllm graceful termination configuration by nwangfw in https://github.com/aibrix/aibrix/pull/568
* Enhance dynamic lora adapter support for auth enabled scenario by Jeffwan in https://github.com/aibrix/aibrix/pull/571
* Update pyproject.toml to support python 3.12 by Jeffwan in https://github.com/aibrix/aibrix/pull/579
* [Docs ]Update ai runtime management api and downloader docs by Jeffwan in https://github.com/aibrix/aibrix/pull/577
* Check the HPA ownerReference in request enqueue by Jeffwan in https://github.com/aibrix/aibrix/pull/582
* Add request length for traces by happyandslow in https://github.com/aibrix/aibrix/pull/569
* Support model registration flow using aibrix runtime api by Jeffwan in https://github.com/aibrix/aibrix/pull/580
* Gateway plugin report total incoming requests and pending requests by zhangjyr in https://github.com/aibrix/aibrix/pull/554
* Support distributed kv cache orchestration by Jeffwan in https://github.com/aibrix/aibrix/pull/583
* Grant workflow action permission to write packages by Jeffwan in https://github.com/aibrix/aibrix/pull/586
* Update routers to use GetPodModelMetric api and misc cleanup in metri… by varungup90 in https://github.com/aibrix/aibrix/pull/590
* Update upload/download artifact github actions version to v4 by varungup90 in https://github.com/aibrix/aibrix/pull/591
* Update version in aibrix/python to 0.2.0-rc.2 by varungup90 in https://github.com/aibrix/aibrix/pull/594
* Update image names in sync-image script by varungup90 in https://github.com/aibrix/aibrix/pull/595
* Update dependency chart for release pipeline by varungup90 in https://github.com/aibrix/aibrix/pull/597
* Patch release for older vllm engine lora support in gateway plugins by varungup90 in https://github.com/aibrix/aibrix/pull/599
* Update component names in staging deployment and readme for new relea… by varungup90 in https://github.com/aibrix/aibrix/pull/605
* Fix the PodAutoscaler kind typo by Jeffwan in https://github.com/aibrix/aibrix/pull/610
* Improve condition update and fix multiple endpoint ips issue by Jeffwan in https://github.com/aibrix/aibrix/pull/609
* Check if model name is present in response from inference engine by varungup90 in https://github.com/aibrix/aibrix/pull/611
* Update log level for few messages in PodAutoscaler by varungup90 in https://github.com/aibrix/aibrix/pull/612
* [enhancement] GPU optimizer accumulated fix by zhangjyr in https://github.com/aibrix/aibrix/pull/598
* Update manifest to use v0.2.0-rc.2 tag by Jeffwan in https://github.com/aibrix/aibrix/pull/614
* Add framework to setup integration test by varungup90 in https://github.com/aibrix/aibrix/pull/616
* [docs] Update lora model adapter docs by Jeffwan in https://github.com/aibrix/aibrix/pull/618
* [docs] Update AI Engine Runtime and Fleet docs by Jeffwan in https://github.com/aibrix/aibrix/pull/619
* [Doc] update quickstart tutorial and add example sending requests via gatew… by nwangfw in https://github.com/aibrix/aibrix/pull/621
* [Doc] feature description for distributed kv cache by DwyaneShi in https://github.com/aibrix/aibrix/pull/623
* WIP: Add docs gateway plugin by varungup90 in https://github.com/aibrix/aibrix/pull/624
* [Docs] Update GPU Optimizer documentation by zhangjyr in https://github.com/aibrix/aibrix/pull/622
* Add integration test to CI workflow by varungup90 in https://github.com/aibrix/aibrix/pull/620
* [Docs] Updated autoscaling doc by gangmuk in https://github.com/aibrix/aibrix/pull/625
* Filter active pods before metrics calculation by Jeffwan in https://github.com/aibrix/aibrix/pull/629
* Fix some issues in the docs and polish contents by Jeffwan in https://github.com/aibrix/aibrix/pull/630
* Ignore Jupyter notebooks for GitHub Linguist by Jeffwan in https://github.com/aibrix/aibrix/pull/632
* [Docs] Improving the heterogenous-GPU feature doc by nwangfw in https://github.com/aibrix/aibrix/pull/634
* [Doc] Fixed autoscaling doc by gangmuk in https://github.com/aibrix/aibrix/pull/635
* Fix out of space error in running integration test github workflow by varungup90 in https://github.com/aibrix/aibrix/pull/628
* Use AIBRIX_POD_METRIC_REFRESH_INTERVAL_MS=50 in base configs by Jeffwan in https://github.com/aibrix/aibrix/pull/640
* Fix the least-kv-cache cache store retrieval by Jeffwan in https://github.com/aibrix/aibrix/pull/639
* Add prefix cache aware routing by varungup90 in https://github.com/aibrix/aibrix/pull/641
* [misc] Polish gateway code with better structure by Jeffwan in https://github.com/aibrix/aibrix/pull/645
* Create AIBrix Single-Node Deployment on Lambda scripts by Jeffwan in https://github.com/aibrix/aibrix/pull/659
* End-to-end benchmark pipeline for autoscalers and routing policies by gangmuk in https://github.com/aibrix/aibrix/pull/650
* Clean up scripts under hack folder by Jeffwan in https://github.com/aibrix/aibrix/pull/660
* Add a research section, update architecture and lambda guidance by Jeffwan in https://github.com/aibrix/aibrix/pull/663
* Leverage literalinclude to keep only one code copy and move autoscaler configs to annotations by Jeffwan in https://github.com/aibrix/aibrix/pull/665
* Updated scripts and fixed issues in benchmark/autoscaling by gangmuk in https://github.com/aibrix/aibrix/pull/662
* Benchmark Generator Refactoring by happyandslow in https://github.com/aibrix/aibrix/pull/655
* Add interface for prefix cache indexer by varungup90 in https://github.com/aibrix/aibrix/pull/657
* Fix missing file to generator refactoring by happyandslow in https://github.com/aibrix/aibrix/pull/670
* [Bug] GPU optimizer bug fix and document fix by zhangjyr in https://github.com/aibrix/aibrix/pull/656
* Change error response to json and improve e2e stability by Jeffwan in https://github.com/aibrix/aibrix/pull/669
* Use response buffer to address stream request issue by Jeffwan in https://github.com/aibrix/aibrix/pull/679
* [docs] Polish feature examples and user guidances by Jeffwan in https://github.com/aibrix/aibrix/pull/686
* Update version and tags to v0.2.0 by Jeffwan in https://github.com/aibrix/aibrix/pull/687
* fix api scheme by kerthcet in https://github.com/aibrix/aibrix/pull/674
* [docs] Polish distributed inference and kv cache examples by Jeffwan in https://github.com/aibrix/aibrix/pull/691
* Improve lora autoscaling and kvcache examples by Jeffwan in https://github.com/aibrix/aibrix/pull/697
* [Docs] Add optimizer-based autoscaling doc and examples by nwangfw in https://github.com/aibrix/aibrix/pull/692
* Add cpu/memory resources for control plane components by varungup90 in https://github.com/aibrix/aibrix/pull/702
* Update log config for sample deployments by varungup90 in https://github.com/aibrix/aibrix/pull/704
* [Docs] Add feature description of dist kv cache in README by DwyaneShi in https://github.com/aibrix/aibrix/pull/705
* [Docs] Update README.md by Jeffwan in https://github.com/aibrix/aibrix/pull/706
* Add feature description for heterogeneous gpu inference feature by nwangfw in https://github.com/aibrix/aibrix/pull/707
* Bump py version to 0.2.0.post1 by Jeffwan in https://github.com/aibrix/aibrix/pull/708
* Fix wrong path for generated html by kerthcet in https://github.com/aibrix/aibrix/pull/709

New Contributors
* scarlet25151 made their first contribution in https://github.com/aibrix/aibrix/pull/548
* Aspirin96 made their first contribution in https://github.com/aibrix/aibrix/pull/544
* DwyaneShi made their first contribution in https://github.com/aibrix/aibrix/pull/623
* gangmuk made their first contribution in https://github.com/aibrix/aibrix/pull/625
* kerthcet made their first contribution in https://github.com/aibrix/aibrix/pull/674

**Full Changelog**: https://github.com/aibrix/aibrix/compare/v0.1.0...v0.2.0

Automatically generated release for tag v0.2.0-rc.2.

What's Changed
* [Bug] Accumulated bug fix on controller manager, mock app configuration, and gpu optimizer. by zhangjyr in https://github.com/aibrix/aibrix/pull/522
* [Misc] Reduced runtime's container image size by nwangfw in https://github.com/aibrix/aibrix/pull/518
* clean memory scaler object when pa crd is deleted by kr11 in https://github.com/aibrix/aibrix/pull/520
* Configure autoscaler http client to skip certificate check by Jeffwan in https://github.com/aibrix/aibrix/pull/530
* [Doc] Update aibrix documentation by Jeffwan in https://github.com/aibrix/aibrix/pull/533
* Refactor the gateway-plugin and metadata service manifests by Jeffwan in https://github.com/aibrix/aibrix/pull/531
* Fix the GITHUB_WORKSPACE artifact sharing issue in release workflow by Jeffwan in https://github.com/aibrix/aibrix/pull/532
* [Misc] Polish the benchmark scripts by Jeffwan in https://github.com/aibrix/aibrix/pull/525
* Fix APA bugs in creation, add test and demo yaml by kr11 in https://github.com/aibrix/aibrix/pull/536
* Add VKE IPv4 Testing Cluster Config by nwangfw in https://github.com/aibrix/aibrix/pull/537
* Support for request length internal trace by happyandslow in https://github.com/aibrix/aibrix/pull/538
* [Feat] Add download status into runtime downloader by brosoul in https://github.com/aibrix/aibrix/pull/539
* [Feat] Add runtime model management api by brosoul in https://github.com/aibrix/aibrix/pull/540
* [gateway] handle the wrong model name and cache inconsistency case by Jeffwan in https://github.com/aibrix/aibrix/pull/542
* [Docs] fix: update the parameters instruction in readme by scarlet25151 in https://github.com/aibrix/aibrix/pull/548
* add lora schedulers - bin pack, least latency, least throughput, random by Aspirin96 in https://github.com/aibrix/aibrix/pull/544
* add request routers - least kv cache, least expected latency by Aspirin96 in https://github.com/aibrix/aibrix/pull/543
* [Docs] heterogenous gpu docs added by nwangfw in https://github.com/aibrix/aibrix/pull/545
* Fix race condition in cache by varungup90 in https://github.com/aibrix/aibrix/pull/550
* Fix pod internal cache delete handling by varungup90 in https://github.com/aibrix/aibrix/pull/552
* Handle terminating pod for request routing by varungup90 in https://github.com/aibrix/aibrix/pull/549
* Support absolute path as lora adapter artifact path by Jeffwan in https://github.com/aibrix/aibrix/pull/556
* Deadlock fix for cache by varungup90 in https://github.com/aibrix/aibrix/pull/557
* Mock app log fix for missing metrics warning by varungup90 in https://github.com/aibrix/aibrix/pull/564
* Add vllm graceful termination configuration by nwangfw in https://github.com/aibrix/aibrix/pull/568
* Enhance dynamic lora adapter support for auth enabled scenario by Jeffwan in https://github.com/aibrix/aibrix/pull/571
* Update pyproject.toml to support python 3.12 by Jeffwan in https://github.com/aibrix/aibrix/pull/579
* [Docs ]Update ai runtime management api and downloader docs by Jeffwan in https://github.com/aibrix/aibrix/pull/577
* Check the HPA ownerReference in request enqueue by Jeffwan in https://github.com/aibrix/aibrix/pull/582
* Add request length for traces by happyandslow in https://github.com/aibrix/aibrix/pull/569
* Support model registration flow using aibrix runtime api by Jeffwan in https://github.com/aibrix/aibrix/pull/580
* Gateway plugin report total incoming requests and pending requests by zhangjyr in https://github.com/aibrix/aibrix/pull/554
* Support distributed kv cache orchestration by Jeffwan in https://github.com/aibrix/aibrix/pull/583
* Grant workflow action permission to write packages by Jeffwan in https://github.com/aibrix/aibrix/pull/586
* Update routers to use GetPodModelMetric api and misc cleanup in metri… by varungup90 in https://github.com/aibrix/aibrix/pull/590
* Update upload/download artifact github actions version to v4 by varungup90 in https://github.com/aibrix/aibrix/pull/591
* Update version in aibrix/python to 0.2.0-rc.2 by varungup90 in https://github.com/aibrix/aibrix/pull/594

New Contributors
* scarlet25151 made their first contribution in https://github.com/aibrix/aibrix/pull/548
* Aspirin96 made their first contribution in https://github.com/aibrix/aibrix/pull/544

**Full Changelog**: https://github.com/aibrix/aibrix/compare/v0.2.0-rc.1...v0.2.0-rc.2

What's Changed

* Add envoy gateway streaming support by varungup90 in https://github.com/aibrix/aibrix/pull/377
* Add client traffic policy to increase per connection buffer size from 32kb to 256kb by varungup90 in https://github.com/aibrix/aibrix/pull/395
* Misc: add support to metricsSources property of podautoscaler by zhangjyr in https://github.com/aibrix/aibrix/pull/371
* [Misc] Update runtime server startup command in v0.1.0 by brosoul in https://github.com/aibrix/aibrix/pull/396
* [CI] improve the ci efficiency by parallelizing the build tasks by nwangfw in https://github.com/aibrix/aibrix/pull/398
* Fix the ticker interval by removing unnecessary ms by Jeffwan in https://github.com/aibrix/aibrix/pull/415
* [Misc] Disable specific endpoints logs by Jeffwan in https://github.com/aibrix/aibrix/pull/418
* [CI] Github Action trigger condition optimized for cost saving by nwangfw in https://github.com/aibrix/aibrix/pull/411
* [Misc] Fix the mocked app role permission issue by Jeffwan in https://github.com/aibrix/aibrix/pull/416
* [CI] Nightly tag removed for release branch by nwangfw in https://github.com/aibrix/aibrix/pull/422
* Enable setting PodAutoscaler configuration via YAML labels by kr11 in https://github.com/aibrix/aibrix/pull/409
* Update manifest to adopt v0.1.1 images by Jeffwan in https://github.com/aibrix/aibrix/pull/429
* [Bug]: duplicated http in rest metrics fetcher (408) by zhangjyr in https://github.com/aibrix/aibrix/pull/421
* [MISC]: Improve Request Trace Granularity with Version Control by zhangjyr in https://github.com/aibrix/aibrix/pull/431
* Support histogram metrics from engine in cache by Jeffwan in https://github.com/aibrix/aibrix/pull/424
* Support fetching metrics from remote Prometheus server by Jeffwan in https://github.com/aibrix/aibrix/pull/433
* [CI] Add python wheel to release artifact by Jeffwan in https://github.com/aibrix/aibrix/pull/434
* Fix update cache pod issue and refactor updatePod handler by Jeffwan in https://github.com/aibrix/aibrix/pull/439
* Extract common metrics structure to types and utils by Jeffwan in https://github.com/aibrix/aibrix/pull/438
* Fix gateway startup issue due to missing prometheus config by Jeffwan in https://github.com/aibrix/aibrix/pull/441
* [feat]: GPU Optimizer and Simulator development app by zhangjyr in https://github.com/aibrix/aibrix/pull/430
* Add selectrandom fallback in routing and only scraping healthy pods by Jeffwan in https://github.com/aibrix/aibrix/pull/445
* AIBrix Workload Generator / Scenario Simulator by happyandslow in https://github.com/aibrix/aibrix/pull/428
* CrashLoopBackOff status detection in CI by nwangfw in https://github.com/aibrix/aibrix/pull/444
* Support installing individual controllers from giant controller-manager by nwangfw in https://github.com/aibrix/aibrix/pull/442
* Refactor Scaler: Resolve Issues with Metric Parameter Updates in Multiple KPAs by kr11 in https://github.com/aibrix/aibrix/pull/437
* Support metrics multi labels for different models by brosoul in https://github.com/aibrix/aibrix/pull/450
* Add health check api interface for runtime by Jeffwan in https://github.com/aibrix/aibrix/pull/451
* Fix the service name override issue in rolebindings by Jeffwan in https://github.com/aibrix/aibrix/pull/453
* Reorganize docs/development and docs/tutorial structure by Jeffwan in https://github.com/aibrix/aibrix/pull/455
* Move tools to separate folders and update mocked app README.md by Jeffwan in https://github.com/aibrix/aibrix/pull/457
* Fix multi models metric result in PromQL by brosoul in https://github.com/aibrix/aibrix/pull/458
* Support Azure LLM trace in workload generator by happyandslow in https://github.com/aibrix/aibrix/pull/462
* Fix autoscaler scalingstrategy switching logic by nwangfw in https://github.com/aibrix/aibrix/pull/475
* Fix missing handle of PromQL scope is PodMetricScope by brosoul in https://github.com/aibrix/aibrix/pull/479
* [Misc] Consolidate app and simulator by zhangjyr in https://github.com/aibrix/aibrix/pull/477
* [Bug] Avoid including sensitive info in Dockerfile ENV by zhangjyr in https://github.com/aibrix/aibrix/pull/487
* Refactor generator to generate time-based traces by happyandslow in https://github.com/aibrix/aibrix/pull/478
* [CI] Update deploy workload script in installation test by nwangfw in https://github.com/aibrix/aibrix/pull/499
* [Bug] handle metricKey creation with MetricsSources by nwangfw in https://github.com/aibrix/aibrix/pull/498
* Adding Client for Workload Generator Workload File by happyandslow in https://github.com/aibrix/aibrix/pull/501
* [Feat] Integrate deployment configurations and fix autoscaler/gpu optimizer connectivity by zhangjyr in https://github.com/aibrix/aibrix/pull/500
* Fix some simulator format issue and add some TODOs by Jeffwan in https://github.com/aibrix/aibrix/pull/505
* [Bug] Fix the way how podautoscaler handle 0 pods. by zhangjyr in https://github.com/aibrix/aibrix/pull/508
* [Misc] Improve gpu optimizer debugging on podautoscaler. by zhangjyr in https://github.com/aibrix/aibrix/pull/509
* Optimize kustomize overlay for volcano engine deployment by Jeffwan in https://github.com/aibrix/aibrix/pull/512
* [perf] Refact tos downloader in Runtime by brosoul in https://github.com/aibrix/aibrix/pull/510
* Refactor metric source for customized protocol, port and path by kr11 in https://github.com/aibrix/aibrix/pull/511
* [Bug] Fixed the yaml of deployments in heterogenous GPU settings to make KPA scaling work as expected. by zhangjyr in https://github.com/aibrix/aibrix/pull/513
* [Misc] Heterogeneous GPU Optimizer Logging Clean Up by nwangfw in https://github.com/aibrix/aibrix/pull/514
* Fix KPA bug, and an elaborate KPA test case by kr11 in https://github.com/aibrix/aibrix/pull/515
* Cut v0.2.0-rc.1 release by Jeffwan in https://github.com/aibrix/aibrix/pull/516


**Full Changelog**: https://github.com/aibrix/aibrix/compare/v0.1.1...v0.2.0-rc.1

What's Changed
* Support absolute path as lora adapter artifact path (556) by Jeffwan in https://github.com/aibrix/aibrix/pull/558
* Cherry pick streaming and client traffic policy by varungup90 in https://github.com/aibrix/aibrix/pull/560
* Cut v0.1.2 release by Jeffwan in https://github.com/aibrix/aibrix/pull/561

**Full Changelog**: https://github.com/aibrix/aibrix/compare/v0.1.1...v0.1.2

Automatically generated release for tag v0.1.1.

What's Changed
* Cherry-pick - Fix the ticker interval by removing unnecessary ms by Jeffwan in https://github.com/aibrix/aibrix/pull/425
* Cut v0.1.1 release by Jeffwan in https://github.com/aibrix/aibrix/pull/427


**Full Changelog**: https://github.com/aibrix/aibrix/compare/v0.1.0...v0.1.1

Feature Highlights

1. Dynamic LoRa Adapter
The Dynamic LoRa Adapter introduces a flexible approach to model adaptation, allowing dynamic management of LoRa models within Kubernetes. This new functionality includes efficient handling of model registration, unloading, and routing, significantly enhancing operational control and scalability for production environments.

2. Gateway Extension Server with Multi-Algorithm Routing Support
We extend the Envoy Gateway through an extension server and the external processing service can inspect and mutate requests and responses. We use this way to extend some features not directly supported in kubernetes service like various routing algorithms, such as `least request`, `least throughput`, and `random` and rate limit feature. This flexibility allows users to fine-tune routing strategies based on their specific application needs, ultimately improving traffic distribution and system performance.

3. LLM-specific Autoscaler
This release integrates multiple autoscaling algorithms, including HPA (Horizontal Pod Autoscaler), KPA (Knative Pod Autoscaler), and APA (AIBrix Pod Autoscaler). The autoscaling framework now features a direct connection to fetch metrics from pods, enabling real-time adjustments based on load and optimized resource utilization.

4. Unified AI Runtime
The AI runtime has been created to support faster model downloading through GPU streaming way, streamlined metrics aggregation, and efficient LoRa request delegation to abstract underlying engine complexities. This runtime provides an optimized environment for deploying and managing machine learning models, making it easier to handle high-volume requests.


Additional Enhancements:

- **Doc website**: Updated documents, including quick-start guides, installation instructions, and tutorials for autoscaling, make setup and onboarding smoother.
- **Benchmarking and Performance Analysis Tools**: Integrated tools for benchmarking autoscalers, gateways and lora to monitor and improve system efficiency and performance.
- **CI/CD Workflow**: The new CI/CD pipeline includes automated image builds, GitHub Actions for testing and linting, and release pipelines for simplified deployment.

What's Changed
* Add common project documents and skeleton folders by Jeffwan in https://github.com/aibrix/aibrix/pull/4
* Scaffolding aibrix project using kubebuilder by Jeffwan in https://github.com/aibrix/aibrix/pull/17
* Optimize project layouts by moving controllers to pkg folder by Jeffwan in https://github.com/aibrix/aibrix/pull/21
* Create Lora api and controller by Jeffwan in https://github.com/aibrix/aibrix/pull/23
* Rename LoraAdapter to ModelAdapter by Jeffwan in https://github.com/aibrix/aibrix/pull/25
* Add ModelAdapter API by Jeffwan in https://github.com/aibrix/aibrix/pull/26
* Use better way to set up controller with Manager by Jeffwan in https://github.com/aibrix/aibrix/pull/27
* Initial model adapter controller implementation by Jeffwan in https://github.com/aibrix/aibrix/pull/32
* Add mocked model container for lora adapter fast prototyping by Jeffwan in https://github.com/aibrix/aibrix/pull/33
* [Misc] Add the PR and issues template by jsw-zorro in https://github.com/aibrix/aibrix/pull/38
* [Docs] Add example to run vLLM distributed inference using Ray by Jeffwan in https://github.com/aibrix/aibrix/pull/39
* [Doc] Improve the model adapter mock service by Jeffwan in https://github.com/aibrix/aibrix/pull/45
* [Misc] Simplify the feature/bug/enhancement template. by jsw-zorro in https://github.com/aibrix/aibrix/pull/48
* [Misc] Make model adapter controller e2e work by Jeffwan in https://github.com/aibrix/aibrix/pull/50
* [Docs] A draft version of the contributing guideline document by kr11 in https://github.com/aibrix/aibrix/pull/47
* [Core] Improve model adapter controller by handling existing resources by Jeffwan in https://github.com/aibrix/aibrix/pull/54
* [Feat] Initial Implementation of PodAutoscaler Reconciler by kr11 in https://github.com/aibrix/aibrix/pull/55
* [Docs] Move the sample mocked application to common folder by Jeffwan in https://github.com/aibrix/aibrix/pull/64
* [Misc] Minor refactor the PodAutoscaler codes by Jeffwan in https://github.com/aibrix/aibrix/pull/68
* [Core] Add model router controller by varungup90 in https://github.com/aibrix/aibrix/pull/57
* Add rbac rules in model router by varungup90 in https://github.com/aibrix/aibrix/pull/71
* [bugs] Add autoscaler RBAC to successfully list horizontalpodautoscalers by kr11 in https://github.com/aibrix/aibrix/pull/72
* [Misc] Update license info; Add license check by happyandslow in https://github.com/aibrix/aibrix/pull/73
* add github workflow to lint & test code by M00nF1sh in https://github.com/aibrix/aibrix/pull/74
* [CI] Fix the golang lint issues by Jeffwan in https://github.com/aibrix/aibrix/pull/77
* [CI] fix the failures from make test by Jeffwan in https://github.com/aibrix/aibrix/pull/80
* [Misc] Add code-generator and openapi-gen as dependencies by Jeffwan in https://github.com/aibrix/aibrix/pull/59
* [Misc] Reconcile hpa, kpa and apa separately by Jeffwan in https://github.com/aibrix/aibrix/pull/83
* [feat] Add rpm/tpm extension proc plugin by varungup90 in https://github.com/aibrix/aibrix/pull/79
* Add kpa scale algorithm implementation by kr11 in https://github.com/aibrix/aibrix/pull/87
* Add host override to query specific pod by varungup90 in https://github.com/aibrix/aibrix/pull/86
* [Core] init aibrix runtime framework by brosoul in https://github.com/aibrix/aibrix/pull/88
* Support kpa/apa autoscaling workflow part I by Jeffwan in https://github.com/aibrix/aibrix/pull/85
* Fix Dockerfile Packaging Issues Related to Go Version and Missing Utils by kr11 in https://github.com/aibrix/aibrix/pull/92
* Autoscaling Workflow Enhancement - Part 2 by kr11 in https://github.com/aibrix/aibrix/pull/94
* Add custom CRD clientset by varungup90 in https://github.com/aibrix/aibrix/pull/97
* Autoscaling Workflow Enhancement - Part 3 by kr11 in https://github.com/aibrix/aibrix/pull/101
* [Core] Add Downloader implementation for runtime by brosoul in https://github.com/aibrix/aibrix/pull/96
* Add RayClusterReplicaSet and RayClusterFleet apis by Jeffwan in https://github.com/aibrix/aibrix/pull/103
* Apply crd:maxDescLen=0 in manifest generation by Jeffwan in https://github.com/aibrix/aibrix/pull/108
* Apply filter to objects owned by model adapters by varungup90 in https://github.com/aibrix/aibrix/pull/111
* Add custom cache and interface for model adapter scheduling by varungup90 in https://github.com/aibrix/aibrix/pull/100
* Refactor gateway package by varungup90 in https://github.com/aibrix/aibrix/pull/112
* BatchAPI storage component together with test by xinchen384 in https://github.com/aibrix/aibrix/pull/104
* Update the installation guidance and README.md by Jeffwan in https://github.com/aibrix/aibrix/pull/115
* [CI] Package AI Runtime by brosoul in https://github.com/aibrix/aibrix/pull/118
* Add gateway installation by varungup90 in https://github.com/aibrix/aibrix/pull/122
* [CI] Support container image build and push in CI by Jeffwan in https://github.com/aibrix/aibrix/pull/120
* [CI] Fix nightly image push error by Jeffwan in https://github.com/aibrix/aibrix/pull/127
* [Bug] Fix download bugs during download benchmark by brosoul in https://github.com/aibrix/aibrix/pull/134
* Autoscaling Workflow Enhancement - Part 4: Integrating MetricClient into Autoscaling Workflow by kr11 in https://github.com/aibrix/aibrix/pull/116
* Update make generate by varungup90 in https://github.com/aibrix/aibrix/pull/132
* Model adapter controller improvement and refactor by Jeffwan in https://github.com/aibrix/aibrix/pull/135
* Improve the aibrix installation scripts by Jeffwan in https://github.com/aibrix/aibrix/pull/141
* [CI] Support python package publish by brosoul in https://github.com/aibrix/aibrix/pull/138
* Fix some typo and naming issues by Jeffwan in https://github.com/aibrix/aibrix/pull/150
* Fix gateway bootstrap issues by varungup90 in https://github.com/aibrix/aibrix/pull/154
* Add kubeconfig flag for cache initialization by varungup90 in https://github.com/aibrix/aibrix/pull/155
* Using sphinx to generate html pages for our project static site by xinchen384 in https://github.com/aibrix/aibrix/pull/153
* Add finalizer and handle the model unload requests by Jeffwan in https://github.com/aibrix/aibrix/pull/152
* Fix kubeConfig redefined issue and update imagePullPolicy by Jeffwan in https://github.com/aibrix/aibrix/pull/158
* Add expectation lib to allows us to set and wait on expectations by Jeffwan in https://github.com/aibrix/aibrix/pull/164
* Add routing algorithms by varungup90 in https://github.com/aibrix/aibrix/pull/143
* Add readthedocs configuration for CI builds and update theme by Jeffwan in https://github.com/aibrix/aibrix/pull/169
* Add RayClusterReplicaSet initial implementation by Jeffwan in https://github.com/aibrix/aibrix/pull/165
* Add template page for the docs by Jeffwan in https://github.com/aibrix/aibrix/pull/170
* Remove myst_parser from sphinx extensions by Jeffwan in https://github.com/aibrix/aibrix/pull/172
* Update quickstart in the doc by Jeffwan in https://github.com/aibrix/aibrix/pull/174
* Metric standardizing in ai runtime by brosoul in https://github.com/aibrix/aibrix/pull/163
* [Misc] Rename env in runtime by brosoul in https://github.com/aibrix/aibrix/pull/176
* Add readiness check for redis in gateway plugin by varungup90 in https://github.com/aibrix/aibrix/pull/173
* [batch] job manager handles job state transition by xinchen384 in https://github.com/aibrix/aibrix/pull/180
* Add users CRUD API by varungup90 in https://github.com/aibrix/aibrix/pull/181
* Add routing for model adapter by varungup90 in https://github.com/aibrix/aibrix/pull/183
* Add installation tests and refactor some CI jobs by Jeffwan in https://github.com/aibrix/aibrix/pull/188
* Add release pipeline for images and manifests by Jeffwan in https://github.com/aibrix/aibrix/pull/189
* [Docs] Update Readme on project intro by xieus in https://github.com/aibrix/aibrix/pull/191
* [CI] Add AI Runtime test case by brosoul in https://github.com/aibrix/aibrix/pull/197
* Add AI Runtime exist model check by brosoul in https://github.com/aibrix/aibrix/pull/198
* Implement rayclusterfleet controller by Jeffwan in https://github.com/aibrix/aibrix/pull/194
* klog Level Standardization by kr11 in https://github.com/aibrix/aibrix/pull/202
* Fix RayClusterReplicaSet e2e running issues by Jeffwan in https://github.com/aibrix/aibrix/pull/200
* Add lora adapter management API by brosoul in https://github.com/aibrix/aibrix/pull/201
* Add kuberay manifest as installation dependencies by Jeffwan in https://github.com/aibrix/aibrix/pull/203
* [doc] fix autoscaling readme by kr11 in https://github.com/aibrix/aibrix/pull/215
* [doc] update runtime feature doc by brosoul in https://github.com/aibrix/aibrix/pull/216
* Fix the annotation missing issue for ray workload by Jeffwan in https://github.com/aibrix/aibrix/pull/218
* [CI]: Add python test on different python version by brosoul in https://github.com/aibrix/aibrix/pull/219
* Add Autoscaling Tutorials in format of rst by kr11 in https://github.com/aibrix/aibrix/pull/225
* [Misc] Check AI Runtime download env settings by brosoul in https://github.com/aibrix/aibrix/pull/221
* Cut v0.1.0-rc.2 release by Jeffwan in https://github.com/aibrix/aibrix/pull/226
* Add model adapter and multi-node inference docs by Jeffwan in https://github.com/aibrix/aibrix/pull/222
* add gateway docs by varungup90 in https://github.com/aibrix/aibrix/pull/232
* [Misc] add Runtime dependency for hf_transfer by brosoul in https://github.com/aibrix/aibrix/pull/240
* Add validation for username and rpm/tpm negative value by varungup90 in https://github.com/aibrix/aibrix/pull/241
* [CI] Merge python wheel publish process to release build pipeline by brosoul in https://github.com/aibrix/aibrix/pull/247
* [CI] Push images to Github container registry by Jeffwan in https://github.com/aibrix/aibrix/pull/246
* [CI] Fix post-submit container push failure by Jeffwan in https://github.com/aibrix/aibrix/pull/249
* [Misc] Infer model name from model_uri and check AWS credential by brosoul in https://github.com/aibrix/aibrix/pull/250
* [Misc ]Add runtime api metrics by brosoul in https://github.com/aibrix/aibrix/pull/251
* [doc] Update release/contribution/quickstart docs by Jeffwan in https://github.com/aibrix/aibrix/pull/242
* [batch] job FIFO scheduler as baseline by xinchen384 in https://github.com/aibrix/aibrix/pull/231
* [Misc] Improve the installation component sequence by Jeffwan in https://github.com/aibrix/aibrix/pull/252
* Fix concurrency issue with gateway RPM plugin by varungup90 in https://github.com/aibrix/aibrix/pull/244
* Improve model adapter reliability and stability by Jeffwan in https://github.com/aibrix/aibrix/pull/257
* Remove underscore from dir names and remove account word in rate limiter by varungup90 in https://github.com/aibrix/aibrix/pull/271
* [Misc] Use klog as the logr implementation by Jeffwan in https://github.com/aibrix/aibrix/pull/264
* [CI] Unify Dockerfile names and simplify the build scripts by Jeffwan in https://github.com/aibrix/aibrix/pull/263
* Improve model adapter reconcile workflow stability by Jeffwan in https://github.com/aibrix/aibrix/pull/260
* Add container override for images by varungup90 in https://github.com/aibrix/aibrix/pull/273
* Add AIBrix Custom Autoscaling Algorithm APA by kr11 in https://github.com/aibrix/aibrix/pull/223
* Use vllm metrics for routing by varungup90 in https://github.com/aibrix/aibrix/pull/274
* Update random routing section and add support for anonymous user by varungup90 in https://github.com/aibrix/aibrix/pull/276
* Add image build details and examples for multi-host inference by Jeffwan in https://github.com/aibrix/aibrix/pull/278
* Cut v0.1.0-rc.3 release by Jeffwan in https://github.com/aibrix/aibrix/pull/280
* Update manifests version to v0.1.0-rc.3 by Jeffwan in https://github.com/aibrix/aibrix/pull/287
* [Misc] Add sync images step and scripts in release process by Jeffwan in https://github.com/aibrix/aibrix/pull/283
* [batch] E2E works with driver and request proxy by xinchen384 in https://github.com/aibrix/aibrix/pull/272
* Fix address already in use when AIRuntime start in pod by brosoul in https://github.com/aibrix/aibrix/pull/289
* Read model name from request body by varungup90 in https://github.com/aibrix/aibrix/pull/290
* Fix redis bootstrap flaky connection issue by varungup90 in https://github.com/aibrix/aibrix/pull/293
* skip docs CI if no changes in /docs dir by varungup90 in https://github.com/aibrix/aibrix/pull/294
* Improve Rayclusterreplicaset Status by Yicheng-Lu-llll in https://github.com/aibrix/aibrix/pull/295
* Add request trace for profiling by varungup90 in https://github.com/aibrix/aibrix/pull/291
* Update the crd definiton due to runtime upgrade by Jeffwan in https://github.com/aibrix/aibrix/pull/298
* Push images to Github registry in release pipeline by Jeffwan in https://github.com/aibrix/aibrix/pull/301
* Build autoscaler abstractions like fetcher, client and scaler by Jeffwan in https://github.com/aibrix/aibrix/pull/300
* Support pod autoscaler periodically check by Jeffwan in https://github.com/aibrix/aibrix/pull/306
* Add timeout in nc check for redis bootstrap by varungup90 in https://github.com/aibrix/aibrix/pull/309
* Refactor AutoScaler: metricClient, context, reconcile by kr11 in https://github.com/aibrix/aibrix/pull/308
* Cut v0.1.0-rc.4 release by Jeffwan in https://github.com/aibrix/aibrix/pull/314
* [doc] update runtime readme by brosoul in https://github.com/aibrix/aibrix/pull/318
* Add env for routing strategy override by varungup90 in https://github.com/aibrix/aibrix/pull/323
* Fix pod autoscaler enqueue issues by Jeffwan in https://github.com/aibrix/aibrix/pull/329
* Autoscaling benchmark by kr11 in https://github.com/aibrix/aibrix/pull/337
* Initial lora benchmark result by Jeffwan in https://github.com/aibrix/aibrix/pull/321
* Adding plotting script by happyandslow in https://github.com/aibrix/aibrix/pull/338
* Update the downloader performance plot by Jeffwan in https://github.com/aibrix/aibrix/pull/341
* Reduce pod metrics refresh interval by varungup90 in https://github.com/aibrix/aibrix/pull/343
* Enable ipv6 for envoy proxy by varungup90 in https://github.com/aibrix/aibrix/pull/342
* Add benchmark scrips for gateway client side changes by Jeffwan in https://github.com/aibrix/aibrix/pull/340
* Update the plots based on feedback by Jeffwan in https://github.com/aibrix/aibrix/pull/346
* [batch] use volcano TOS as batch storage by xinchen384 in https://github.com/aibrix/aibrix/pull/344
* Add check if no pods are present by varungup90 in https://github.com/aibrix/aibrix/pull/345
* Add model exists check by varungup90 in https://github.com/aibrix/aibrix/pull/353
* [Misc] Disable fastapi docs in runtime default action by brosoul in https://github.com/aibrix/aibrix/pull/350
* Add check for acceptable routing strategies by varungup90 in https://github.com/aibrix/aibrix/pull/352
* optimize PA messages: const 'HPA' -> actual pa type by kr11 in https://github.com/aibrix/aibrix/pull/354
* [Misc] Runtime server startup with args by brosoul in https://github.com/aibrix/aibrix/pull/355
* [Misc] Add python format script by brosoul in https://github.com/aibrix/aibrix/pull/357
* optimize benchmark scripts for autoscaler, add more logs by kr11 in https://github.com/aibrix/aibrix/pull/356
* Update the mocked app to cleaner state by Jeffwan in https://github.com/aibrix/aibrix/pull/361
* Update manifests & docs about service httproute naming trick by Jeffwan in https://github.com/aibrix/aibrix/pull/362
* Add reference grant to support httprouting for different namespace by varungup90 in https://github.com/aibrix/aibrix/pull/347
* Validate routing strategy bug fix by varungup90 in https://github.com/aibrix/aibrix/pull/364
* Bug fix for setting routing strategy via env var by varungup90 in https://github.com/aibrix/aibrix/pull/369
* Improve the routing env value & flag retrieval by Jeffwan in https://github.com/aibrix/aibrix/pull/373
* Sync main branch changes to release-0.1 branch by Jeffwan in https://github.com/aibrix/aibrix/pull/375
* Cut v0.1.0-rc.5 release by Jeffwan in https://github.com/aibrix/aibrix/pull/376
* Cut v0.1.0-rc.5 release by Jeffwan in https://github.com/aibrix/aibrix/pull/378
* [runtime] Add download args for control download progress bar by brosoul in https://github.com/aibrix/aibrix/pull/382
* [runtime] Update tos sdk version to 2.8.0 by brosoul in https://github.com/aibrix/aibrix/pull/381
* replaced old names AIBricks with AIBrix by nwangfw in https://github.com/aibrix/aibrix/pull/372
* [Misc] Update logos, docs and some configuration for v0.1.0 by Jeffwan in https://github.com/aibrix/aibrix/pull/383
* Sync changes from main to release-0.1 by Jeffwan in https://github.com/aibrix/aibrix/pull/384
* Cut v0.1.0 release by Jeffwan in https://github.com/aibrix/aibrix/pull/385

New Contributors
* Jeffwan made their first contribution in https://github.com/aibrix/aibrix/pull/4
* jsw-zorro made their first contribution in https://github.com/aibrix/aibrix/pull/38
* kr11 made their first contribution in https://github.com/aibrix/aibrix/pull/47
* varungup90 made their first contribution in https://github.com/aibrix/aibrix/pull/57
* happyandslow made their first contribution in https://github.com/aibrix/aibrix/pull/73
* M00nF1sh made their first contribution in https://github.com/aibrix/aibrix/pull/74
* brosoul made their first contribution in https://github.com/aibrix/aibrix/pull/88
* xinchen384 made their first contribution in https://github.com/aibrix/aibrix/pull/104
* xieus made their first contribution in https://github.com/aibrix/aibrix/pull/191
* Yicheng-Lu-llll made their first contribution in https://github.com/aibrix/aibrix/pull/295
* nwangfw made their first contribution in https://github.com/aibrix/aibrix/pull/372

**Full Changelog**: https://github.com/aibrix/aibrix/commits/v0.1.0