Qhub

Enhancements for this release include:

- Fix reported bug with Azure deployments due to outdated azurerm provider
- All dashboards related conda-store environments are now visible as options for spawning dashboards
- New Nebari entrypoint
- New Typer-based CLI for Qhub (available using new entrypoint)
- Renamed built-in conda-store namespaces and added customization support
- Updated Traefik version to support the latest Kubernetes API

What's Changed
* Update azurerm version by tjcrone in https://github.com/Quansight/qhub/pull/1471
* Make CDSDashboards.conda_envs dynamically update from function by costrouc in https://github.com/Quansight/qhub/pull/1358
* Fix get_latest_repo_tag fn by iameskild in https://github.com/Quansight/qhub/pull/1485
* Nebari Typer CLI by asmijafar20 in https://github.com/Quansight/qhub/pull/1443
* Pass AWS `region`, `kubernetes_version` to terraform scripts by iameskild in https://github.com/Quansight/qhub/pull/1493
* Enable ebs-csi driver on AWS, add region + kubernetes_version vars by iameskild in https://github.com/Quansight/qhub/pull/1494
* Update traefik version + CRD by iameskild in https://github.com/Quansight/qhub/pull/1489
* [ENH] Switch default and filesystem name envs by viniciusdc in https://github.com/Quansight/qhub/pull/1357

New Contributors
* tjcrone made their first contribution in https://github.com/Quansight/qhub/pull/1471

Migration note

If you are upgrading from a version of Nebari prior to `0.4.5`, you will need to manually update your conda-store namespaces
to be compatible with the new Nebari version. This is a one-time migration step that will need to be performed after upgrading to continue using the service. Refer to [How to migrate base conda-store namespaces](https://deploy-preview-178--nebari-docs.netlify.app/troubleshooting#conda-store-compatibility-migration-steps-when-upgrading-to-045) for further instructions.

Feature changes and enhancements

Enhancements for this release include:
- Bump `conda-store` version to `v0.4.11` and enable overrides
- Fully decouple the JupyterLab, JupyterHub and Dask-Worker images from the main codebase
- See https://github.com/nebari-dev/nebari-docker-images for images
- Add support for Python 3.10
- Add support for Terraform binary download for M1 Mac
- Add option to supply additional arguments to ingress from qhub-config.yaml
- Add support for Kubernetes Kind (local)

What's Changed
* Add support for terraform binary download for M1 by aktech in https://github.com/Quansight/qhub/pull/1370
* Improvements in the QHub Cost estimate tool by HarshCasper in https://github.com/Quansight/qhub/pull/1365
* Add Python-3.10 by HarshCasper in https://github.com/Quansight/qhub/pull/1352
* Add backwards compatibility item to test checklist by viniciusdc in https://github.com/Quansight/qhub/pull/1381
* add code server version to fix build by HarshCasper in https://github.com/Quansight/qhub/pull/1383
* Update Cirun.io config to use labels by aktech in https://github.com/Quansight/qhub/pull/1379
* Decouple docker images by iameskild in https://github.com/Quansight/qhub/pull/1371
* Set LATEST_SUPPORTED_PYTHON_VERSION as str by iameskild in https://github.com/Quansight/qhub/pull/1387
* Integrate kind into local deployment to no longer require minikube for development by costrouc in https://github.com/Quansight/qhub/pull/1171
* Upgrade conda-store to 0.4.7 allow for customization by costrouc in https://github.com/Quansight/qhub/pull/1385
* [ENH] Bump conda-store to v0.4.9 by viniciusdc in https://github.com/Quansight/qhub/pull/1392
* [ENH] Add `pyarrow` and `s3fs` by viniciusdc in https://github.com/Quansight/qhub/pull/1393
* Fixing bug in authentication method in Conda-Store authentication by costrouc in https://github.com/Quansight/qhub/pull/1396
* CI: Merge test and release to PyPi workflows into one by HarshCasper in https://github.com/Quansight/qhub/pull/1386
* Update packages in the dashboard env by iameskild in https://github.com/Quansight/qhub/pull/1402
* BUG: Setting behind proxy setting in conda-store to be aware of http vs. https by costrouc in https://github.com/Quansight/qhub/pull/1404
* Minor update to release workflow by iameskild in https://github.com/Quansight/qhub/pull/1406
* Clean up release workflow by iameskild in https://github.com/Quansight/qhub/pull/1407
* Add release notes for v0.4.4 by iameskild in https://github.com/Quansight/qhub/pull/1408
* Update Ingress overrides behaviour by viniciusdc in https://github.com/Quansight/qhub/pull/1420
* Preserve conda-store image permissions by iameskild in https://github.com/Quansight/qhub/pull/1419
* Add project name to jhub helm chart release name by iameskild in https://github.com/Quansight/qhub/pull/1422
* Fix for helm extension overrides data type issue by konkapv in https://github.com/Quansight/qhub/pull/1424
* Add option to disable tls certificate by iameskild in https://github.com/Quansight/qhub/pull/1421
* Fixing provider=existing for local/existing by costrouc in https://github.com/Quansight/qhub/pull/1425
* Update release, testing checklist by iameskild in https://github.com/Quansight/qhub/pull/1397
* Add `--disable-checks` flag to deploy by iameskild in https://github.com/Quansight/qhub/pull/1429
* Adding option to supply additional arguments to ingress via `ingress.terraform_overrides.additional-arguments` by costrouc in https://github.com/Quansight/qhub/pull/1431
* Add properties to middleware crd headers by iameskild in https://github.com/Quansight/qhub/pull/1434
* Restart conda-store worker when new conda env is added to config.yaml by iameskild in https://github.com/Quansight/qhub/pull/1437
* Pin dask ipywidgets version to `7.7.1` by viniciusdc in https://github.com/Quansight/qhub/pull/1442
* Set qhub-dask version to 0.4.4 by iameskild in https://github.com/Quansight/qhub/pull/1470

New Contributors
* konkapv made their first contribution in https://github.com/Quansight/qhub/pull/1424

Feature changes and enhancements

Enhancements for this release include:
- Integrating Argo Workflow
- Integrating kbatch
- Adding `cost-estimate` CLI subcommand (Infracost)
- Add `panel-serve` as a CDS dashboard option
- Add option to use RetroLab instead of default JupyterLab


What's Changed
* Update the login/Keycloak docs page by gabalafou in https://github.com/Quansight/qhub/pull/1289
* Add configuration option so myst parser generates anchors for heading… by costrouc in https://github.com/Quansight/qhub/pull/1299
* Image scanning by HarshCasper in https://github.com/Quansight/qhub/pull/1291
* Fix display version behavior by viniciusdc in https://github.com/Quansight/qhub/pull/1275
* [Docs] Add docs about custom Identity providers for Authentication by viniciusdc in https://github.com/Quansight/qhub/pull/1273
* Add prefect token var to CI when needed by viniciusdc in https://github.com/Quansight/qhub/pull/1279
* ci: prevent image scans on main image builds by HarshCasper in https://github.com/Quansight/qhub/pull/1300
* Integrate `kbatch` by iameskild in https://github.com/Quansight/qhub/pull/1258
* add `retrolab` to the base jupyter image by tonyfast in https://github.com/Quansight/qhub/pull/1222
* Update pre-commit, remove vale by iameskild in https://github.com/Quansight/qhub/pull/1282
* Argo Workflows by Adam-D-Lewis in https://github.com/Quansight/qhub/pull/1252
* Update minio, postgresql chart repo location by iameskild in https://github.com/Quansight/qhub/pull/1308
* Fix broken AWS, set minimum desired size to 1, enable 0 scaling by tylerpotts in https://github.com/Quansight/qhub/pull/1304

Incident postmortem

Bitnami update breaks post v0.4.0 releases

On June 2, 2022, GitHub user peytondmurray reported [issue 1306](https://github.com/Quansight/qhub/issues/1306), stating that he was unable to deploy QHub using either the latest release `v0.4.1` or installing `qhub` from `main`. As verified by peytondmurray and others, during your first `qhub deploy`, the deployment halts and complains about two invalid Helm charts missing from the bitnami `index.yaml`.

[Bitnami's decision to update how long they keep old Helm charts in their index for](https://github.com/bitnami/charts/issues/10539) has essentially broken all post `v0.4.0` versions of QHub.

This is a severe bug that will affect any new user who tries to install and deploy QHub with any version less than `v0.4.2` and greater than or equal to `v0.4.0`.

Given the impact and severity of this bug, the team has decided to quickly cut a hotfix.

AWS deployment failing due to old auto-scaler helm chart

On May 27, 2022, GitHub user tylerpotts reported [issue 1302](https://github.com/Quansight/qhub/issues/1302), stating that he was unable to deploy QHub using the latest release `v0.4.1` (or installing `qhub` from `main`). As described in the original issue, the deployment failed complaining about the deprecated `v1beta` Kubernetes API. This led to the discovery that we were using an outdated `cluster_autoscaler` helm chart.

The solution is to update from `v1beta` to `v1` Kubernetes API for the appropriate resources and update the reference to the `cluster_autoscaler` helm chart.

Given the impact and severity of this bug, the team has decided to quickly cut a hotfix.

Bug fixes

This release is a hotfix for the issue summarized in the following:
* [issue 1319](https://github.com/Quansight/qhub/issues/1319)
* [issue 1306](https://github.com/Quansight/qhub/issues/1306)
* [issue 1302](https://github.com/Quansight/qhub/issues/1302)


What's Changed
* Update minio, postgresql chart repo location by iameskild in [PR 1308](https://github.com/Quansight/qhub/pull/1308)
* Fix broken AWS, set minimum desired size to 1, enable 0 scaling by tylerpotts in [PR 1304](https://github.com/Quansight/qhub/issues/1304)

Feature changes and enhancements

Enhancements for this release include:
- Add support for pinning the IP address of the load balancer via terraform overrides
- Upgrade to Conda-Store to `v0.3.15`
- Add ability to limit JupyterHub profiles based on users/groups

Bug fixes

This release addresses several bugs with a slight emphasis on stablizing the core services while also improving the end user experience.

What's Changed
* [BUG] Adding back feature of limiting profiles for users and groups by costrouc in [PR 1169](https://github.com/Quansight/qhub/pull/1169)
* DOCS: Add release notes for v0.4.0 release by HarshCasper in [PR 1170](https://github.com/Quansight/qhub/pull/1170)
* Move ipython config within jupyterlab to docker image with more robust jupyterlab ssh tests by costrouc in [PR 1143](https://github.com/Quansight/qhub/pull/1143)
* Removing custom dask_gateway from qhub and idle_timeout for dask clusters to 30 min by costrouc in [PR 1151](https://github.com/Quansight/qhub/pull/1151)
* Overrides.json now managed by qhub configmaps instead of inside docker image by costrouc in [PR 1173](https://github.com/Quansight/qhub/pull/1173)
* Adding examples to QHub jupyterlab by costrouc in [PR 1176](https://github.com/Quansight/qhub/pull/1176)
* Bump conda-store version to 0.3.12 by costrouc in [PR 1179](https://github.com/Quansight/qhub/pull/1179)
* Fixing concurrency not being specified in configuration by costrouc in [PR 1180](https://github.com/Quansight/qhub/pull/1180)
* Adding ipykernel as default to environment along with ensure conda-store restarted on config change by costrouc in [PR 1181](https://github.com/Quansight/qhub/pull/1181)
* keycloak dev docs by danlester in [PR 1184](https://github.com/Quansight/qhub/pull/1184)
* Keycloakdev2 by danlester in [PR 1185](https://github.com/Quansight/qhub/pull/1185)
* Setting minio storage to by default be same as filesystem size for Conda-Store environments by costrouc in [PR 1188](https://github.com/Quansight/qhub/pull/1188)
* Bump Conda-Store version in Qhub to 0.3.13 by costrouc in [PR 1189](https://github.com/Quansight/qhub/pull/1189)
* Upgrade mrparkers to 3.7.0 by danlester in [PR 1183](https://github.com/Quansight/qhub/pull/1183)
* Mdformat tables by danlester in [PR 1186](https://github.com/Quansight/qhub/pull/1186)
* [ImgBot] Optimize images by imgbot in [PR 1187](https://github.com/Quansight/qhub/pull/1187)
* Bump conda-store version to 0.3.14 by costrouc in [PR 1192](https://github.com/Quansight/qhub/pull/1192)
* Allow terraform init to upgrade providers within version specification by costrouc in [PR 1194](https://github.com/Quansight/qhub/pull/1194)
* Adding missing __init__ files by costrouc in [PR 1196](https://github.com/Quansight/qhub/pull/1196)

This post-release addresses the a few minor bugs and updates the release notes.
There are no breaking changes or API changes.

- Render `.gitignore`, black py files - [PR 1206](https://github.com/Quansight/qhub/pull/1206)
- Update qhub-dask pinned version - [PR 1224](https://github.com/Quansight/qhub/pull/1224)
- Update conda-store-environment variable `type` - [PR 1213](https://github.com/Quansight/qhub/pull/1213)
- Update release notes - justification for changes in `v0.4.0` - [PR 1178](https://github.com/Quansight/qhub/pull/1178)
- Merge spawner and profile env vars to ensure dashboard sharing vars are provided to dashboard servers - [PR 1237](https://github.com/Quansight/qhub/pull/1237)