Cortex

**New features**

* Multi-model caching: serve a collection of models that is collectively bigger than what will fit in memory (via LRU cache eviction) ([docs](https://docs.cortex.dev/v/0.22/deployments/realtime-api/models#multi-model-caching)) https://github.com/cortexlabs/cortex/pull/1428 https://github.com/cortexlabs/cortex/issues/619 ([RobertLucian](https://github.com/RobertLucian))
* Live reloading: support updating models in running APIs by adding new versions to the model's S3 directory ([docs](https://docs.cortex.dev/v/0.22/deployments/realtime-api/models#live-model-reloading)) https://github.com/cortexlabs/cortex/pull/1428 https://github.com/cortexlabs/cortex/issues/1252 ([RobertLucian](https://github.com/RobertLucian))
* Inter-process fairness: distribute requests within an API replica evenly across all processes https://github.com/cortexlabs/cortex/pull/1526 https://github.com/cortexlabs/cortex/issues/839 https://github.com/cortexlabs/cortex/issues/1298 ([RobertLucian](https://github.com/RobertLucian))
* Support requests between APIs within the same cluster ([docs](https://docs.cortex.dev/v/0.22/deployments/realtime-api/predictors#chaining-apis)) https://github.com/cortexlabs/cortex/pull/1503 https://github.com/cortexlabs/cortex/issues/1241 ([deliahu](https://github.com/deliahu))
* Allow overriding of CLI install path and config directory (via `$CORTEX_INSTALL_PATH` and `$CORTEX_CLI_CONFIG_DIR`) ([docs](https://docs.cortex.dev/v/0.22/miscellaneous/cli#mac-linux-os)) https://github.com/cortexlabs/cortex/pull/1521 https://github.com/cortexlabs/cortex/issues/1222 ([deliahu](https://github.com/deliahu))

**Breaking changes**

* ONNX model paths in API configuration files must now point to a directory containing a single ONNX file, rather than the onnx file itself. For example `model_path: s3://cortex-examples/onnx/yolov5-youtube/yolov5s.onnx` becomes `model_path: s3://cortex-examples/onnx/yolov5-youtube`.
* The `--env/-e` flag in all `cortex cluster` commands has been renamed to `--configure-env/-e`, and if not provided, the environment named `aws` will no longer be configured in the `cortex cluster info` command

**Bug fixes**

* Fix intermittent failed requests during rolling updates https://github.com/cortexlabs/cortex/pull/1526 https://github.com/cortexlabs/cortex/issues/814 ([RobertLucian](https://github.com/RobertLucian))
* Prevent CLI environments from getting overwritten when multiple `cortex cluster` commands are run concurrently https://github.com/cortexlabs/cortex/pull/1520 https://github.com/cortexlabs/cortex/issues/1410 ([deliahu](https://github.com/deliahu))

**Docs**

* Add [Python client docs](https://docs.cortex.dev/v/0.22/miscellaneous/python-client) https://github.com/cortexlabs/cortex/pull/1519 https://github.com/cortexlabs/cortex/issues/1502 ([deliahu](https://github.com/deliahu))
* Add guide for [running in production](https://docs.cortex.dev/v/0.22/guides/production) https://github.com/cortexlabs/cortex/pull/1513 https://github.com/cortexlabs/cortex/issues/1464 https://github.com/cortexlabs/cortex/issues/1257 ([deliahu](https://github.com/deliahu))
* Add guide for [low-cost clusters](https://docs.cortex.dev/v/0.22/guides/low-cost-clusters) https://github.com/cortexlabs/cortex/pull/1514 https://github.com/cortexlabs/cortex/issues/1425 ([deliahu](https://github.com/deliahu))
* Add guide for [using a REST API Gateway](https://docs.cortex.dev/v/0.22/guides/rest-api-gateway) https://github.com/cortexlabs/cortex/pull/1505 https://github.com/cortexlabs/cortex/issues/1228 ([deliahu](https://github.com/deliahu))
* Add guide for [troubleshooting `cortex cluster down` failures](https://docs.cortex.dev/v/0.22/troubleshooting/cluster-down) https://github.com/cortexlabs/cortex/pull/1515 https://github.com/cortexlabs/cortex/issues/1319 ([deliahu](https://github.com/deliahu))

**Misc**

* Stagger Predictor `__init__()` calls to reduce peak memory consumption https://github.com/cortexlabs/cortex/pull/1543 https://github.com/cortexlabs/cortex/issues/1450 ([RobertLucian](https://github.com/RobertLucian))
* Add `--name/-n` and `--region/-r` flags to `cortex cluster info`, `cortex cluster export`, and `cortex cluster down` commands https://github.com/cortexlabs/cortex/pull/1492 https://github.com/cortexlabs/cortex/issues/1363 ([RobertLucian](https://github.com/RobertLucian))
* Rename `--env/-e` flag to `--configure-env/-e` in `cortex cluster` commands and update its behavior https://github.com/cortexlabs/cortex/pull/1533 https://github.com/cortexlabs/cortex/issues/1412 ([deliahu](https://github.com/deliahu))
* Disallow ARM-based instances, which are not currently supported https://github.com/cortexlabs/cortex/pull/1536 ([deliahu](https://github.com/deliahu))
* Validate AWS vCPU quota is sufficient for up to `max_instances` instances when running `cortex cluster up` and `cortex cluster configure` https://github.com/cortexlabs/cortex/pull/1537 https://github.com/cortexlabs/cortex/issues/1461 ([deliahu](https://github.com/deliahu))

**New features**

* Add Python client: [pypi.org/project/cortex](https://pypi.org/project/cortex/) https://github.com/cortexlabs/cortex/pull/1449 https://github.com/cortexlabs/cortex/issues/684 ([vishalbollu](https://github.com/vishalbollu))
* Add support for private docker image registries ([docs](https://docs.cortex.dev/guides/private-docker)) https://github.com/cortexlabs/cortex/pull/1460 https://github.com/cortexlabs/cortex/issues/1113 ([deliahu](https://github.com/deliahu))

**Bug fixes**

* Fix minor BatchAPI bugs https://github.com/cortexlabs/cortex/pull/1471 https://github.com/cortexlabs/cortex/pull/1468 https://github.com/cortexlabs/cortex/pull/1480 https://github.com/cortexlabs/cortex/issues/1473 ([vishalbollu](https://github.com/vishalbollu), [RobertLucian](https://github.com/RobertLucian))
* Bypass instance limit check if AWS's API doesn't provide quota information (this was blocking cluster creation in `eu-north-1`) https://github.com/cortexlabs/cortex/pull/1439 https://github.com/cortexlabs/cortex/issues/1438 ([deliahu](https://github.com/deliahu))

**Docs**

* Add a guide for how to [install the CLI on Windows](https://docs.cortex.dev/guides/windows-cli) https://github.com/cortexlabs/cortex/pull/1476 https://github.com/cortexlabs/cortex/issues/715 ([RobertLucian](https://github.com/RobertLucian))

**Misc**

* Change default local port from 8888 to 8890 to avoid port conflicts with Jupyter https://github.com/cortexlabs/cortex/pull/1456 ([vishalbollu](https://github.com/vishalbollu))
* Disallow instance types that aren't supported by NLB https://github.com/cortexlabs/cortex/pull/1436 https://github.com/cortexlabs/cortex/issues/1433 ([deliahu](https://github.com/deliahu))
* Add `--cluster-aws-key` and `--cluster-aws-secret` flags to `cortex cluster configure` command https://github.com/cortexlabs/cortex/pull/1404 ([deliahu](https://github.com/deliahu))
* Add `--output` flag to `cortex env list` command https://github.com/cortexlabs/cortex/pull/1444 ([vishalbollu](https://github.com/vishalbollu))

**New features**

* Add `cortex cluster export` command to export all APIs running in a cluster ([docs](https://docs.cortex.dev/v/0.20/miscellaneous/cli#cluster-export)) https://github.com/cortexlabs/cortex/pull/1368 https://github.com/cortexlabs/cortex/issues/1255 ([vishalbollu](https://github.com/vishalbollu))
* Enable users to specify CIDR ranges for the cluster's VPC ([docs](https://docs.cortex.dev/v/0.20/cluster-management/config)) https://github.com/cortexlabs/cortex/pull/1388 ([vishalbollu](https://github.com/vishalbollu))
* Support json output for CLI commands (via `-o/--output json`) https://github.com/cortexlabs/cortex/pull/1365 https://github.com/cortexlabs/cortex/issues/1161 ([vishalbollu](https://github.com/vishalbollu))
* Support the nvidia device driver (nvidia-container-toolkit) when running locally https://github.com/cortexlabs/cortex/pull/1366 https://github.com/cortexlabs/cortex/issues/1223 ([vishalbollu](https://github.com/vishalbollu))

**Breaking changes**

* The valid values for `api_gateway` in the cluster configuration file have been changed from `enabled`/`disabled` to `public`/`none` (to match the values for `networking.api_gateway` in the API configuration file).

**Bug fixes**

* Support AWS tags with spaces and valid special characters https://github.com/cortexlabs/cortex/pull/1374 https://github.com/cortexlabs/cortex/pull/1355 https://github.com/cortexlabs/cortex/pull/1380 https://github.com/cortexlabs/cortex/pull/1385 https://github.com/cortexlabs/cortex/issues/1373 ([deliahu](https://github.com/deliahu))
* Fix tensor shape validation for the TensorFlow predictor https://github.com/cortexlabs/cortex/pull/1311 https://github.com/cortexlabs/cortex/issues/1310 ([RobertLucian](https://github.com/RobertLucian))
* Allow `cortex cluster *` commands to be run from within a docker container https://github.com/cortexlabs/cortex/pull/1370 https://github.com/cortexlabs/cortex/issues/1361 https://github.com/cortexlabs/cortex/issues/1325 ([deliahu](https://github.com/deliahu))

**New examples**

* [pytorch/question-generator](https://github.com/cortexlabs/cortex/tree/0.20/examples/pytorch/question-generator) to generate questions given text and the correct answer (uses transformers and spacy) https://github.com/cortexlabs/cortex/pull/1308 ([ismaelc](https://github.com/ismaelc))

**Docs**

* Add documentation for how to [install a specific version of the CLI](https://docs.cortex.dev/v/0.20/miscellaneous/cli#installing-a-specific-version-of-the-cli) https://github.com/cortexlabs/cortex/pull/1386 https://github.com/cortexlabs/cortex/issues/1244 ([vishalbollu](https://github.com/vishalbollu))
* Add sections for [overprovisioning](https://docs.cortex.dev/v/0.20/deployments/realtime-api/autoscaling#autoscaling-instancesoverprovisioning) and [responsiveness](https://docs.cortex.dev/v/0.20/deployments/realtime-api/autoscaling#autoscaling-instancesa-note-about-autoscaling-responsiveness) to autoscaling docs https://github.com/cortexlabs/cortex/pull/1397 ([deliahu](https://github.com/deliahu))
* Add [documentation](https://docs.cortex.dev/v/0.20/miscellaneous/security#running-cortex-cluster-commands-from-different-iam-users) for how to allow IAM users who did not create the cortex cluster to run `cortex cluster *` commands https://github.com/cortexlabs/cortex/pull/1392 https://github.com/cortexlabs/cortex/issues/1391 ([deliahu](https://github.com/deliahu))
* Add guide for [setting up `kubectl`](https://docs.cortex.dev/v/0.20/guides/kubectl-setup) to access the cluster https://github.com/cortexlabs/cortex/pull/1344 https://github.com/cortexlabs/cortex/issues/1343 ([RobertLucian](https://github.com/RobertLucian))

**Misc**

* Update sources of AWS credentials for `cortex cluster *` commands, and improve transparency ([docs](https://docs.cortex.dev/v/0.20/miscellaneous/security#iam-permissions)) https://github.com/cortexlabs/cortex/pull/1378 https://github.com/cortexlabs/cortex/issues/1229 ([vishalbollu](https://github.com/vishalbollu))
* Rename cluster `api_gateway` config values to match API config https://github.com/cortexlabs/cortex/pull/1335 https://github.com/cortexlabs/cortex/issues/1334 ([deliahu](https://github.com/deliahu))
* Set the default value for `networking.api_gateway` in the API configuration to `none` if api gateway is disabled cluster-wide https://github.com/cortexlabs/cortex/pull/1337 https://github.com/cortexlabs/cortex/issues/1336 ([deliahu](https://github.com/deliahu))
* Support **c6g** and **r6g** instances https://github.com/cortexlabs/cortex/pull/1332 https://github.com/cortexlabs/cortex/issues/809 ([deliahu](https://github.com/deliahu))
* Display autoscaling group activity history when `cortex cluster up` fails https://github.com/cortexlabs/cortex/pull/1342 https://github.com/cortexlabs/cortex/issues/1340 ([deliahu](https://github.com/deliahu))
* Print debug info if `cortex cluster up` times out https://github.com/cortexlabs/cortex/pull/1396 ([deliahu](https://github.com/deliahu))
* Add Inferentia compute statistics to `cortex cluster info` command https://github.com/cortexlabs/cortex/pull/1354 https://github.com/cortexlabs/cortex/issues/1304 ([RobertLucian](https://github.com/RobertLucian))
* Disable prompts in `get-cli.sh` if not running interactively https://github.com/cortexlabs/cortex/pull/1372 https://github.com/cortexlabs/cortex/issues/1371 ([deliahu](https://github.com/deliahu))
* Update `cortex help` output https://github.com/cortexlabs/cortex/pull/1398 ([deliahu](https://github.com/deliahu))

**New features**

* Support batch APIs [docs](https://docs.cortex.dev/v/0.19/deployments/batch-api) https://github.com/cortexlabs/cortex/pull/1203 https://github.com/cortexlabs/cortex/issues/523 ([vishalbollu](https://github.com/vishalbollu))
* Support traffic splitting (enables A/B testing, multi-armed bandit, etc) [docs](https://docs.cortex.dev/v/0.19/deployments/realtime-api/traffic-splitter) https://github.com/cortexlabs/cortex/pull/1213 https://github.com/cortexlabs/cortex/pull/1270 https://github.com/cortexlabs/cortex/issues/1132 https://github.com/cortexlabs/cortex/issues/275 https://github.com/cortexlabs/cortex/issues/1089 ([tthebst](https://github.com/tthebst))
* Support server-side request batching for the TensorFlow Predictor [docs](https://docs.cortex.dev/v/0.19/deployments/realtime-api/parallelism#server-side-batching) https://github.com/cortexlabs/cortex/pull/1193 https://github.com/cortexlabs/cortex/issues/1060 ([RobertLucian](https://github.com/RobertLucian))
* Add `post_predict()` method to Predictor interface (runs after the response has been sent) [docs](https://docs.cortex.dev/v/0.19/deployments/realtime-api/predictors) https://github.com/cortexlabs/cortex/pull/1237 https://github.com/cortexlabs/cortex/issues/954 ([RobertLucian](https://github.com/RobertLucian))
* Support disabling API Gateway cluster-wide [docs](https://docs.cortex.dev/v/0.19/cluster-management/config) https://github.com/cortexlabs/cortex/pull/1259 https://github.com/cortexlabs/cortex/issues/1198 ([deliahu](https://github.com/deliahu))
* Support different CUDA versions for the slim Python Predictor image [docs](https://docs.cortex.dev/v/0.19/advanced/system-packages#custom-docker-image) https://github.com/cortexlabs/cortex/pull/1263 https://github.com/cortexlabs/cortex/issues/923 https://github.com/cortexlabs/cortex/issues/1254 ([RobertLucian](https://github.com/RobertLucian))
* Add additional widgets to the CloudWatch Dashboard (avg in-flight requests per replica, active replicas) [docs](https://docs.cortex.dev/v/0.19/guides/metrics) https://github.com/cortexlabs/cortex/pull/1181 ([RobertLucian](https://github.com/RobertLucian))

**Breaking changes**

* `kind` is now a required top-level field for all API configurations. Existing APIs should add `kind: RealtimeAPI`. This release adds support for `kind: BatchAPI` and `kind: TrafficSplitter`.

**Bug fixes**

* Fix `python_path` config field https://github.com/cortexlabs/cortex/pull/1202 ([deliahu](https://github.com/deliahu))
* Fix local TensorFlow deploy from parent directory https://github.com/cortexlabs/cortex/pull/1274 ([deliahu](https://github.com/deliahu))
* Improve error response for invalid payloads https://github.com/cortexlabs/cortex/pull/1212 https://github.com/cortexlabs/cortex/issues/1208 ([RobertLucian](https://github.com/RobertLucian))

**New examples**

* [onnx/yolov5-youtube](https://github.com/cortexlabs/cortex/tree/0.19/examples/onnx/yolov5-youtube) https://github.com/cortexlabs/cortex/pull/1201 ([dsuess](https://github.com/dsuess))
* Update PyTorch text generator example to use Hugging Face transfomers GPT-2 model https://github.com/cortexlabs/cortex/pull/1177 ([ospillinger](https://github.com/ospillinger))

**Docs**

* Update [tutorial](https://docs.cortex.dev/v/0.19/text-generator) to use the pytorch text-generator example https://github.com/cortexlabs/cortex/pull/1278 https://github.com/cortexlabs/cortex/issues/1256 ([deliahu](https://github.com/deliahu))
* Improve instructions for [updating cluster](https://docs.cortex.dev/v/0.19/cluster-management/update#upgrading-to-a-newer-version-of-cortex) without downtime https://github.com/cortexlabs/cortex/pull/1261 ([deliahu](https://github.com/deliahu))
* Mention API Gateway timeout in [404/503 API responses guide](https://docs.cortex.dev/v/0.19/troubleshooting/api-request-errors) https://github.com/cortexlabs/cortex/pull/1264 https://github.com/cortexlabs/cortex/issues/1225 ([deliahu](https://github.com/deliahu))

**Misc**

* Set tags on log groups https://github.com/cortexlabs/cortex/pull/1164 https://github.com/cortexlabs/cortex/issues/1078 ([tthebst](https://github.com/tthebst))
* Display API metrics in the CLI by API ID (rather than by API name) https://github.com/cortexlabs/cortex/pull/1216 ([vishalbollu](https://github.com/vishalbollu))
* Fix recursive error message for deploy/delete CLI commands https://github.com/cortexlabs/cortex/pull/1247 https://github.com/cortexlabs/cortex/issues/1218 ([RobertLucian](https://github.com/RobertLucian))
* Add shell completion to .zshrc file during CLI installation https://github.com/cortexlabs/cortex/pull/1265 https://github.com/cortexlabs/cortex/issues/1221 ([deliahu](https://github.com/deliahu))
* Handle OOM error when project files are too large https://github.com/cortexlabs/cortex/pull/1217 ([RobertLucian](https://github.com/RobertLucian))
* Display image pull errors https://github.com/cortexlabs/cortex/pull/1167 https://github.com/cortexlabs/cortex/issues/955 ([deliahu](https://github.com/deliahu))
* Display local Docker image pull error when out of space https://github.com/cortexlabs/cortex/pull/1238 https://github.com/cortexlabs/cortex/issues/1236 ([zouyee](https://github.com/zouyee))

**Bug fixes**

* Fix dynamic axes for ONNX models https://github.com/cortexlabs/cortex/pull/1187 https://github.com/cortexlabs/cortex/issues/1186 ([RobertLucian](https://github.com/RobertLucian))
* Fix memory node capacity calculation for multi-api configuration files https://github.com/cortexlabs/cortex/pull/1185 ([deliahu](https://github.com/deliahu))
* Check cluster-name tag when choosing load balancer for VPC Link integration https://github.com/cortexlabs/cortex/pull/1173 ([deliahu](https://github.com/deliahu))

**New guides**

* [Troubleshooting: API request errors](https://docs.cortex.dev/troubleshooting/api-request-errors) ([deliahu](https://github.com/deliahu))
* [Troubleshooting: TensorFlow session in predict()](https://docs.cortex.dev/troubleshooting/tf-session-in-predict) ([RobertLucian](https://github.com/RobertLucian))

**Misc**

* Delete API Gateway if `cluster up` fails https://github.com/cortexlabs/cortex/pull/1172 ([deliahu](https://github.com/deliahu))
* Move image version verification from serve.py to run.sh https://github.com/cortexlabs/cortex/pull/1180 https://github.com/cortexlabs/cortex/pull/1183 ([vishalbollu](https://github.com/vishalbollu))
* Add retries for resource tagging during `cluster up` https://github.com/cortexlabs/cortex/pull/1188 ([deliahu](https://github.com/deliahu))
* Use info log level when TensorFlow model is being loaded https://github.com/cortexlabs/cortex/pull/1171 ([RobertLucian](https://github.com/RobertLucian))
* Increase max number of processes per API replica to 100 https://github.com/cortexlabs/cortex/pull/1166 ([RobertLucian](https://github.com/RobertLucian))
* Allow empty cluster config https://github.com/cortexlabs/cortex/pull/1179 ([deliahu](https://github.com/deliahu))

**New features**

* Support Inferentia instances https://github.com/cortexlabs/cortex/pull/1119 https://github.com/cortexlabs/cortex/issues/654 ([RobertLucian](https://github.com/RobertLucian))
* Automatically provision HTTPS API Gateway endpoints for Cortex APIs https://github.com/cortexlabs/cortex/pull/1108 https://github.com/cortexlabs/cortex/issues/1077 ([tthebst](https://github.com/tthebst))
* Support multi-model endpoints for TensorFlow and ONNX predictors https://github.com/cortexlabs/cortex/pull/1107 https://github.com/cortexlabs/cortex/issues/890 ([RobertLucian](https://github.com/RobertLucian))
* Support local Docker images in the local environment https://github.com/cortexlabs/cortex/pull/1114 https://github.com/cortexlabs/cortex/issues/1094 ([RobertLucian](https://github.com/RobertLucian))
* Support replica parallelism fields (`processes_per_replica` and `threads_per_process`) in the local environment https://github.com/cortexlabs/cortex/pull/1158 https://github.com/cortexlabs/cortex/issues/960 https://github.com/cortexlabs/cortex/issues/1090 ([RobertLucian](https://github.com/RobertLucian))
* Support a `.env` file to export environment variables in the API container https://github.com/cortexlabs/cortex/pull/1154 https://github.com/cortexlabs/cortex/issues/1147 ([RobertLucian](https://github.com/RobertLucian), [spentaur](https://github.com/spentaur))

**Breaking changes**

* `autoscaling.workers_per_replica` and `autoscaling.threads_per_worker` have been moved/renamed to `predictor.processes_per_replica` and `predictor.threads_per_process` (see [API configuration docs](https://docs.cortex.dev/deployments/api-configuration))
* `endpoint` and `local_port` have been moved to a new sub-field called `networking` (see [API configuration docs](https://docs.cortex.dev/deployments/api-configuration))
* `model` has been renamed to `model_path` in TensorFlow and ONNX predictors (see [API configuration docs](https://docs.cortex.dev/deployments/api-configuration))

**Bug fixes**

* Prevent GPU overprovisioning during autoscaling https://github.com/cortexlabs/cortex/pull/1111 https://github.com/cortexlabs/cortex/issues/1085 ([vishalbollu](https://github.com/vishalbollu))

**New examples**

* [tensorflow/image-classifier-resnet50](https://github.com/cortexlabs/cortex/tree/0.18/examples/tensorflow/image-classifier-resnet50) and [pytorch/image-classifier-resnet50](https://github.com/cortexlabs/cortex/tree/0.18/examples/pytorch/image-classifier-resnet50) to demonstrate using Inferentia https://github.com/cortexlabs/cortex/pull/1119 ([RobertLucian](https://github.com/RobertLucian))
* [pytorch/multi-model-text-analyzer](https://github.com/cortexlabs/cortex/tree/0.18/examples/pytorch/multi-model-text-analyzer), [tensorflow/multi-model-classifier](https://github.com/cortexlabs/cortex/tree/0.18/examples/tensorflow/multi-model-classifier), and [onnx/multi-model-classifier](https://github.com/cortexlabs/cortex/tree/0.18/examples/onnx/multi-model-classifier) to demonstrate multi-model APIs https://github.com/cortexlabs/cortex/pull/1107 ([RobertLucian](https://github.com/RobertLucian))

**New guides**

* [Multi-model endpoints](https://docs.cortex.dev/guides/multi-model) using TensorFlow and ONNX predictors https://github.com/cortexlabs/cortex/pull/1107 ([RobertLucian](https://github.com/RobertLucian))

**Docs**

* Add [API architecture diagram](https://docs.cortex.dev/deployments/networking) https://github.com/cortexlabs/cortex/pull/1126 ([deliahu](https://github.com/deliahu))
* Add documentation for [configuring the CLI on a new machine](https://docs.cortex.dev/miscellaneous/environments) https://github.com/cortexlabs/cortex/pull/1127 ([deliahu](https://github.com/deliahu), [javithe7](https://github.com/javithe7))

**Misc**

* Call predictor `__init__()` from the request's threadpool to avoid mutlithreadding issues in some ML frameworks when using 1 thread https://github.com/cortexlabs/cortex/pull/1146 ([deliahu](https://github.com/deliahu))
* Allow changing an API's endpoint to not trigger a rolling replica update https://github.com/cortexlabs/cortex/pull/1155 https://github.com/cortexlabs/cortex/issues/1116 ([deliahu](https://github.com/deliahu))
* Set the default shell to `bash` in Predictor Dockerfiles (which simplifies using them as base images for custom-built images) https://github.com/cortexlabs/cortex/pull/1104 https://github.com/cortexlabs/cortex/issues/1086 ([RobertLucian](https://github.com/RobertLucian))
* Move `endpoint` and `local_port` to `networking` API config https://github.com/cortexlabs/cortex/pull/1151 https://github.com/cortexlabs/cortex/issues/1091 ([deliahu](https://github.com/deliahu))
* Rename `model` to `model_path` in API config https://github.com/cortexlabs/cortex/pull/1150 https://github.com/cortexlabs/cortex/issues/1115 ([deliahu](https://github.com/deliahu))
* Use cluster name for cloudwatch metrics namespace https://github.com/cortexlabs/cortex/pull/1138 ([deliahu](https://github.com/deliahu))
* Misc UI improvements https://github.com/cortexlabs/cortex/pull/1159 https://github.com/cortexlabs/cortex/pull/1084 https://github.com/cortexlabs/cortex/pull/1152 https://github.com/cortexlabs/cortex/pull/1136 https://github.com/cortexlabs/cortex/pull/1128 https://github.com/cortexlabs/cortex/commit/a52f0a0a7871253c8fdd13eac7116cf4b2e961c1 https://github.com/cortexlabs/cortex/pull/1096 ([deliahu](https://github.com/deliahu))