Determined

Changelog

* 7cc610754 chore: bump version: 0.19.1-rc2 -> 0.19.1
* 5feb1dcc6 docs: add release notes for 0.19.1 (4768)
* 60b06ded7 chore: bump version: 0.19.1-rc1 -> 0.19.1-rc2
* 6797dbadd fix: tensorboard metrics step count [DET-8028] (4761)
* b7ef72696 chore: bump version: 0.19.1-rc0 -> 0.19.1-rc1
* 1706a0cfe fix: allow changing max_length units in HP Search (4755)
* 086942f0e chore: bump version: 0.19.1-dev0 -> 0.19.1-rc0
* 14cff265d ci: unversion workflows (4752)
* f080a6334 chore: lock api state for backward compatibility check
* f26428129 fix: Write change-password script in /tmp instead of CWD (4677)
* ebc79c28b fix: python sdk can parse master output again (4745)
* 2b415761b chore: update docker images names (4727)
* 286194d6c fix: deepspeedtrial validation batch size computation (4743)
* ce780672b chore: [Ant Design] replace old menu with new menu (4741)
* 6de74a507 docs: add release note for fix for searcher early termination bug (4739)
* bf6fff383 fix: url-encode description of notebook and tensorboard (4718)
* 933494528 fix: fix an issue with forbidden api actions causing logout (4737)
* e69576307 style: fix mobile exp header [DET-7975] (4733)
* 73fe5b6bd fix: hardcode pathname instead of using `paths` (4740)
* a071fc648 test: test cases for `shared/utils/routes.ts` [DET-7902] (4706)
* e5fa6fdbc style: remove styling that forced padding to be 0 (4734)
* d8d7e252d fix: remove the default theme from initialization (4698)
* 5adbf42db feat: add spinner to show trial fetching (4683)
* 464f68c4b test: add tests for experiment detail page [DET-7979] (4723)
* a09e81d9a fix: cursor in modal text field jumps to end of input (4691)
* 3fcb98531 chore: add regex in `InlineEditor` [DET-7518] (4716)
* 5ef83ba19 chore: share sort utilities [DET-7970] (4711)
* feabd4595 fix: breadcrumb text color (4720)
* bd542a038 fix: resolve issues around `InlineEditor` [DET-7914] (4713)
* 2ea79464d test: add tests for settings page [DET-7966] (4717)
* 2724b707b chore: Remove unnecessary imports and fields in proto (4710)
* eef660fd5 fix: WebUI workspace pagination [DET-7927] (4700)
* aad801115 refactor: authz provider implementation and authz users basic implementation (4676)
* 2c575fd94 fix: record operations at the right places around shutting down (4719)
* 9ab7dae72 chore: clear selected item when clear filters (4714)
* b089329ef feat: One-Click Hyperparameter Search [DET-7537] [DET-7538] (4458)
* 02be458d4 test: add wait utils test coverage [DET-7959] (4701)
* bd8664ad1 fix: fix low contrast issue for button styles [DET-7958] (4692)
* 05800e21b test: update path conditionals for gh workflows (4708)
* 332270af2 style: fix doc tile styling (dark mode support and responsive) [DET-7955] (4709)
* c78b1526a fix: mark all 4xx api failures as auth failure (4690)
* 972954d82 feat: Connect trial UI to workloads API; pass sort/filter to API (4407)
* b97198b44 test: add samlauth tests (4685)
* 2c26b4619 docs: add rest api reference link and rewrite rest api doc (4688)
* c2968d68e docs: port slurm deployment to oss docs (4653)
* 3623b0ce5 test: WebUI interaction test for page [DET-7894] (4689)
* 55aa326e7 refactor: test cases for `ActionDropdown` (4699)
* 938a48614 fix: push-shared target's directory change (4672)
* da5f7fe3f fix: keyboard doesnt show for inline editor in mobile [DET-7519] (4659)
* 0016fd7c5 fix: word break in description (4697)
* 6a8856c60 fix: move some libs in package.json (4687)
* 20d48be12 chore: support enum sizes for avatar (4686)
* 84631abff test: add test cases for `string.ts` (4679)
* 8d2a82103 test: create interaction tests for action dropdown [DET-7895] (4684)
* 5c1679da5 test: add test coverage for shared error utilities [DET-7900] (4666)
* ed65d20c9 ci(lint-python): migrate to gha workflow (4639)
* 4c3e9f2c4 test: add test cases for `Image.tsx` (4667)
* aedaa589a chore: bump version: 0.19.0-dev0 -> 0.19.1-dev0
* 63b2dac9b docs: add release notes for 0.19.0 (4671)
* 4eeaa51cd chore: update live docs script for extension change (4678)
* 53ed638cf test: add test cases for `Icon.tsx` (4664)
* 2a115c494 test: add unit tests for logger class [DET-7901] (4674)
* 20b682afe feat: add new PyTorchCallbacks [DET-7760] (4500)
* a9f4a8724 refactor: remove unused code in model version detail page (4670)
* 725c74fd9 fix: persist task state update in interactive task view (4662)
* 31155099b feat: Create user UI [DET-7847] (4665)
* fac341c49 fix: Count only active tasks in cluster info board (4658)
* 9651e0dcb chore: update codecov badge to reflect web only (4661)
* 69a8668e4 fix: comment to gen swagger for model def API [DET-7926] (4657)
* 17f39260f test: utils/set unit tests [DET-7904] (4655)
* a42bd971a fix: description overflowing table cell (4656)
* 65ba5d652 test: add test cases for `AvatarCard` (4650)
* ad70ce8de feat: task specific actions to job overflow menu (4638)
* dc1ecfbce ci(lint-bindings): migrate to gha workflow (4642)
* 6b341f29e ci(lint-go): migrate to gha workflow (4636)
* cd5cbec95 docs: fix a typo in docs for Elasticsearch-backed logging (4228)


Docker images

- `docker pull determinedai/determined-master:0.19.1`
- `docker pull determinedai/determined-master:7cc610754`
- `docker pull determinedai/determined-master:7cc610754b2f6828240e07cb222a31da71df4f10`
- `docker pull determinedai/determined-dev:determined-master-7cc610754`
- `docker pull determinedai/determined-dev:determined-master-7cc610754b2f6828240e07cb222a31da71df4f10`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:0.19.1`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:7cc610754`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:7cc610754b2f6828240e07cb222a31da71df4f10`

Changelog

* 5497b5114 chore: bump version: 0.19.0-rc2 -> 0.19.0
* d4a101ce5 docs: add release notes for 0.19.0 (4671)
* 35c926f55 chore: bump version: 0.19.0-rc1 -> 0.19.0-rc2
* 1f0a22ea2 fix: Count only active tasks in cluster info board (4658)
* 0785b6962 chore: bump version: 0.19.0-rc0 -> 0.19.0-rc1
* 86ba506ea fix: description overflowing table cell (4656)
* 90f3c269a chore: bump version: 0.19.0-dev0 -> 0.19.0-rc0
* f296b9e76 chore: lock api state for backward compatibility check
* 7ae6674d0 chore: bump version: 0.18.5-dev0 -> 0.19.0-dev0
* 704c36b78 chore: hide user management for now (4652)
* c1dc69b3d ci: long running det_deploy_local stress test to upstream (4643)
* 74349af83 fix: change average_training_metrics default to true [DET-7240] (4646)
* 801642625 fix: update resource pool job queues to paginate properly (4579)
* bc9ec2baa chore: test improvement for _pytorch_context and _pytorch_trial [DET-7761] [DET-7763] (4494)
* ffc1b34cc style: fix avatar card for long names (4644)
* 5d57eabc1 style: fix disabled primary button style (4645)
* c980fead0 fix: model deital bugs (4640)
* 9032f67c1 feat: enable open telemetry in agent [DET 7085] (4276)
* 562532351 chore: install ptl in startup hooks (4380)
* 69083b993 fix: minor bugs in test config creation (4515)
* 84a63b604 feat: allow DET_PASS and DET_USER to skip need for login [DET-7025] (4597)
* c4e32ba14 style: update account layout [ET-7829] (4627)
* f8c8c9954 fix: agent entrypoint should use `exec`. [DET-7834] (4641)
* ead85bb88 feat: support pagination in bun (4634)
* 331376e97 build: skip det-deploy-local for webui only changes (4628)
* 2acd1235d feat: Show active experiment and task count on resources page [DET-7680] (4566)
* 8bd2c8455 feat: User management list view [DET-7796] (4607)
* be07453df chore: fix docs/.gitignore to use .rst (4633)
* de18b887e chore: allow setting context type for useModal (4612)
* 177ae9606 chore: handle new type-pyopenssl pacakage (4632)
* 2da2ed2a1 test: fix EditableMetadata test flake (4610)
* 96a3a15df chore: enhance GitHub issue templates (4630)
* b5b99f59d ci(lint-docs): migrate to gha workflow (4621)
* a89d7b350 docs: apply formatting again
* b7d28bb68 docs: complete switch from `txt` to `rst` extensions
* ad0c12998 chore: implement closeBar feature for omnibar (3306)
* 3358e9092 chore: remove getProjectExperiments and merge into getExperiments (4606)
* 271f5e929 Adding issues template
* 27da5e8d1 ci: test downstream (4604)
* b1d36043c fix: reject reconnecting agents with different device configuration [DET-7568] (4381)
* 4336924cc ci(circleci): remove determined-ci context ref (4613)
* ce0f89da9 docs: model definition file cache (4609)
* 6742e1a4a chore: add attr to track api state has been initialized (4599)
* e409e7185 chore: share useModal hook [DET-7781] (4571)
* e1618399f fix: flaky test caused by compare stats [DET-7838] (4576)
* a17c043fd fix: rocm-smi workaround without product info (4553)
* 1d87dcf7b style: fix spacing for tabs and headers [DET-7823] (4595)
* 8e52a7988 docs: shorten landing page tile descriptions (4605)
* d149a54aa fix: Drop rendezvous interface warning (FOUNDENG-139) (4594)
* 066c11e3f fix: helm option "defaultPassword" caused the deployment to hang [DET-7814] (4570)
* 6362a3083 ci(lint-react): migrate to gha workflow (4592)
* 0d0f89ba0 ci(lint-secrets): migrate to gha workflow (4591)
* a5ca19e67 feat: text search for task/trial logs [DET-7446] (4577)
* fb4dba510 chore: add cache to tools/devcluster.yaml (4584)
* 0e0784e30 docs: restructure content (4484)
* db32a6434 fix: ignore order for Set isEqual [DET-7822] (4589)
* 9c79ea844 test: switch hamid with a one line check (4596)
* 881ef6859 chore: update relative import styles to absolute (4581)
* 10205cdaa docs: update description of telemetry reporting (4175)
* 0c6020972 feat: add sort and order to users api [DET-7828] (4573)
* 6d3065d2a feat: open tasks in embedded task view in CLI [DET-7686] (4563)
* 58fc5b11b fix: notebook ignores --template CLI param and notebooks still launch if --preview param is set [DET-7632] (4476)
* d81faa2ab fix: zero slot tasks k8s using wrong image and exposing all GPUs [DET-7808] (4586)
* deef8819a ci(test-cli): migrate to gha workflow (4575)
* 05827e122 ci(test-e2e): move optional jobs into own workflow (4587)
* 823e322ce fix: allow zero slots for JupyterLab in modal (4582)
* 52c5a0006 chore: tweak ilia's CODEOWNERS. (4580)
* 85531d1e9 chore: rbac query params [DET-7843] (4583)
* 75706262e refactor: move user settings to page [DET-7795] (4550)
* 31fff14f2 fix: double scroll bar (4578)
* 3897a5000 fix: storybook rendering issue (4554)
* b1818a472 fix: missing `key` for rows (4564)
* 91811cf1c refactor: replace antd Space with flexbox gap in SelectFilter (4569)
* facb23491 chore: add docs to codeowners (4568)
* 46888f001 fix: expconf copy timeout too short causing errors (4567)
* 9559b99d5 fix: race condition on experiment config for 'det e create --paused' [DET-7789] (4533)
* 09dfaf5d0 chore: eslint keyword spacing (4561)
* 011ca00e7 chore: update eslint array multiline and add eslint arrow paren (4562)
* d5f897715 feat: Place experiment in a project using CLI [DET-7720] (4552)
* cb92dd6a1 feat: add dynamic page title to embedded task page [DET-7681] (4555)
* 48b6c321a refactor: make sso a plugin [DET-7560] (4559)
* 2bb461ee7 feat: remove reset column widths button [DET-7675] (4558)
* 5a163d80e chore: bump version: 0.18.4-dev0 -> 0.18.5-dev0
* d109ef4b0 docs: add release notes for 0.18.4 (4547)
* f519b39a4 style: add gofumpt (4217)
* 002d9502a ci(scan-docker-images): migrate to gha (4546)
* 495f40937 ci: switch to custom-built container image (4535)
* f13c2377e perf: improve deepspeed checkpointing for sharedfs (3905)
* 92bf7c5e2 feat: api to expose experiment model code [DET-7465] (4374)
* 00c290949 feat: Web UI request checkpoint deletion [DET-7113] (4545)
* 9907bc728 fix: increase time to wait for command in priority scheduler test (4544)
* 2d59d25ed chore: remove activemetric duplication [DET-7737] (4469)
* ff758fd3d fix: correct allocation end times when cluster heartbeat is before allocation start time (4556)
* 8ae44d4ca fix: hide description placeholder when archived (4551)
* 1e6da7b1c fix: rename window title (4548)
* 276088514 fix: polish cluster page UI [DET-7682] (4508)
* 85f72ede7 feat: update allocation bar legend logic [DET-7683] (4510)
* 5e1bd1a4a chore: update omnibar with new theme variables (4528)
* 9045e2169 fix: tensorboard redirecting due to missing rp (4542)
* d0d23beee fix: scroll bar overlap (4538)
* 20ac53809 feat: use skeleton component for rendering the table while fetching data (4462)
* 7ddc8ad88 chore: agent sends log level with agent added container logs (4532)
* 937964e64 chore: temporary-disable-dependabumps (4541)
* 6004b8992 fix: rename lable `restarts` to `auto restarts` (4536)
* 633be08a1 fix: change `short ID` width (4537)
* 1e66cabc8 test: disable flaky test for now (4530)
* 7a54c9acc fix: persist whose workspaces/projects (4525)
* b673e34ed test: update avatar tests to remove warnings (4523)
* bdfa9fa64 fix: text color in Hyperparameters page (4529)
* e9ea762d0 fix: skip gzip only for proxy web assets [DET-7802] (4517)
* 82d1144d2 feat: docker auth improvements [DET-7633, DET-7636] (4513)


Docker images

- `docker pull determinedai/determined-master:0.19.0`
- `docker pull determinedai/determined-master:5497b5114`
- `docker pull determinedai/determined-master:5497b5114db5546f1ecaa2349dd6e8c4c3638fd5`
- `docker pull determinedai/determined-dev:determined-master-5497b5114`
- `docker pull determinedai/determined-dev:determined-master-5497b5114db5546f1ecaa2349dd6e8c4c3638fd5`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:0.19.0`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:5497b5114`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:5497b5114db5546f1ecaa2349dd6e8c4c3638fd5`

Changelog

* 710d5575b chore: bump version: 0.18.4-rc4 -> 0.18.4
* 990e62b04 docs: add release notes for 0.18.4 (4547)
* a12fd4520 chore: bump version: 0.18.4-rc3 -> 0.18.4-rc4
* 57e4e7e8a chore: bump version: 0.18.4-rc2 -> 0.18.4-rc3
* 06dcaacc0 chore: bump version: 0.18.4-rc1 -> 0.18.4-rc2
* 09bf496ab fix: correct allocation end times when cluster heartbeat is before allocation start time (4556)
* 75d52378c chore: bump version: 0.18.4-rc0 -> 0.18.4-rc1
* 47f920731 fix: tensorboard redirecting due to missing rp (4542)
* 56bf894de chore: bump version: 0.18.4-dev0 -> 0.18.4-rc0
* 900b134cd chore: lock api state for backward compatibility check
* a14986bbf test: `set_priority` should respect the master url. (4527)
* 8a3c07a39 test: bring back tests for generic commands on master restarts. (4490)
* 73268ac6b docs: add ClusterInfo docs (4496)
* 9a34b3d48 chore: bumpenvs (4520)
* b1a292731 fix: ensure correct master url is used for priority scheduler and other managed devcluster tests. (4512)
* 667e313c8 fix: deepspeed examples config (4511)
* 2f6373ce5 style: add uplot cursor styles for dark mode (4502)
* 7657c15c1 feat: add props to style avatar differently (4514)
* 5272c0916 test: set up shared web to test with local strategy (4504)
* 2f0950317 chore: bump version: 0.18.3-dev0 -> 0.18.4-dev0
* 5f30b6714 docs: add release notes for 0.18.3 (4491)
* 758c2e929 test: fix local time tests (4503)
* 2a968bf7a fix: give a reasonable name to model def download (4493)
* 7e20b5d11 docs: minor improvements and Homebrew build instructions (4489)
* 38fe30220 chore: add helpers for working with shared-code (4452)
* 28c7b895d fix: make actor system `GetOrElseTimeout` actually timeout. (4499)
* 5a4198677 feat: environment_variables in task_container_defaults [DET-7638] (4485)
* 1184bb3dd test: fix editable metadata test flake (4495)
* 7898dc1a6 style: theme tuning [DET-7362, DET-7363, DET-7364, DET-7365, DET-7366, DET-7383, DET-7425, DET-7498, DET-7551] (4378)
* cd28b37a1 chore: fix react fmt (4487)
* 97d3e6029 refactor: update modals to better support contexts [DET-6297] (4468)
* 855e8324b fix: allocation errors on finished hp search [DET-7724] (4467)
* ce296c5f4 fix: correct path selector for tensorboard upload (4474)
* c3d650984 fix: add priority scheduler e2e tests [DET-7106] (4429)
* 7e50a0416 fix: close button should not show in non-embedded log viewer [DET-7723] (4447)
* 1d61f3a32 fix: adjust spinner for the InlineEditor (4367)
* a69813bfa feat: persist user web setting [DET-7501] (4394)
* be48f7654 feat: support non-root init container k8s [DET-7109] (4460)
* 2015f145e fix: disable pointer events on log viewer spinner block (4470)
* db65bf45a test: tweak `test_agent_reconnect_keep_experiment` test timeouts. (4465)
* 5f1340767 chore: bump the resources for react tests (4459)
* 60ec81f14 fix: sync agent actor init on master restart [DET-7746] (4463)
* 473f7b620 fix: loadingState cleanup for WorkspaceList (4461)
* e1fd06275 feat: add spinner to tiral/experiment tabs to show data fetching (4436)
* d123d90c3 ci: fix autolabeling for shared (4456)
* 7347bb66b test: update ci job for testing shared-code (4444)
* 6450aa140 docs: workspaces docs (4448)
* a1a06c4ac fix: trim workspace and project name whitespace [DET-7390] [DET-7747] (4451)
* 908cdb19e docs: PyTorchTrialCallback.on_validation_end (4457)
* e9144916c ci: add codeowners for shared directory (4455)
* d28d1c245 chore: share AvatarCard and Avatar comps [DET-7714 DET-7713] (4430)
* efc5ffb06 fix: only call move API for permissioned experiments (4445)
* 62b9a2df3 fix: map name to name instead of description in getProjectExperiments (4450)
* 6475a19c7 fix: mac path for --agent-config-path (4449)
* df830a118 fix: long tag wrap (4446)
* 10022e8ed fix: various workspaces fixes (4443)
* 6790aee73 feat: master config option for additional fluent outputs [DET-7549] (4415)
* c0ddb8dbd chore: webui changes for slurm (4427)
* 4df29fcd1 chore: resolve warnings from yaml and numpy, fix supposed fstrings, black formatting (4372)


Docker images

- `docker pull determinedai/determined-master:0.18.4`
- `docker pull determinedai/determined-master:710d5575b`
- `docker pull determinedai/determined-master:710d5575b8565fc50b5e65143b0b27dd661b0d17`
- `docker pull determinedai/determined-dev:determined-master-710d5575b`
- `docker pull determinedai/determined-dev:determined-master-710d5575b8565fc50b5e65143b0b27dd661b0d17`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:0.18.4`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:710d5575b`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:710d5575b8565fc50b5e65143b0b27dd661b0d17`

Changelog

* 5cf7e8b5a chore: bump version: 0.18.3-rc8 -> 0.18.3
* 6d19e1795 docs: add release notes for 0.18.3 (4491)
* a7cc461ff chore: bump version: 0.18.3-rc7 -> 0.18.3-rc8
* 6dba678bb fix: make actor system `GetOrElseTimeout` actually timeout. (4499)
* 250aca7b0 chore: bump version: 0.18.3-rc6 -> 0.18.3-rc7
* f02911147 chore: bump version: 0.18.3-rc5 -> 0.18.3-rc6
* 73fd9f09b fix: allocation errors on finished hp search [DET-7724] (4467)
* c85186be2 fix: correct path selector for tensorboard upload (4474)
* 2193001e0 feat: support non-root init container k8s [DET-7109] (4460)
* 40d4cd149 chore: bump version: 0.18.3-rc4 -> 0.18.3-rc5
* d996a96a0 fix: sync agent actor init on master restart [DET-7746] (4463)
* 97b5a0c5e fix: loadingState cleanup for WorkspaceList (4461)
* e2fb0f865 docs: workspaces docs (4448)
* d835b1e8a fix: trim workspace and project name whitespace [DET-7390] [DET-7747] (4451)
* bcb8b3ea9 chore: bump version: 0.18.3-rc3 -> 0.18.3-rc4
* e34bbe1b6 fix: map name to name instead of description in getProjectExperiments (4450)
* 9b86fc343 fix: mac path for --agent-config-path (4449)
* 0918a7123 fix: only call move API for permissioned experiments (4445)
* 5a8a4c462 chore: bump version: 0.18.3-rc2 -> 0.18.3-rc3
* 054d089b3 fix: long tag wrap (4446)
* 29f224e42 fix: various workspaces fixes (4443)
* c7d6b68bf chore: bump version: 0.18.3-rc1 -> 0.18.3-rc2
* 650cce517 chore: webui changes for slurm (4427)
* ca975c8b4 chore: bump version: 0.18.3-rc0 -> 0.18.3-rc1
* 761e6ad52 feat: master config option for additional fluent outputs [DET-7549] (4415)
* 759e5d643 chore: bump version: 0.18.3-dev0 -> 0.18.3-rc0
* ca0a7c116 chore: lock api state for backward compatibility check
* 4010b330b feat: experiment comparison page (4410)
* 030de4a39 fix: default max length properly to undefined (4437)
* 6e6420ec8 feat: task container checks for occupied gpus [DET-5091] (4323)
* e414235c9 test: resolve `useCustomizeColumnsModal` test flakes [DET-7635] (4433)
* bd576678e chore: update deepspeed launcher to work with newer versions (4156)
* 4277e991d Split 'webui/react/src/shared/' into commit '3302ddf5d45c5a73cdcbbc750936bfb32e025c06'
* 9fbf9d5d0 fix: hide continue trial for experiments with 0 or more than 1 trial (4434)
* 79b9d90b1 chore: Merge Slurm-infrastructure support changes (4376)
* 8b799e97d ci: send Docker image scans to the infrastructure engineering channel instead (4425)
* 7436c6c82 fix: properly close experiment create modal [DET-7553] (4421)
* 169c0d835 docs: clarify count requirement for grid search (4428)
* 47c393f5c test: tune web tests (4409)
* 2e8b92b27 feat: install a SIGUSR1 signal handler to print stacktraces (4281)
* bff6d1afc fix: registry auth in master.yaml (4412)
* 69d6b1e82 fix: Sync epoch_idx across all workers for PyTorchTrial [DET-7488] (4303)
* 3302ddf5d chore: make core styles and configs shareable [DET-7316] (4398)
* b8a7afcb0 chore: make core styles and configs shareable [DET-7316] (4398)
* 182af4956 fix: allocation state mismatch with proto [DET-7593] (4408)
* 2c4a77a57 chore: don't launch horovod for hypothetical zero slot trials (4414)
* e1c1eacf1 feat: shm_size can take a string with units like docker run allows (4314)
* c05ebd772 chore: migrate shared-web to subtree (4402)
* 050542264 chore: migrate shared-web to subtree (4402)
* cb1fc53fa fix: always flush tensorboard ready log (4387)
* c82d64c81 fix: End agent stats log to debug level (4411)
* b5e239714 fix: fix cluster resource pool selection [DET-7517 DET-7567 DET-7517] (4391)
* 6672fd8e1 chore: Merge Slurm-infrastructure support changes trial (4396)
* 6d0fe6bb1 fix: recover from permission error when deleting preexisting file or link (4397)
* 1e8bbac6d fix: move scale import (4406)
* 624d17904 chore: Add nolintlint to deadcode for unused oss method (4404)
* 8e50499b2 fix: Do not fail if no checkpoints to gc [FOUNDENG-83] (4405)
* e3ee40f8e fix: test agent config flake (4386)
* b701fcdf8 feat: Trial Metrics - Summary endpoints (4392)
* c9d9d5354 feat: add log scale to experiment viz (4273)
* 2d82f0148 chore: sync node version requirements with package-lock (4395)
* b2acc5daa chore: Update task logging setup [FOUNDENG-81] (290) (4389)
* 0ad82fd5f chore: Merge Slurm-infrastructure support changes task_trial (4393)
* 9149c1a49 chore: Merge Slurm-infrastructure support changes job.go (4388)
* 3d306378e chore: Merge Slurm-infrastructure support changes archive (4390)
* e9f3b1a9b feat: rolling upgrades support for generic command types (notebooks etc.) [DET-7218] (4371)
* b130e3f32 fix: Add compute driver capabilities to determined-agent Dockerfile (4385)
* 6d8ea5304 chore: Restrict display names [DET-7356] (4266)
* 72d4bcb22 fix: update experiment list tag truncate rule [DET-7530] (4373)
* c78e92eb1 feat: stress test for agent enable/disable and reconnect spam [DET-6733] (4269)
* e4a275b26 feat: add --agent-config-path to det deploy local agent-up [DET-6278] (4366)
* 7f40e8642 chore: handle setResourcePool message in commands (3571)
* 9a1ab33a3 style: ban `fmt.Println` and `fmt.Printf` in go code. (4369)
* cbc37cd74 chore: upgrade mockery to latest (4363)
* 76423ba86 fix: don't GC registered checkpoints [DET-7418] (4316)
* 81fed29cd chore: idempotent container running messages [DET-7555] (4364)
* 19f311e9e feat: workspaces and projects [DET-6461] (4203)
* d257b95e9 chore: update resource pool cloud icons [DET-7160] (4317)
* c1da1f29f chore: restrict access to master.yaml and agent.yaml to the user/owner only. (4299)
* 8d91f0fb5 ci: Add dependabot for all the things (4313)
* 058cf5cd5 ci: make test-unit-storage run on any upstream branch (4320)
* 49966efa5 feat: Tensorboard profiles from all hosts (4142)
* 762cee189 ci: merge separate codeowners (4322)
* 5e6ba22a8 chore: bump version: 0.18.2-dev0 -> 0.18.3-dev0
* bb5ccc123 docs: add release notes for 0.18.2 (4318)
* 13b6059c9 ci: create default codeowner file (4321)
* 0527c48dc fix: harness azure dependencies (4319)
* 869dea1f9 chore: upgrade to typescript 4.7 [DET-7499] (4285)
* 9c94d1fce ci: use parallelism for `test-e2e-managed-devcluster`. (4193)
* 98e4b0bd9 chore: delete dead code (4312)
* 3df0fb13c fix: provide unique port offsets to trials (4315)
* c5eb030e5 chore: drop pbt, adaptive and adaptive_simple from docs and web (4311)
* ca57ffcd6 chore: cleanup container terminations resent on agent exit (4309) [DET-7533]
* 11d17fe47 chore: add logging for e2e gpu test (4232)
* b14c28142 docs: more consistently use Determined AI vs. Determined (4310)
* 0a93e76dc fix: skip allocation check on checkpoint save to fix pulling preemption (4308)
* 4610d7071 ci: skip e2e_tests for webui
* 2e9bae652 fix: remove limit of length 4 for task id (4304)
* ee6b118d5 chore: use vanilla markdown in examples (4268)
* db5cd90d9 fix: harness dependency class fore azure (4302)
* 19aa55c61 chore: stamp out unexpected messages [DET-7492] (4284)
* 342236a33 chore: FOUNDENG-55 For deepspeed, set the NCCL_SOCKET_IFNAME env variable based on dtrain_network_interface (4297)
* 69ff97386 ci: fix log message grepped for by test_launch_layer_cifar (4301)
* 1299ef395 ci: remove overzealous assert that is a race with a quick noop task (4296)
* 5c2830431 docs: move description of agent client cert fields to the right place (4293)


Docker images

- `docker pull determinedai/determined-master:0.18.3`
- `docker pull determinedai/determined-master:5cf7e8b5a`
- `docker pull determinedai/determined-master:5cf7e8b5a6a8393b04c1d54a5363cbbe6e8792d2`
- `docker pull determinedai/determined-dev:determined-master-5cf7e8b5a`
- `docker pull determinedai/determined-dev:determined-master-5cf7e8b5a6a8393b04c1d54a5363cbbe6e8792d2`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:0.18.3`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:5cf7e8b5a`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:5cf7e8b5a6a8393b04c1d54a5363cbbe6e8792d2`

Changelog

* d214a34df chore: bump version: 0.18.2-rc2 -> 0.18.2
* 10b172bcc docs: add release notes for 0.18.2 (4318)
* 38e0efb15 chore: bump version: 0.18.2-rc1 -> 0.18.2-rc2
* c5cb23fc9 fix: harness azure dependencies (4319)
* f623c1c1e chore: bump version: 0.18.2-rc0 -> 0.18.2-rc1
* 350de3838 chore: cleanup container terminations resent on agent exit (4309) [DET-7533]
* f02f11bc5 fix: skip allocation check on checkpoint save to fix pulling preemption (4308)
* cfc0f8108 fix: remove limit of length 4 for task id (4304)
* 0645ba968 fix: harness dependency class fore azure (4302)
* 9991528a2 chore: bump version: 0.18.2-dev0 -> 0.18.2-rc0
* 86b6c28a4 chore: lock api state for backward compatibility check
* 271ae41c7 chore: ensure container terminations aren't lost in the event of network failures [DET-7440, DET-7441] (4272)
* 2d5a11865 fix: check for errors from actor asks in createResourcePoolSummary [DET-7494] (4294)
* daee03661 fix: stale agent state crashes resource pool [DET-7493] (4295)
* 4722caa95 fix: limit waiting for logger to 30 seconds (4289)
* b8f9463c6 fix: jupyterlab modal stale values, not sending values to api
* 42615b4b1 feat: add cli and api for delete checkpoints [DET-7119], [DET-7120] (4246)
* ad9bcd809 chore: restore determined_version in Trial checkpoint metadata (4288)
* 0b7dcdbd2 chore: widen node version detection to 16.29 (4290)
* 118a850da fix: pass signals through wrapper processes (4286)
* 0089ede8c fix: enable Full Configuration in appropriate modals [DET-7495] (4280)
* 45c62f20c feat: show only selected trials in learning curve
* 922b11349 chore: reduce use of any in InteractiveTable
* 5b03672a4 chore: update docs to accurate node support (4279)
* 59f686c96 fix: make trials table sort properly (4275)
* 695b30117 feat: incrementally release resources (4278)
* c0f53fa26 perf: avoid Seq Scanning raw steps (4244)
* b36596f13 fix: backslashes in show_ssh_command for windows (4260)
* ec503e06d fix: correct error message when command list fails (4235)
* 15b0525fc feat: add master-side verification for agent mTLS (4220)
* c6e824937 fix: don't hardcode /bin/which in entrypoints (4257)
* 236c24117 refactor: migrating tables to use InteractiveTable component [DET-7382] (4229)
* 156ff504b fix: reshow drop targets for customize columns modal (4199)
* 5e9962686 docs: delete mnist_tf_layers example (4263)
* 9d8223113 Revert "add autosync action"
* 8288461f5 add autosync action
* 70e534f9e fix: det task logs unable to use trial task IDs and checkpoint GC task IDs [DET-7424] (4258)
* 12d21c2e0 fix: gcs storage upstream test failure (4253)
* b09ec407e feat: improve trial logs to have some system events [DET-5885] (4215)
* c20ad4334 ci: Lints migrations to ensure new migrations have higher timestamps than old ones [DET-7146] (4250)
* da83e6509 chore: small cleanups for slurm (4211)
* b71f179aa feat: det deploy now can use --yes to skip prompts [DET-7408] (4255)
* 7b3fee44c chore: better slurm option override support (4254)
* 7af3cfe48 feat: add google cloud storage (gcs) prefix support [DET-6883] (4238)
* b5c2b14f8 docs: add enhanced launcher user guide (4248)
* eb1d9aaac chore: add dev server support for embedded tasks view (4243)
* 9d19a8704 perf: dont repeatedly reprocess profiler data
* b6582c02b ci: add check to prevent ssh git url (4240)
* 50bdbc3a8 chore: bumpenvs (4239)
* 1065314ea chore: add node_modules to eslintignore (4237)
* c74dee646 feat: Add theme toggle to user settings [DET-7321] (4204)
* 3016fc103 chore: remove legacy code/docs for NCCL/Gloo port range config (4187)
* f1e8d3cdc ci: check ulimit before 4x4 distributed test on macs (4234)
* 7d9e999cd fix: adjust page to preserve props.children (4231)
* 35258efd7 feat: Enable sending empty string for displayname with fallback to username [DET-7031] (4140)
* 2e77ec58c fix: det shell start/open, in windows (4227)
* 7217cfd94 feat: k8s detect non-det tasks (4154)
* a88f5c450 chore: share webui base page (4218)
* 15bd75895 fix: use custom image for tensor board [DET-7242] (4123)
* de926b1eb chore: fix rendezvous timeout logic (4226)
* c29e97a45 chore: base Dockerfile TensorFlow 2.6, 2.7, 2.8 security patches [DET-7325] (4223)
* 7882381cd fix: authenticate pprof endpoints [DET-7402]
* 2b0ccb830 chore: bump version: 0.18.1-dev0 -> 0.18.2-dev0
* bcbab4d92 docs: add release notes for 0.18.1 (4216)
* 034b9570c chore: revert rename of `RestoreResourcesFailure -> ResourcesFailure`. (4210)
* a7c4c2afe feat: enable agent-side mTLS for connection to master (4212)
* c9e13b64a feat: save connection in context (4213)
* 15f65ab37 feat: pix2pix example (4125)
* db987de7d chore: delete "conditional" json-schema extension (4177)
* 9b33f825c fix: use bigint for checkpoint size in `proto_get_trials_plus` (4208)
* 2c4c847d7 docs: update release note instructions with important admonition (4207)
* 138caf8f3 fix: pool detail page tab count when loading (4200)
* c5f685f18 feat: move task logs to embedded view [DET-7169] (4179)
* 54982c9be perf: tweak proto_get_trials_plus plan (4206)
* e585ebbb1 refactor: cleanup task logging shell scripts (4113)
* 4e2913f4a chore: update entrypoint in expconf docs (4198)
* fcff1c2aa fix: agent panic on commands with unusal formatted environment variables [DET-6649] (4202)
* 4172a4690 refactor: pull in user service code changes from EE (4183)
* 1c48fa618 docs: improve OpenTelemetry docs slightly (4182)
* 7f508e462 fix: allow `internal: null` for pre-0.15.6 experiments (4197)
* 55957fe06 fix: add restarts back to get_trial_ids for sorting
* dd8d3f377 feat: add det experiment logs <EXP_ID> [DET-7145] (4190)
* 3ef36d56b chore: refactor action dropdown comp to be reused [DET-7171] (4164)
* 623e60d37 ci: bust circleci cache (4189)
* af56e0103 docs: document using AWS Load Balancer on EKS [DET-6669] (4174)
* 36e56670d feat: allow enabling Prometheus monitoring through helm [DET-6993] (4158)
* 3bb7bb1d9 style: minor theme fixes and style adjustments [DET-7349] (4161)
* 2166dfc88 docs: update screen shots for cluster UI (4188)
* b7a327819 style: address new `flake8-comprehensions`, `pyzmq==23.0.0`. (4185)
* 5e1a81cb2 feat: allow setting of checkpointStorage.prefix through helm [DET-7152] (4152)
* 526e1dcc1 feat: display trial restarts [DET-7347] (4160)
* 2fdc6d710 fix: agent can now be control-C while connecting to master [DET-6287] (4178)
* d339f7be2 chore: migrate det a list to new api and bindings (4186)
* ed257d38e refactor: rip out `UseFluentLogging`. (4184)
* 21b85907b docs: update fluent-bit version. (4181)
* 4b325a558 docs: document database SSL options (4169)
* 5d228f8a5 chore: make core-api tutorial Windows-friendly (4176)
* 187505148 fix: sync slot usage for k8s [DET-7350] (4172)
* 92a944f96 chore: add .dccache to .gitignore (4173)
* 5e7a30c43 docs: fix typo in release note (4170)
* a52210f9e feat: chart sync provider [DET-7309] (4139)
* a7fafbb9a fix: enable currently active side nav item (4167)
* 0a5d54d45 chore: fix hardcoded url in schema logic (4171)
* 7df89b293 chore: allow deleting delete failed experiments (4141) [DET-7070]
* 4ef2b6771 perf: fixup query for latest training per trial (4166) [DET-7352]
* 3d3fe1cd0 fix: include both old and new checkpoints in total checkpoint size (4165)
* 4d98cee3d fix: replace carriage returns with newlines in task output [DET-5302] (3945)
* a2f878aaf chore: only warn on invalid calls to daemonize resources for slurm (4108)
* c00ce0a4c chore: check git state in lock-api-state.sh (4163)
* ec743d754 ci: turn off github annotations. (4146)
* 0efd44d08 doc: fix a broken file reference (4131)
* b911d85ed fix: avoid potential race between AllocationReady and Running state (4159)
* cc59985dc revert: partial revert of 96e0e584 (4162)
* f07633b4e fix: port collisions for multiple shared-non distributed jobs (4120) [HAL-2894]
* 80d1bb152 feat: Add embedded experience for JupyterLab and TensorBoard [DET-7162] (4134)
* 83cc1ec8f fix: prevent experiment name in header from flowing entire vertical space of screen during resize (4157)


Docker images

- `docker pull determinedai/determined-master:0.18.2`
- `docker pull determinedai/determined-master:d214a34df`
- `docker pull determinedai/determined-master:d214a34df0c0eb2e5e38ae63d1359862fd2af8f1`
- `docker pull determinedai/determined-dev:determined-master-d214a34df`
- `docker pull determinedai/determined-dev:determined-master-d214a34df0c0eb2e5e38ae63d1359862fd2af8f1`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:0.18.2`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:d214a34df`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:d214a34df0c0eb2e5e38ae63d1359862fd2af8f1`

Changelog

* 9284a3aa6 chore: bump version: 0.18.1-rc7 -> 0.18.1
* eb09c3449 docs: add release notes for 0.18.1 (4216)
* bad9a336a chore: bump version: 0.18.1-rc6 -> 0.18.1-rc7
* 6cff1b0a5 fix: use bigint for checkpoint size in `proto_get_trials_plus` (4208)
* 60291e934 chore: bump version: 0.18.1-rc5 -> 0.18.1-rc6
* 8f4a7977d perf: tweak proto_get_trials_plus plan (4206)
* 414bcd2a4 chore: bump version: 0.18.1-rc4 -> 0.18.1-rc5
* 789b39c9c fix: allow `internal: null` for pre-0.15.6 experiments (4197)
* fd27bac05 fix: add restarts back to get_trial_ids for sorting
* 845f2f06e chore: bump version: 0.18.1-rc3 -> 0.18.1-rc4
* eed09e911 docs: update screen shots for cluster UI (4188)
* 88271dd14 style: minor theme fixes and style adjustments [DET-7349] (4161)
* f2a4e5ee4 feat: display trial restarts [DET-7347] (4160)
* eaf84e681 chore: bump version: 0.18.1-rc2 -> 0.18.1-rc3
* a8ddc8208 fix: sync slot usage for k8s [DET-7350] (4172)
* 1f13710b3 fix: enable currently active side nav item (4167)
* e9333d2f1 perf: fixup query for latest training per trial (4166) [DET-7352]
* 764ef2d06 fix: include both old and new checkpoints in total checkpoint size (4165)
* 4157c82a9 chore: bump version: 0.18.1-rc1 -> 0.18.1-rc2
* e2f949ab2 chore: bump version: 0.18.1-rc0 -> 0.18.1-rc1
* 26ede20fb chore: revert scheduling docs
* 8ea2a5256 fix: prevent experiment name in header from flowing entire vertical space of screen during resize (4157)
* 1e244e048 chore: bump version: 0.18.1-dev0 -> 0.18.1-rc0
* 96e0e5840 chore: lock api state for backward compatibility check
* 82f0366dc feat: allow NaN validation metrics [DET-7177] (4150)
* 0bbeec1f7 feat: upload all tb files DET-7139 (4155)
* 90b918acf fix: adjust upscaling of column widths [DET-7220] (4138)
* 4b66bf07f feat: rolling upgrades v0 [DET-6548] (4031)
* beea2451a ci: disable most checks on ci-only changes (4118)
* 5f7e74a6c fix: upstream test failures due to config being admin protected (4153)
* da1dcd76a fix: return user data when new user is created [DET-7255] (4149)
* 1eba7a20c docs: a vain attempt to pass ci test on already approved pr4110 content changes (4151)
* 7aea015d0 fix: No redirecting url when model name is changed (4127)
* 00171f82b feat: Cluster UI improvement [DET-7072, DET-7073] (4009)
* 27e04e4d8 feat: require admin privileges for cluster managment [DET-7186] (4129)
* 09a8ff698 ci: update gke version. (4147)
* fa3a95960 ci: Increase package-and-push-system-local resource class (4143)
* 0d4fe2385 chore: fix boolean urlparams for grpc (4136)
* b1829b8c8 feat: enable SLURM preemption (4114) [FOUNDENG-21]
* b4ef2735f chore: add a local docs server (4117)
* 5dea21112 refactor: theme architecture [DET-6211] (4004)
* aef66b088 build: make docs build incremental and idempotent (4116)
* ec7007cef ci: persist debs and rpms in circleci for dev, rc, and release builds (4124)
* b89b0a359 fix: user filter on dashboard [DET-7251] (4132)
* e3e50a916 chore: add job ID and experiment labels to prometheus endpoint mappings [DET-6964] (4119)
* b0d8a935e ci: make codecov information for sure now. (4130)
* b313503d0 chore: restructure shareable webui utils and types (4112)
* 78505d6e6 ci: turn off codecov bot PR comments (4122)
* a91866fdb chore: fix rank determination for horovod with mpi (4109)
* 3368a7727 fix: NCCL interface in distributed tests (4111)
* 18aadd0dd chore: bump version: 0.18.0-dev0 -> 0.18.1-dev0
* 7500d6fc6 docs: add release notes for 0.18.0 (4102)
* 1f4a64260 chore: bump version: 0.17.16-dev0 -> 0.18.0-dev0
* 59928ec4f chore: explicit naming of preemption and coscheduler resources [DET-7140] (4101)
* ac2564b87 fix: add missing task log teardown for trials (4107)
* c41e1dcc0 docs: rework quickstart for ml developers (4091)
* 2c7564d13 chore: use reported slots available for on prem deployments (4095)
* 62049aeab chore: change codecov to informational only (4105)
* 5061a8fd3 fix: mark distributed tests as parallel (4093)
* 87b8e5396 chore: enable codecov enforcement (4084)
* 15dd7e3d4 fix: bindings sessions in experiment apis. (4096)
* eb65b09ff chore: cleanup and fixes for "det deploy" (4103)
* d78a7120a perf: improve plan for proto_get_trial_plus.sql (4073)
* a980c560b build: update submodules on webui get-deps (4082)
* 78d4e8b7d chore: HAL-2879 Cleanly shutdown all sshd servers on exit (176) (4087)
* 940f8f703 chore: Refactor JupyterLabModal pattern [DET-6276] (4072)
* ec5553ab4 chore: make container proxy support more flexible, for slurm (3948)
* 3614c83a6 chore: wait for process substition log filters [DET-6712] (3930)
* 474742f9a chore: clean up useCallback dependency (4092)
* 39588ee25 feat: add det.LOG_FORMAT constant (4090)
* bcc50f97c fix: Support rendering rank of 0 (4083)
* c523523e8 fix: consistent total slot calculation for cluster overview [DET-7182] (4080)
* 9c163497c feat: add wrap_rank helper script (4086)
* ea4a94911 fix: dont show archived in column picker [DET-7187] (4085)
* a4e5f8410 feat: authenticate task proxies (4071)
* 5fab38417 fix: wrap torch.distributed launch in pid server/client (4077)
* e73f06309 fix: use displayNames in ClusterHistoricalUsage (4059)
* 3368dd86a chore: filter out NaN, +/- Infinity metric values for charts for now. (4076)
* f8b5bf50e chore: add and consolidate code coverage to codecov (4064)
* 487b04c21 docs: release note for core api (4069)
* 15a668be9 fix: add user column back to experiment list (4070)
* 880b769ec feat: break workload info from trial endpoint into a new endpoint [DET-6729] (3635)
* d703c968c fix: show notification when delete experiment fail [DET-6811] (4051)


Docker images

- `docker pull determinedai/determined-master:0.18.1`
- `docker pull determinedai/determined-master:9284a3aa6`
- `docker pull determinedai/determined-master:9284a3aa6e307c61426c93b5e09730c664725604`
- `docker pull determinedai/determined-dev:determined-master-9284a3aa6`
- `docker pull determinedai/determined-dev:determined-master-9284a3aa6e307c61426c93b5e09730c664725604`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:0.18.1`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:9284a3aa6`
- `docker pull nvcr.io/isv-ngc-partner/determined/determined-master:9284a3aa6e307c61426c93b5e09730c664725604`