Intake-esm

What's Changed
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/363
* Bump codecov/codecov-action from 2.0.2 to 2.0.3 by dependabot in https://github.com/intake/intake-esm/pull/362
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/364
* Bump codecov/codecov-action from 2.0.3 to 2.1.0 by dependabot in https://github.com/intake/intake-esm/pull/365
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/366
* Update pydantic models by andersy005 in https://github.com/intake/intake-esm/pull/367
* Update pre-commit hooks by andersy005 in https://github.com/intake/intake-esm/pull/369
* Add Query Model by andersy005 in https://github.com/intake/intake-esm/pull/370
* Use ESMCatModel Pydantic model by andersy005 in https://github.com/intake/intake-esm/pull/368
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/371
* Add ESMDataSource by andersy005 in https://github.com/intake/intake-esm/pull/372
* Fix catalog serialization by andersy005 in https://github.com/intake/intake-esm/pull/373
* Fix `__repr__` and `__repr_html__` by andersy005 in https://github.com/intake/intake-esm/pull/374
* Ensure multi variable catalogs are parsed properly by andersy005 in https://github.com/intake/intake-esm/pull/375
* Update Pull Request Template by andersy005 in https://github.com/intake/intake-esm/pull/376
* Use pydantic.validate_arguments decorator to validate individual functions by andersy005 in https://github.com/intake/intake-esm/pull/377
* Upgrade setup/build requirements by andersy005 in https://github.com/intake/intake-esm/pull/383
* Add functionality for derived variables by andersy005 in https://github.com/intake/intake-esm/pull/379
* Rename `_types` module to `cat` by andersy005 in https://github.com/intake/intake-esm/pull/381
* Add method for loading registry from a Python module by andersy005 in https://github.com/intake/intake-esm/pull/386
* Add query to derived variables by andersy005 in https://github.com/intake/intake-esm/pull/389
* Add `skip_on_error` option when loading datasets by andersy005 in https://github.com/intake/intake-esm/pull/390
* Fix `.nunique()` and `.unique()` methods by andersy005 in https://github.com/intake/intake-esm/pull/391
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/392
* Properly check whether dataframe is empty by andersy005 in https://github.com/intake/intake-esm/pull/394
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/396
* Remove linting workflow: use pre-commit.ci by andersy005 in https://github.com/intake/intake-esm/pull/399
* ESMCat pydantic Model: make id optional by andersy005 in https://github.com/intake/intake-esm/pull/398
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/402
* Exclude buggy xarray versions by andersy005 in https://github.com/intake/intake-esm/pull/406
* Add `to_dask()` method to `esm_datastore` by d70-t in https://github.com/intake/intake-esm/pull/403
* Use mamba when building docs on Readthedocs by andersy005 in https://github.com/intake/intake-esm/pull/408
* Add to_collection method returning an Xcollection by jukent in https://github.com/intake/intake-esm/pull/405
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/410
* Added detection of "*" to enable opening of multi-file datasets. by andersy005 in https://github.com/intake/intake-esm/pull/395
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/411
* Add Docs Based on ESDS Blog Posts by mgrover1 in https://github.com/intake/intake-esm/pull/409
* Switch over to the furo theme by andersy005 in https://github.com/intake/intake-esm/pull/412
* Reorganize docs by andersy005 in https://github.com/intake/intake-esm/pull/413
* Search returns same class as self - allowing subclassing by aulemahal in https://github.com/intake/intake-esm/pull/417
* Support mixed data formats by aulemahal in https://github.com/intake/intake-esm/pull/416
* Expose `pd.DataFrame.to_csv` and `json.dump` keyword arguments by andersy005 in https://github.com/intake/intake-esm/pull/421
* Pin importlib-metadata to 2.0 by andersy005 in https://github.com/intake/intake-esm/pull/422
* Fix CI failures: don't turn warnings into errors by andersy005 in https://github.com/intake/intake-esm/pull/429
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/430
* Bump pypa/gh-action-pypi-publish from 1.4.2 to 1.5.0 by dependabot in https://github.com/intake/intake-esm/pull/431
* Fix dependency version conflict by andersy005 in https://github.com/intake/intake-esm/pull/432
* Add Python 3.10 to CI by andersy005 in https://github.com/intake/intake-esm/pull/400
* Improve search with derived variables by aulemahal in https://github.com/intake/intake-esm/pull/428
* Add pyupgrade to pre-commit hooks by andersy005 in https://github.com/intake/intake-esm/pull/433
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/438
* Support iterable columns with `require_all_on` by aulemahal in https://github.com/intake/intake-esm/pull/435
* Remove unused `df.setter` by andersy005 in https://github.com/intake/intake-esm/pull/440
* Add `last_updated` to the `ESMCatalogModel` by andersy005 in https://github.com/intake/intake-esm/pull/442
* Derived Catalog: test for all needed variables and skip if existing by aulemahal in https://github.com/intake/intake-esm/pull/441
* Subset derived variable registry only with used derived variables by aulemahal in https://github.com/intake/intake-esm/pull/446
* Bump actions/setup-python from 2 to 3 by dependabot in https://github.com/intake/intake-esm/pull/451
* Bump actions/checkout from 2 to 3 by dependabot in https://github.com/intake/intake-esm/pull/450
* Add tutorial module by jukent in https://github.com/intake/intake-esm/pull/454
* Tutorial url by jukent in https://github.com/intake/intake-esm/pull/455
* Ensure fsspec storage options are propagated to `xr.open_dataset` by jukent in https://github.com/intake/intake-esm/pull/453
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/459
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/463
* Change import to have configurable prefixes via `set_options` by aulemahal in https://github.com/intake/intake-esm/pull/460
* updating google-cmip6 cat to have more datasets by jukent in https://github.com/intake/intake-esm/pull/464
* replace references to collection with catalog by jukent in https://github.com/intake/intake-esm/pull/457
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/466
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/467
* Allow saving catalog via fsspec protocols by andersy005 in https://github.com/intake/intake-esm/pull/469
* Ensure `storage_options` are passed to `esmcat.save()` by andersy005 in https://github.com/intake/intake-esm/pull/471
* Bump codecov/codecov-action from 2.1.0 to 3.0.0 by dependabot in https://github.com/intake/intake-esm/pull/472
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/473
* Support for the grid mapping attribute and variable by RondeauG in https://github.com/intake/intake-esm/pull/449
* Bump codecov/codecov-action from 3.0.0 to 3.1.0 by dependabot in https://github.com/intake/intake-esm/pull/475
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/476
* ENH: Support Kerchunk Files by mgrover1 in https://github.com/intake/intake-esm/pull/480
* Bump actions/setup-python from 3 to 4 by dependabot in https://github.com/intake/intake-esm/pull/482
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/483
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/484
* FIX: Add fixes to allow reading kerchunk catalog by mgrover1 in https://github.com/intake/intake-esm/pull/485
* Bump styfle/cancel-workflow-action from 0.9.1 to 0.10.0 by dependabot in https://github.com/intake/intake-esm/pull/486
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/488
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/489
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/492
* Bump pypa/gh-action-pypi-publish from 1.5.0 to 1.5.1 by dependabot in https://github.com/intake/intake-esm/pull/493
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/494
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/497
* Drop support for Python 3.7 by andersy005 in https://github.com/intake/intake-esm/pull/499
* use micromamba in CI by andersy005 in https://github.com/intake/intake-esm/pull/500
* Add `get_available_cats()` method to `tutorial.py` by jukent in https://github.com/intake/intake-esm/pull/458
* Docs improvement: use sphinx-design tabs by andersy005 in https://github.com/intake/intake-esm/pull/504
* add `sphinx-design` to list of extensions by andersy005 in https://github.com/intake/intake-esm/pull/505
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/507
* ensure `storage_options` are passed to data loader by andersy005 in https://github.com/intake/intake-esm/pull/508
* Ensure global attributes added by intake-esm are compatible with netCDF and Zarr by andersy005 in https://github.com/intake/intake-esm/pull/509
* ENH: Add .to_datatree() method and remove to collection by mgrover1 in https://github.com/intake/intake-esm/pull/512
* Discard `catalog_file` attribute after a search by andersy005 in https://github.com/intake/intake-esm/pull/514
* Add `keys_info()` method by andersy005 in https://github.com/intake/intake-esm/pull/515
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/516
* upgrade dependencies by andersy005 in https://github.com/intake/intake-esm/pull/517
* [pre-commit.ci] pre-commit autoupdate by pre-commit-ci in https://github.com/intake/intake-esm/pull/519
* Reorganize the documentation by andersy005 in https://github.com/intake/intake-esm/pull/521
* DOC: Add section on intake-esm keys by mgrover1 in https://github.com/intake/intake-esm/pull/522
* Update how to guides by andersy005 in https://github.com/intake/intake-esm/pull/523
* FIX: Update default catalog location and tests by mgrover1 in https://github.com/intake/intake-esm/pull/525
* Check if all values in a groupby column are NaN or not NaN by andersy005 in https://github.com/intake/intake-esm/pull/526
* Update isort configuration to use `profile=black` by andersy005 in https://github.com/intake/intake-esm/pull/528
* Update changelog by andersy005 in https://github.com/intake/intake-esm/pull/527

New Contributors
* d70-t made their first contribution in https://github.com/intake/intake-esm/pull/403
* aulemahal made their first contribution in https://github.com/intake/intake-esm/pull/417
* RondeauG made their first contribution in https://github.com/intake/intake-esm/pull/449

**Full Changelog**: https://github.com/intake/intake-esm/compare/v2021.8.17...v2022.9.18

([full changelog](https://github.com/intake/intake-esm/compare/1563b7092415114f1fcda9d2a077413ebaf17fad...a7962e47ac812d938c013e2951c635ac676be80f))

Enhancements made

- Add pydantic models to facilitate data validation [347](https://github.com/intake/intake-esm/pull/347) ([andersy005](https://github.com/andersy005))

Maintenance and upkeep improvements

- [pre-commit.ci] pre-commit autoupdate [355](https://github.com/intake/intake-esm/pull/355) ([pre-commit-ci](https://github.com/pre-commit-ci))
- skip cmip6_preprocessing tests for the time being [354](https://github.com/intake/intake-esm/pull/354) ([andersy005](https://github.com/andersy005))
- Bump styfle/cancel-workflow-action from 0.9.0 to 0.9.1 [348](https://github.com/intake/intake-esm/pull/348) ([dependabot](https://github.com/dependabot))
- Update pre-commit hooks [346](https://github.com/intake/intake-esm/pull/346) ([andersy005](https://github.com/andersy005))
- Bump codecov/codecov-action from 1 to 2.0.2 [345](https://github.com/intake/intake-esm/pull/345) ([dependabot](https://github.com/dependabot))
- Disable workflows on Forks [342](https://github.com/intake/intake-esm/pull/342) ([andersy005](https://github.com/andersy005))
- 💚 Add missing test dependency [340](https://github.com/intake/intake-esm/pull/340) ([andersy005](https://github.com/andersy005))
- Code refactoring [338](https://github.com/intake/intake-esm/pull/338) ([andersy005](https://github.com/andersy005))
- Bump pre-commit/action from v2.0.2 to v2.0.3 [337](https://github.com/intake/intake-esm/pull/337) ([dependabot](https://github.com/dependabot))
- Bump styfle/cancel-workflow-action from 0.8.0 to 0.9.0 [334](https://github.com/intake/intake-esm/pull/334) ([dependabot](https://github.com/dependabot))
- Bump pre-commit/action from v2.0.0 to v2.0.2 [333](https://github.com/intake/intake-esm/pull/333) ([dependabot](https://github.com/dependabot))
- Bump styfle/cancel-workflow-action from 0.7.0 to 0.8.0 [322](https://github.com/intake/intake-esm/pull/322) ([dependabot](https://github.com/dependabot))
- 💚 Fix CI [321](https://github.com/intake/intake-esm/pull/321) ([andersy005](https://github.com/andersy005))
- Fix Tests: Use a publicly available s3 object [318](https://github.com/intake/intake-esm/pull/318) ([andersy005](https://github.com/andersy005))
- Bump styfle/cancel-workflow-action from 0.6.0 to 0.7.0 [316](https://github.com/intake/intake-esm/pull/316) ([dependabot](https://github.com/dependabot))

Documentation improvements

- Add cesm2-le catalog [349](https://github.com/intake/intake-esm/pull/349) ([mgrover1](https://github.com/mgrover1))
- Docs: Execute all notebooks [341](https://github.com/intake/intake-esm/pull/341) ([andersy005](https://github.com/andersy005))
- 📚 Enable comments in docs via sphinx-comments [326](https://github.com/intake/intake-esm/pull/326) ([andersy005](https://github.com/andersy005))

Other merged PRs

- pin pandas version [356](https://github.com/intake/intake-esm/pull/356) ([mgrover1](https://github.com/mgrover1))

Contributors to this release

([GitHub contributors page for this release](https://github.com/intake/intake-esm/graphs/contributors?from=2021-01-16&to=2021-08-17&type=c))

[andersy005](https://github.com/search?q=repo%3Aintake%2Fintake-esm+involves%3Aandersy005+updated%3A2021-01-16..2021-08-17&type=Issues) | [dependabot](https://github.com/search?q=repo%3Aintake%2Fintake-esm+involves%3Adependabot+updated%3A2021-01-16..2021-08-17&type=Issues) | [mgrover1](https://github.com/search?q=repo%3Aintake%2Fintake-esm+involves%3Amgrover1+updated%3A2021-01-16..2021-08-17&type=Issues) | [pre-commit-ci](https://github.com/search?q=repo%3Aintake%2Fintake-esm+involves%3Apre-commit-ci+updated%3A2021-01-16..2021-08-17&type=Issues)

([full changelog](https://github.com/intake/intake-esm/compare/2c89c1f15f2d66b93247e83494117b3e90340d01...66ecb069cd1961d2ecde29f696627d7a3f611a59))

Bug Fixes

- Fix memory error when computing unique values [313](https://github.com/intake/intake-esm/pull/313) ([andersy005](https://github.com/andersy005))

Breaking Changes

- 📦 Drop support for Python 3.6 [311](https://github.com/intake/intake-esm/pull/311) ([andersy005](https://github.com/andersy005))

Internal Changes

- ⬆️ Upgrade dependencies & pin versions in CI environment [314](https://github.com/intake/intake-esm/pull/314) ([andersy005](https://github.com/andersy005))
- 💚 Fix failing upstream-dev CI [310](https://github.com/intake/intake-esm/pull/310) ([andersy005](https://github.com/andersy005))

Documentation

- Update MPI catalogs for MISTRAL [308](https://github.com/intake/intake-esm/pull/308) ([aaronspring](https://github.com/aaronspring))

Contributors to this release

([GitHub contributors page for this release](https://github.com/intake/intake-esm/graphs/contributors?from=2020-12-19&to=2021-01-16&type=c))

[aaronspring](https://github.com/search?q=repo%3Aintake%2Fintake-esm+involves%3Aaaronspring+updated%3A2020-12-19..2021-01-16&type=Issues) | [andersy005](https://github.com/search?q=repo%3Aintake%2Fintake-esm+involves%3Aandersy005+updated%3A2020-12-19..2021-01-16&type=Issues) | [jbusecke](https://github.com/search?q=repo%3Aintake%2Fintake-esm+involves%3Ajbusecke+updated%3A2020-12-19..2021-01-16&type=Issues)

([full changelog](https://github.com/intake/intake-esm/compare/4f63319294fc7d8394a7c89680ca3525ca1b0d54...dd3e7fdbd752a9e26030ccc7c03e571adb3d3be1))

Bug Fixes

- 🐛 Disable `_requested_variables` for single variable assets [306](https://github.com/intake/intake-esm/pull/306) ([andersy005](https://github.com/andersy005))

Internal Changes

- Update changelog in preparation for new release [307](https://github.com/intake/intake-esm/pull/307) ([andersy005](https://github.com/andersy005))
- Use `github-activity` to update list of contributors [302](https://github.com/intake/intake-esm/pull/302) ([andersy005](https://github.com/andersy005))
- Add nbqa & Update prettier commit hooks [300](https://github.com/intake/intake-esm/pull/300) ([andersy005](https://github.com/andersy005))
- Update pre-commit and GH actions [299](https://github.com/intake/intake-esm/pull/299) ([andersy005](https://github.com/andersy005))

Contributors to this release

([GitHub contributors page for this release](https://github.com/intake/intake-esm/graphs/contributors?from=2020-11-05&to=2020-12-19&type=c))

[andersy005](https://github.com/search?q=repo%3Aintake%2Fintake-esm+involves%3Aandersy005+updated%3A2020-11-05..2020-12-19&type=Issues) | [dcherian](https://github.com/search?q=repo%3Aintake%2Fintake-esm+involves%3Adcherian+updated%3A2020-11-05..2020-12-19&type=Issues) | [jbusecke](https://github.com/search?q=repo%3Aintake%2Fintake-esm+involves%3Ajbusecke+updated%3A2020-11-05..2020-12-19&type=Issues) | [naomi-henderson](https://github.com/search?q=repo%3Aintake%2Fintake-esm+involves%3Anaomi-henderson+updated%3A2020-11-05..2020-12-19&type=Issues) | [Recalculate](https://github.com/search?q=repo%3Aintake%2Fintake-esm+involves%3ARecalculate+updated%3A2020-11-05..2020-12-19&type=Issues)

Features

- ✨ Support multiple variable assets/files. ({pr}`287`) [andersy005](https://github.com/andersy005)
- ✨ Add utility function for printing version information. ({pr}`284`) [andersy005](https://github.com/andersy005)

Breaking Changes

- 💥 Remove unnecessary logging bits. ({pr}`297`) [andersy005](https://github.com/andersy005)

Bug Fixes

- ✔️ Fix test failures. ({pr}`280`) [andersy005](https://github.com/andersy005)
- 🐛 Fix TypeError bug in `.search()` method when using wildcard and regular expressions. ({pr}`285`) [andersy005](https://github.com/andersy005)
- 🐛 Use file like object when dealing with netcdf in the cloud. ({pr}`292`) [andersy005](https://github.com/andersy005)
- 🐛 Fix import errors due to [intake/intake526](https://github.com/intake/intake/pull/526). ({pr}`282`) [andersy005](https://github.com/andersy005)

Documentation

- 📚 Fix ReadtheDocs documentation builds. ({pr}`286`) [andersy005](https://github.com/andersy005)
- 📚 Migrate docs from restructured text to markdown via `myst-parsers`. ({pr}`296`) [andersy005](https://github.com/andersy005)
- 🔨 Refactor documentation contents & add new notebooks. ({pr}`298`) [andersy005](https://github.com/andersy005)

Internal Changes

- 💚 Migrate CI from CircleCI to GitHub Actions. ({pr}`283`) [andersy005](https://github.com/andersy005)
- 💚 Use mamba to speed up CI testing. ({pr}`293`) [andersy005](https://github.com/andersy005)
- Enable dependabot updates. ({pr}`294`) [andersy005](https://github.com/andersy005)
- Test against Python 3.9. ({pr}`295`) [andersy005](https://github.com/andersy005)

See [changelog](https://intake-esm.readthedocs.io/en/latest/changelog.html#intake-esm-v2020-08-15) for the list of new features and changes.