Pandera

⭐️ Highlights

This release optimizes the import and schema creation runtime so that importing pandera and creating a schema (without doing any validation) happens in ~5 ms (before it would be >800ms). It also updates the docs to use `docsearch` for a better search experience.

* Defer backend registration to validation time by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1818
* Reduce import overhead to improve runtime by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1821
* Add docsearch by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1814

What's Changed
* Upgrade multimethod to 1.12 by jskrzypek in https://github.com/unionai-oss/pandera/pull/1803
* bugfix: validation_enabled configuration correctly disables polars validation by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1813
* Support Enum by gab23r in https://github.com/unionai-oss/pandera/pull/1798
* Revert/1803 by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1815
* Add docsearch by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1816
* Correct spelling in index.md by galenseilis in https://github.com/unionai-oss/pandera/pull/1819
* Bugfix/1760 Bad type hint for argument unique for DataFrameSchema by Jarek-Rolski in https://github.com/unionai-oss/pandera/pull/1817
* accept expr in default value by gab23r in https://github.com/unionai-oss/pandera/pull/1820
* fix: :bug: add coerce value to pyarrow dtypes by aaravind100 in https://github.com/unionai-oss/pandera/pull/1850
* feat: add overload. by yassun7010 in https://github.com/unionai-oss/pandera/pull/1823

New Contributors
* jskrzypek made their first contribution in https://github.com/unionai-oss/pandera/pull/1803
* galenseilis made their first contribution in https://github.com/unionai-oss/pandera/pull/1819
* Jarek-Rolski made their first contribution in https://github.com/unionai-oss/pandera/pull/1817
* yassun7010 made their first contribution in https://github.com/unionai-oss/pandera/pull/1823

**Full Changelog**: https://github.com/unionai-oss/pandera/compare/v0.20.4...v0.21.0

What's Changed
* Bugfix/1732: Fix misleading error when columns are missing and lazy=True by benlee1284 in https://github.com/unionai-oss/pandera/pull/1752
* Bugfix/1644: refactor geopandas and pyarrow dtypes to avoid top-level import by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1753
* regex column errors should report the correct column name by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1754
* bugfix/1657: use rename instead of select in polars check backend by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1757
* make sure registered checks supports error kwarg by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1756
* make sure optional generic types are supported by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1758
* fix: SQLModel table model not validated by AlpAribal in https://github.com/unionai-oss/pandera/pull/1696
* Restore accidentally-deleted use of "breakpoint()" by deepyaman in https://github.com/unionai-oss/pandera/pull/1763
* Swap `types-pkg_resources` with `types-setuptools` by deepyaman in https://github.com/unionai-oss/pandera/pull/1779
* Add support for Spark Connect dataframes by filipeo2-mck in https://github.com/unionai-oss/pandera/pull/1775
* feat: select_columns reorders columns by default by ldacey in https://github.com/unionai-oss/pandera/pull/1783
* Update Polars dtype test to generate more examples by deepyaman in https://github.com/unionai-oss/pandera/pull/1770
* bugfix/1784 polars `DataFrameModel.to_json_schema()` fails on DateTime column by AlpAribal in https://github.com/unionai-oss/pandera/pull/1789
* fix pd.ArrowDtype use in pandera engine for old pd versions by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1792
* Reexport polars function to match pyright expectation by gab23r in https://github.com/unionai-oss/pandera/pull/1797

New Contributors
* benlee1284 made their first contribution in https://github.com/unionai-oss/pandera/pull/1752
* ldacey made their first contribution in https://github.com/unionai-oss/pandera/pull/1783
* gab23r made their first contribution in https://github.com/unionai-oss/pandera/pull/1797

**Full Changelog**: https://github.com/unionai-oss/pandera/compare/v0.20.3...v0.20.4

What's Changed
* update dtype api reference docs by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1745
* handle deprecated methods/arguments in polars v1 by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1746
* handle case when pandera is run with optimized python mode by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1749


**Full Changelog**: https://github.com/unionai-oss/pandera/compare/v0.20.2...v0.20.3

⭐️ Highlights:

* feat: add remaining pyarrow types by aaravind100 in https://github.com/unionai-oss/pandera/pull/1720
* Bugfix/1724: Add support for polars v1 by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1725

What's Changed
* Depend on OpenJDK>8.0.0 for PySpark support by billyvinning in https://github.com/unionai-oss/pandera/pull/1701
* Update polars checks.py to avoid calling the check function multiple times by jcadam14 in https://github.com/unionai-oss/pandera/pull/1719
* str checks use plain string instead of re.Pattern by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1729
* Document Field instance reuse workaround by lundybernard in https://github.com/unionai-oss/pandera/pull/1730
* add pyarrow docs by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1739
* fix typing docs by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1740
* Update docs: setup deps for algolia, modify pandera banner, fix API ref by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1741

New Contributors
* jcadam14 made their first contribution in https://github.com/unionai-oss/pandera/pull/1719

**Full Changelog**: https://github.com/unionai-oss/pandera/compare/v0.20.1...v0.20.2

What's Changed
* fix: raising type error when pyarrow is not installed by aaravind100 in https://github.com/unionai-oss/pandera/pull/1717
* feat: add pyarrow list and struct to pandas engine by aaravind100 in https://github.com/unionai-oss/pandera/pull/1699


**Full Changelog**: https://github.com/unionai-oss/pandera/compare/v0.20.0...v0.20.1

⭐️ Highlights

- Pandera now supports [pyarrow](https://arrow.apache.org/docs/python/index.html) datatypes in the pandera validation engine! Big shoutout to aaravind100 for the heavy lifting here.
- Added compatibility for numpy v2.
- Add compatibility for polars v1
- `pandera.SchemaModel` is now deprecated, use `pandera.DataFrameModel` instead.

What's Changed
* Bugfix/1631: Series[Annotated[...]] DataFrameModel types should correctly create a DataFrameSchema by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1633
* Add missing pandas import line. by kyleweise in https://github.com/unionai-oss/pandera/pull/1635
* add pandas pyarrow backend support by aaravind100 in https://github.com/unionai-oss/pandera/pull/1628
* bugfix: timezone-agnostic datetime in polars works in DataFrameModel by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1638
* fix pandas pyarrow string validation by aaravind100 in https://github.com/unionai-oss/pandera/pull/1636
* Bump jinja2 from 3.1.3 to 3.1.4 by dependabot in https://github.com/unionai-oss/pandera/pull/1619
* Updating Old `pandas-stubs` Link in Documentation by bustosalex1 in https://github.com/unionai-oss/pandera/pull/1648
* Bugfix: add missing `reason_code` for pyspark backend by melvinkokxw in https://github.com/unionai-oss/pandera/pull/1646
* change pandas engine to be numpy>2 compat by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1690
* Minor documentation fix by poulter7 in https://github.com/unionai-oss/pandera/pull/1643
* perf: dataframe-level checks, fix polars tests by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1702
* Docs: fix missing import in data conversion code cell by billyvinning in https://github.com/unionai-oss/pandera/pull/1700
* fix: DataFrameSchema repr formatting by AlpAribal in https://github.com/unionai-oss/pandera/pull/1694
* Fix coerion errors for `polars=1.0.0` by MariusMerkleQC in https://github.com/unionai-oss/pandera/pull/1706
* Solve deprecation warning on with_context by MariusMerkleQC in https://github.com/unionai-oss/pandera/pull/1705
* fix: default values set before coercion by sanzoghenzo in https://github.com/unionai-oss/pandera/pull/1708
* remove deprecated SchemaModel by cosmicBboy in https://github.com/unionai-oss/pandera/pull/1711
* Fix mismatched quotes, standardize CONTRIBUTING.md by deepyaman in https://github.com/unionai-oss/pandera/pull/1712
* Run CI on PRs to `ibis-dev`; stop for `polars-dev` by deepyaman in https://github.com/unionai-oss/pandera/pull/1713
* enable black for py311 by lundybernard in https://github.com/unionai-oss/pandera/pull/1697
* Updates to improve TryPandera documentation by hendera2 in https://github.com/unionai-oss/pandera/pull/1668

New Contributors
* kyleweise made their first contribution in https://github.com/unionai-oss/pandera/pull/1635
* aaravind100 made their first contribution in https://github.com/unionai-oss/pandera/pull/1628
* bustosalex1 made their first contribution in https://github.com/unionai-oss/pandera/pull/1648
* melvinkokxw made their first contribution in https://github.com/unionai-oss/pandera/pull/1646
* poulter7 made their first contribution in https://github.com/unionai-oss/pandera/pull/1643
* billyvinning made their first contribution in https://github.com/unionai-oss/pandera/pull/1700
* AlpAribal made their first contribution in https://github.com/unionai-oss/pandera/pull/1694
* MariusMerkleQC made their first contribution in https://github.com/unionai-oss/pandera/pull/1706
* sanzoghenzo made their first contribution in https://github.com/unionai-oss/pandera/pull/1708
* lundybernard made their first contribution in https://github.com/unionai-oss/pandera/pull/1697
* hendera2 made their first contribution in https://github.com/unionai-oss/pandera/pull/1668

**Full Changelog**: https://github.com/unionai-oss/pandera/compare/v0.19.2...v0.20.0