Polars-ds

3. FFT. Currently it is slow for larger series.
4. Column-wise Jaccard similarity + Pairwise list vs. list Jaccard similarity
5. Binarize a column
6. Computes t-statistics

**String:**

1. Freq removal. Remove rare or very common words from list of strings. (output of tokenize)
2. Infer and merge strings based on frequency
3. Extract numbers as list
7. Added parallel option and documentation. When using str_ext functions, parallel is generally faster if it is the only expression you are running and has the same caveat as the parallel parameter in .value_counts

What's Changed
* Change statistical description of standard error by mishpat in https://github.com/abstractqqq/polars_ds_extension/pull/8
* Fix/import api and more feats by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/7
* feat/roc_auc by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/9
* updated readme by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/10

New Contributors
* mishpat made their first contribution in https://github.com/abstractqqq/polars_ds_extension/pull/8

**Full Changelog**: https://github.com/abstractqqq/polars_ds_extension/compare/v0.1.0...v0.1.1

What's Changed
* added par option in convolve by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/146
* More dia plots by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/147
* fixed corr method bug by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/148
* Add string pre-preprocessing code by CangyuanLi in https://github.com/abstractqqq/polars_ds_extension/pull/150
* String Cleaning by CangyuanLi in https://github.com/abstractqqq/polars_ds_extension/pull/152
* Pipeline by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/155

New Contributors
* CangyuanLi made their first contribution in https://github.com/abstractqqq/polars_ds_extension/pull/150

**Full Changelog**: https://github.com/abstractqqq/polars_ds_extension/compare/v0.4.3...v0.4.4

What's Changed
* Kendall tau correlation coefficient by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/137
* added combined pds.corr expression by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/139
* new pca plot and lstsq plot by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/140
* fixed a bug in lstsq regarding group by by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/143
* added null dist by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/144
* Improve convolve perf, especially when filter size is small. added method option by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/145


**Full Changelog**: https://github.com/abstractqqq/polars_ds_extension/compare/v0.4.2...v0.4.3

Highlights

In Diagnosis, you can now generate 2d principal component graphs. This can help you visualize higher dimensional data.
python
dia = DIA(df)
dia.plot_pc2(pl.all().exclude("species"), by = "species")

In addition, the following PCA related queries are available:

df.select(
pds.query_pca("a", "b") singular values and weight vectors
).unnest("a")

df.select(
pds.query_singular_values("a", "b", center = True, as_explained_var=True)
)

The Xi - Correlation is also implemented:

df.select(
pds.xi_corr("x", "y")
)


What's Changed
* try new maturin config by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/128
* added basic pca exprs by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/129
* added infer_prob by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/131
* More pca by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/132
* xi_corr by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/134


**Full Changelog**: https://github.com/abstractqqq/polars_ds_extension/compare/v0.4.1-release...v0.4.2

v0.4.1-release
[Original release note](https://github.com/abstractqqq/polars_ds_extension/releases/tag/v0.4.1)

What's Changed
* upgraded download action in CI by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/124
* removed unncessary test-deps by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/126


**Full Changelog**: https://github.com/abstractqqq/polars_ds_extension/compare/v0.4.1-fix-release...v0.4.1-release

v0.4.1-fix-release

What's Changed
* updated packages, OLS now falls back to LU decomp when X^TX is not strictly positive definite. by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/122

Breaking Changes

For almost all old functions that were invoked like

python
pl.col("a").name_space.method_call(, ...)


You can now call them via

python
import polars_ds as pds

pds.method_call(...)


Linters now should recognize the package and all its methods.


What's Changed
* added meta and str_stats for Diagnosis by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/110
* added iqr in Diagnosis by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/111
* Refactor F stats by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/112
* Sampling functionalities by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/114
* Added weighted corr, etc. by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/116
* Fix regex `SyntaxWarning` on Python 3.12+ by jorenham in https://github.com/abstractqqq/polars_ds_extension/pull/118
* Clean up codebase by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/119
* added heat map for corr in Diagnosis by abstractqqq in https://github.com/abstractqqq/polars_ds_extension/pull/121

New Contributors
* jorenham made their first contribution in https://github.com/abstractqqq/polars_ds_extension/pull/118

**Full Changelog**: https://github.com/abstractqqq/polars_ds_extension/compare/v0.3.5...v0.4.0