Pygwalker

In the past, pygwalker has been using the data computing capabilities provided by graphic-walker, and all calculations were done in the browser.

However, when we need to analyze slightly larger datasets, the browser may crash or become unresponsive.

In the new pygwalker, graphic-walker only loads the data it needs; the calculation of the data is performed on the python side using duckdb. Duckdb is a very great database system; it provides a very simple invoke method and stronger computing power.♪(･ω･)ﾉ

Now, you can use pygwalker to explore larger datasets.

Enable kernel computation mode (duckDB) with
py
walker = pyg.walk(df, use_kernel_calc=True)


performance before (computation in javascript+webworker)
dataset with 300K rows

https://github.com/Kanaries/pygwalker/assets/22167673/0a22ae41-e66d-4790-9cce-828cf48a2010

performance now (based on duckDB)

https://github.com/Kanaries/pygwalker/assets/22167673/12da8496-2658-4f6c-afb2-b600da48237a


Feat

* add new calculation, use duckdb as computing engine in the kernel. https://github.com/Kanaries/pygwalker/pull/193
* update graphic-walker, add new filter tool and support limit feature. https://github.com/Kanaries/pygwalker/pull/193

Refactor

* refactor data parser https://github.com/Kanaries/pygwalker/pull/185

longxiaofei


**Full Changelog**: https://github.com/Kanaries/pygwalker/compare/0.2.0...0.3.0

FIX
* fix: streamlit large data limit https://github.com/Kanaries/pygwalker/pull/147
* fix: invoke code & communication & ci https://github.com/Kanaries/pygwalker/pull/153
* fix: export config bug https://github.com/Kanaries/pygwalker/pull/157
* fix: communication kernel https://github.com/Kanaries/pygwalker/pull/166
* fix: communication data type bug https://github.com/Kanaries/pygwalker/pull/177
* fix: preview default show first chart https://github.com/Kanaries/pygwalker/pull/181 longxiaofei

Feature

* feat: use new communication on jupyter https://github.com/Kanaries/pygwalker/pull/148
* add feature that save config to json file https://github.com/Kanaries/pygwalker/pull/155
* feat: add the adaptation of different jupyter https://github.com/Kanaries/pygwalker/pull/156
* feat: preview chart when no kernel https://github.com/Kanaries/pygwalker/pull/162
* feat: sendMsg add timeout param & modify cloud function show https://github.com/Kanaries/pygwalker/pull/164
* feat: add display chart by invoke function https://github.com/Kanaries/pygwalker/pull/168
* feat: add tips on start https://github.com/Kanaries/pygwalker/pull/169
* feat: improve dispaly and save chart https://github.com/Kanaries/pygwalker/pull/172 longxiaofei

Refactor

* refactor: app index.tsx code https://github.com/Kanaries/pygwalker/pull/182 longxiaofei
* fix: types & lint issues https://github.com/Kanaries/pygwalker/pull/144 ObservedObserver

Doc

* 145 doc: fix typos https://github.com/Kanaries/pygwalker/pull/146 Viddesh1


**Full Changelog**: https://github.com/Kanaries/pygwalker/compare/0.1.11...0.2.0

Fix

* types & lint issues 144 ObservedObserver
* fix invoke code 153
* fix export config 157

Feature

* add new communication on jupyter 148
* add config store 155
* add preview chart 162
* add display chart function 168 longxiaofei

Doc
* fix typos 146 Viddesh1

Other
* 0.2 document: [here](https://docs.kanaries.net/pygwalker/changelog/pygwalker-0-2)

**Full Changelog**: https://github.com/Kanaries/pygwalker/compare/0.1.11...0.2.0a1

Fix

* Large data limit 138
* Parse invoke code 140

Feature

* Support custom data parser 140

Refactor

* Refactored the whole project. 138 140 longxiaofei


**Full Changelog**: https://github.com/Kanaries/pygwalker/compare/0.1.10...0.1.11

Fix

* fix `to_html` bugs. PR 133 by longxiaofei
* remove data restrictions for non-Jupyter env. PR 128 by ysj0226

Feature

* add `modin.pandas` as data source. 131 by rentruewang

**Full Changelog**: https://github.com/Kanaries/pygwalker/compare/0.1.9.1...0.1.10

**Full Changelog**: https://github.com/Kanaries/pygwalker/compare/0.1.9...0.1.9.1