What's Changed
v0.9 brings many changes to the spark module, allowing support for pyspark connect along with a bunch of bug fixes and some new features. Additionally, the snowflake implementation is significantly reworked now relying on a pure python implementation for interacting with Snowflake outside of spark.
New features / Refactors
The following new features are included with 0.9:
* [feature] **Box** - Add overwrite functionality to the BoxFileWriterClass by ToneVDB in https://github.com/Nike-Inc/koheesio/pull/103
* [feature] **Box** - allow setting file encoding by louis-paulvlx in https://github.com/Nike-Inc/koheesio/pull/96
* [refactor] **Core** - change private attr and step getter by mikita-sakalouski in https://github.com/Nike-Inc/koheesio/pull/82
* [feature] **DataBricks** - DataBricksSecret for getting secrets from DataBricks scope by mikita-sakalouski in https://github.com/Nike-Inc/koheesio/pull/133
* [feature] **Delta** - Enable adding options to DeltaReader both streaming and batch by mikita-sakalouski in https://github.com/Nike-Inc/koheesio/pull/111
* [feature] **SE** - SparkExpectations bump version to 2.2.0 by dannymeijer in https://github.com/Nike-Inc/koheesio/pull/99
* [feature] **Snowflake** - Populate account from url if not provided in SnowflakeBaseModel by mikita-sakalouski in https://github.com/Nike-Inc/koheesio/pull/117
* [feature] **Spark** - add support for Spark Connect by mikita-sakalouski in https://github.com/Nike-Inc/koheesio/pull/63
* [feature] **Spark** - Make Transformations callable by dannymeijer in https://github.com/Nike-Inc/koheesio/pull/126
* [feature] **Tableau** - Add support for HyperProcess parameters by maxim-mityutko in https://github.com/Nike-Inc/koheesio/pull/112
Bug fixes