Pbspark

Latest version: v0.9.0

Safety actively analyzes 623133 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 2

0.9.0

* Relax pyspark constraint

0.8.0

* Breaking: Provide the same kwargs used in the protobuf lib on encoding/decoding rather than the ``options`` dict, except ``DescriptorPool`` which is unserializable.
* Breaking: Change param ``mc`` -> ``message_converter`` on top level functions.

0.7.0

* Bugfix: Fixed a bug where int64 protobuf types were not being properly converted into spark types.
* Added support for protobuf wrapper types.

0.6.1

* Bugfix: Fixed a bug where ``options`` was not being passed recursively in ``get_spark_schema``.

0.6.0

* Add ``to_protobuf`` and ``from_protobuf`` functions to operate on columns without needing a ``MessageConverter``.
* Add ``df_to_protobuf`` and ``df_from_protobuf`` functions to operate on DataFrames without needing a ``MessageConverter``. These functions also optionally handle struct expansion.

0.5.1

* Bugfix: Fix ``bytearray`` TypeError when using newer versions of protobuf

Page 1 of 2

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.