Pbspark

Latest version: v0.9.0

Safety actively analyzes 634425 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 2 of 2

0.5.0

* Breaking: return type instances to be passed to custom serializers rather than type class + init kwargs
* Bugfix: `get_spark_schema` now returns properly when the descriptor passed has a registered custom serializer

0.4.0

* Breaking: pbspark now encodes the well known type `Timestamp` to spark `TimestampType` by default.
* Bugfix: protobuf bytes now properly convert to spark BinaryType
* Bugfix: message decoding now properly works by populating the passed message instance rather than returning a new one
* protobuf objects are now patched only temporarily when being used by pbspark
* Timestamp conversion now references protobuf well known type objects rather than objects copied from protobuf to pbspark
* Modify the encoding function to convert udf-passed Row objects to dictionaries before passing to the parser.
* Documentation fixes and more details on custom encoders.

0.3.0

* Breaking: protobuf bytes fields will now convert directly to spark ByteType and vice versa.
* Relax constraint on pyspark
* Bump minimum protobuf version to 3.20.0

0.2.0

* Add `to_protobuf` method to encode pyspark structs to protobuf

0.1.0

* initial release

Page 2 of 2

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.