Sparkmeasure

Latest version: v0.24.0

Safety actively analyzes 681775 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 2

0.23

- new: aggregate_stagemetrics and aggregate_taskmetrics added to the Python API
- added Scala and Python tests
- improvements to the documentation
- improvements to the GitHub workflows

0.22

Pushed new release to fix issues with 0.21 not being correctly published, see 43

0.21

Added print memory report to stage-level metrics collection.
Example:

(scala)> stageMetrics.printMemoryReport
(python)> stagemetrics.print_memory_report()

0.20

- The Apache Spark dependency has been bumped up to Spark 3.3.0
- This release is cross compiled for Scala 2.12 and 2.13

0.19

Refactoring of StageMetrics and TaskMetrics:
- report will not use Spark SQL but rather compute the metrics using Scala code.
- removed API for accumulables metrics capture and reporting
- added a short report "Stages and their duration" to StageMetrics report
- updated the Python package sparkmeasure match the Scala code refactoring

Improved documentation:
- notably added documentation for the KafkaSink and a reference guide of sparkMeasure API

Latest release to build with Spark 2.4.8 and Scala 2.11
- use this release if you run sparkMeasure with Spark 2.x and Scala 2.11

0.18

This adds the Apache Kafka sink.
The versions of several dependencies have been bumped up.

Page 1 of 2

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.