Sparkmeasure

Latest version: v0.24.0

Safety actively analyzes 723296 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 2 of 2

0.17

This release has minor improvements.
Updated and extended the list of shuffle metrics.
Improved output of taskMeasure.
Note: this release breaks the compatibility with Spark 2.1 and 2.2. Use for Spark 2.3 and higher only.

0.16

Minor improvements in this release.
Updated InfuxDB sink to map executorId, executorHost with the InfluxDB sink. This is used by the Spark dashboard as detailed in [Spark dashboard annotations](https://github.com/LucaCanali/Miscellaneous/tree/master/Spark_Dashboard#spark-metrics-dashboard-with-queryjobstage-annotations)

0.15

This release extends sparkMeasure Flight recorder mode with an InfluxDB sink:
- It allows to write Spark queries, jobs and stages information to InfluxDB.
- Optionally it can write stage and task metrics to InfluxDB.
- These features have been added to improve Spark performance dashboard built with Grafana and InfluxDB.

0.14

Main changes with this release are the refactoring of the Flight Recorder mode.
Tested with Apache Spark up to version 2.4.3 and for Scala 2.11 and 2.12.

0.13

This release merges a few PRs I received, adds a Python API package wrapper for PySpark and has improved documentation and examples.

Page 2 of 2

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.