L2metrics

Latest version: v3.1.0

Safety actively analyzes 641171 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 4 of 5

2.3.0

- Added scripts for multi-lifetime evaluation
- Added validation for scenario info (complexity/difficulty)
- Added type hints
- Updated reference to metrics specification document 0.65
- Updated calculation for performance recovery to use negative slope
- Add docstrings
- Minor updates to example multi-task log

2.2.0

- Added validation to performance maintenance
- Updated performance maintenance calculation, more specifically maintenance values
- Updated backward transfer to compute multiple values for each task pair
- Updated example logs and documentation with ideal learner scenario
- Implemented option to compute transfer matrix with both contrast and ratio methods

2.1.0

- Added log validation
- Reformatted metrics report output
- Updated metrics calculations per metrics specification version 0.64
- Switched to Theil-Sen slope instead of linear regression for performance recovery
- Added parameter for selecting transfer calculation method (contrast vs ratio)
- Use median instead of mean for aggregating lifetime metrics
- Updated log data parsing per log format version 1.0
- Added flag for disabling smoothing
- Added flag for disabling plotting
- Added flag for disabling saving

2.0.0

- Updated initial metrics to include all major identified lifelong learning metrics
- Removed dependence on learnkit
- Refactored metrics calculations to integrate with different log format
- Updated workflow for storing single-task expert data
- Updated READMEs and example scripts
- Added new example logs along with their metrics outputs

0.3.0

- Updated initial agent and classification metrics for both adapting to new tasks and continual learning
- Updated reporting format, plots for metrics
- Added getting started with custom metrics guide (`examples/README.md`), including example log files (`examples/syllabus_ANT_harder-1582671493-285338/`), and example output plot (`examples/syllabus_ANT_harder-1582671493-285338_example.png`)

0.2.0

- Updated foundation code and initial metrics for continual learning
- Overview document of Metrics Framework (`docs/metrics_documentation.pdf`)

Page 4 of 5

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.