What's Changed * fix(Evaluation): Brier score default metric fixed when columns not set correctly. Updated in and out of sample scoring function. Added test. by szemyd in https://github.com/dream-faster/krisi/pull/168 * feature(Metrics): added binary vs multiclass metrics, get default metrics automatically by almostintuitive in https://github.com/dream-faster/krisi/pull/174 * fix(Metrics): wrap roc_auc score so it works when doing binary classification by almostintuitive in https://github.com/dream-faster/krisi/pull/175 * fix(Metrics): only used weighted and macro roc_auc score for multi-label by almostintuitive in https://github.com/dream-faster/krisi/pull/176 * fix(Utils): correctly recognize dataset types by almostintuitive in https://github.com/dream-faster/krisi/pull/179 * feature(Group): Metric consistency over time. by szemyd in https://github.com/dream-faster/krisi/pull/180 * feature(Evaluation): Added support for `sample_weights`. by szemyd in https://github.com/dream-faster/krisi/pull/182 * fix(Printing): Scorecard get's printed multiple times to console. by szemyd in https://github.com/dream-faster/krisi/pull/183 * feature(Metrics): added ncdg, changed default metrics slightly by almostintuitive in https://github.com/dream-faster/krisi/pull/181 * fix(Evaluation): Sample weight rolling window fix. by szemyd in https://github.com/dream-faster/krisi/pull/184 * fix(Report): Callibration plot. by szemyd in https://github.com/dream-faster/krisi/pull/185 * fix(Evaluation): Rolling evaluation shouldn't assume the name of the arguments. by szemyd in https://github.com/dream-faster/krisi/pull/186 * fix(Library): use ovr instead of ovo for roc_auc by almostintuitive in https://github.com/dream-faster/krisi/pull/187 * feature(Library): Added Bennet's et. al `S-Score` classification metric. by szemyd in https://github.com/dream-faster/krisi/pull/188 * feature(Report): Calibration plot in console & took out `rmse` from default metrics. by szemyd in https://github.com/dream-faster/krisi/pull/190 * feature(Library): added weighted metrics to binary presets by almostintuitive in https://github.com/dream-faster/krisi/pull/191 * feature(State): Added global state that allows us to throw errors in try except when in `RunType.test`. Fixed S-Curve by szemyd in https://github.com/dream-faster/krisi/pull/193 * feature(Checks): check if sample_weight has the same length as target by almostintuitive in https://github.com/dream-faster/krisi/pull/194 * fix(Tests): don't use matplotlib if not installed by almostintuitive in https://github.com/dream-faster/krisi/pull/196 * feature(Evaluation): Benchmarking metrics to a random model. by szemyd in https://github.com/dream-faster/krisi/pull/195 * feature(Test): Don't show plots when we are testing. by szemyd in https://github.com/dream-faster/krisi/pull/197 * fix(Data): Syntethetic data generation. by szemyd in https://github.com/dream-faster/krisi/pull/198
What's Changed * fix(ScoreCard): `ipython` should only be imported if notebook is available. by szemyd in https://github.com/dream-faster/krisi/pull/166
What's Changed * feature(ScoreCard): Saving now handles overwriting based on model_name by szemyd in https://github.com/dream-faster/krisi/pull/160 * fix(ScoreCard): We should clean the directory first in tests and misspelling. by szemyd in https://github.com/dream-faster/krisi/pull/161 * **feature(Scoring): Handle probabilities and multiclass classification.** by szemyd in https://github.com/dream-faster/krisi/pull/162 * feature(Report): Calibration plot and many fixes. by szemyd in https://github.com/dream-faster/krisi/pull/164
What's Changed * feature(Analyse): Exposed correlation over time metrics in `analyze` module. by szemyd in https://github.com/dream-faster/krisi/pull/154 * feature(Docs): Rewamped the README with new examples, changed wording and new illustrations by szemyd in https://github.com/dream-faster/krisi/pull/155 * feature(Docs): Updated walkthrough by szemyd in https://github.com/dream-faster/krisi/pull/156
What's Changed * feature(Report): Better `pdf` reporting, `direct_save`, `direct_one_subplot` option for `generate_report`, refractored code, new examples. by szemyd in https://github.com/dream-faster/krisi/pull/152
What's Changed * feature(Report): Calling the object in the terminal will output a pretty printed version and the orginal python `__repr__` for `ScoreCard` and `Metric`. by szemyd in https://github.com/dream-faster/krisi/pull/150 * feature(Analysis): A new `analysis` module that explores features on a rolling basis. `EDA` with finer insights by szemyd in https://github.com/dream-faster/krisi/pull/151