Validmind

What's Changed

Internal

* Hotfix prod/broken ragas version by johnwalz97 in https://github.com/validmind/validmind-library/pull/223
* Update pypi page to refer to library by cachafla in https://github.com/validmind/validmind-library/pull/222
* Prod 2.5.25 to main by cachafla in https://github.com/validmind/validmind-library/pull/260
* Merge Main into Prod (prod-2.6.7) by github-actions in https://github.com/validmind/validmind-library/pull/261
* Hotfix/fix listing of tasks and tags by johnwalz97 in https://github.com/validmind/validmind-library/pull/265
* fix: fixing issue with sklearn version by johnwalz97 in https://github.com/validmind/validmind-library/pull/266
* Bump Version to 2.6.9 by johnwalz97 in https://github.com/validmind/validmind-library/pull/267
* Fix Intro for Model Developers Notebook by johnwalz97 in https://github.com/validmind/validmind-library/pull/268
* Merge Prod hotfixes into Main (prod-2.6.9-to-main) by github-actions in https://github.com/validmind/validmind-library/pull/269
* Hotfix for Required Inputs Formatting by johnwalz97 in https://github.com/validmind/validmind-library/pull/270
* Merge Prod hotfixes into Main (prod-2.6.10-to-main) by github-actions in https://github.com/validmind/validmind-library/pull/271
* [SC 7728] Include data quality tests in option pricer model notebooks by AnilSorathiya in https://github.com/validmind/validmind-library/pull/264
* [SC 7726] Create graphs in the capital markets model by AnilSorathiya in https://github.com/validmind/validmind-library/pull/272
* feat: test [all] install target in integration tests by nibalizer in https://github.com/validmind/validmind-library/pull/276
* fix: join unit metrics docstrings for composite tests doc by juanmleng in https://github.com/validmind/validmind-library/pull/277
* [SC 7727] Greeks tests for option pricer model by AnilSorathiya in https://github.com/validmind/validmind-library/pull/273
* [SC 7819] Include Implied volatility surface test by AnilSorathiya in https://github.com/validmind/validmind-library/pull/278
* Merge Main into Prod (prod-2.7.2) by github-actions in https://github.com/validmind/validmind-library/pull/279
* [SC-2327] add ability to preload data for demo inventory by nateshim in https://github.com/validmind/validmind-library/pull/262
* Add Better Handling for Generated Descriptions by johnwalz97 in https://github.com/validmind/validmind-library/pull/275
* John6797/sc 7795/add better handling for description futures by johnwalz97 in https://github.com/validmind/validmind-library/pull/281
* End-to-end notebook template generation script by validbeck in https://github.com/validmind/validmind-library/pull/282
* John6797/sc 7776/add more coverage to integration unit tests by johnwalz97 in https://github.com/validmind/validmind-library/pull/283
* Merge Main into Prod (prod-2.7.4) by github-actions in https://github.com/validmind/validmind-library/pull/284
* add as_json tag by nateshim in https://github.com/validmind/validmind-library/pull/286
* 2.7.5 by nateshim in https://github.com/validmind/validmind-library/pull/288
* Merge Main into Prod (prod-2.7.5) by github-actions in https://github.com/validmind/validmind-library/pull/289
* Fix: Updating scikit-learn in pyproject.toml by juanmleng in https://github.com/validmind/validmind-library/pull/291
* Merge Main into Prod (prod-2.7.6) by github-actions in https://github.com/validmind/validmind-library/pull/292
* John6797/sc 8121/switch from mathml to mathjax for latex formulas by johnwalz97 in https://github.com/validmind/validmind-library/pull/294
* Merge Main into Prod (prod-2.7.7) by github-actions in https://github.com/validmind/validmind-library/pull/297

External

* Add Initial Support for Post-Processing Functions by johnwalz97 in https://github.com/validmind/validmind-library/pull/263
* [SC-7759] Exposing static descriptions in test results by juanmleng in https://github.com/validmind/validmind-library/pull/274
* [SC-7588] Explore dynamic llm context injection in test descriptions by juanmleng in https://github.com/validmind/validmind-library/pull/256
* [SC-7864] Create credit risk scorecard notebook using XGBoost by juanmleng in https://github.com/validmind/validmind-library/pull/280
* [SC-8008] Ongoing monitoring notebook for application scorecard model by juanmleng in https://github.com/validmind/validmind-library/pull/290
* John6797/sc 7792/add raw data to validmind library tests by johnwalz97 in https://github.com/validmind/validmind-library/pull/285
* [SC-8072] Support threshold lines in unit metric plots by juanmleng in https://github.com/validmind/validmind-library/pull/293
* feat: add print_env function by nibalizer in https://github.com/validmind/validmind-library/pull/295


New Contributors
* nibalizer made their first contribution in https://github.com/validmind/validmind-library/pull/276

**Full Changelog**: https://github.com/validmind/validmind-library/compare/v2.6.7...v2.7.7

What's Changed

Internal

* Merge Main into Prod (prod-2.4.4) by github-actions in https://github.com/validmind/validmind-library/pull/139
* Merge Main into Prod (prod-2.4.5) by github-actions in https://github.com/validmind/validmind-library/pull/142
* Merge Main into Prod (prod-2.4.6) by github-actions in https://github.com/validmind/validmind-library/pull/145
* Merge Main into Prod (prod-2.4.7) by github-actions in https://github.com/validmind/validmind-library/pull/147
* Merge Main into Prod (prod-2.4.9) by github-actions in https://github.com/validmind/validmind-library/pull/150
* Merge Main into Prod (prod-2.4.10) by github-actions in https://github.com/validmind/validmind-library/pull/157
* Merge Main into Prod (prod-2.4.13) by github-actions in https://github.com/validmind/validmind-library/pull/160
* Merge Main into Prod (prod-2.5.1) by github-actions in https://github.com/validmind/validmind-library/pull/162
* Merge Main into Prod (prod-2.5.2) by github-actions in https://github.com/validmind/validmind-library/pull/164
* Merge Main into Prod (prod-2.5.6) by github-actions in https://github.com/validmind/validmind-library/pull/171
* Merge Main into Prod (prod-2.5.8) by github-actions in https://github.com/validmind/validmind-library/pull/174
* Merge Main into Prod (prod-2.5.15) by github-actions in https://github.com/validmind/validmind-library/pull/189
* Merge Main into Prod (prod-2.5.18) by github-actions in https://github.com/validmind/validmind-library/pull/199
* Fix PyPI publish by cachafla in https://github.com/validmind/validmind-library/pull/200
* Merge Main into Prod (prod-2.5.18) by github-actions in https://github.com/validmind/validmind-library/pull/201
* John6797/sc 6723/step 1 get rid of test runs by johnwalz97 in https://github.com/validmind/validmind-library/pull/202
* Removed references to projects in Jupyter Notebooks by validbeck in https://github.com/validmind/validmind-library/pull/203
* Quick fixes for ongoing monitoring by validbeck in https://github.com/validmind/validmind-library/pull/204
* fix: fixing issue with missing dependency by johnwalz97 in https://github.com/validmind/validmind-library/pull/206
* Hotfix: Add standardized handling for missing dependencies by johnwalz97 in https://github.com/validmind/validmind-library/pull/207
* [SC-6651] edit reference developer framework -> library by nateshim in https://github.com/validmind/validmind-library/pull/210
* fix: fixing dependency issues in workflow files and doing some cleanup by johnwalz97 in https://github.com/validmind/validmind-library/pull/208
* chore: undo some testing changes by eggshell in https://github.com/validmind/validmind-library/pull/213
* [SC-7262] Update RAG documentation demo notebook by juanmleng in https://github.com/validmind/validmind-library/pull/214
* Added Upgrade ValidMind instructions to Jupyter Notebooks by validbeck in https://github.com/validmind/validmind-library/pull/212
* [SC 5606] POC for the option pricer model by AnilSorathiya in https://github.com/validmind/validmind-library/pull/153
* Prod 2.5.19 to main by cachafla in https://github.com/validmind/validmind-library/pull/217
* Merge Main into Prod (prod-2.5.23) by github-actions in https://github.com/validmind/validmind-library/pull/218
* Cachafla/sc 7304/fix seaborn warnings on overfit and weakness by cachafla in https://github.com/validmind/validmind-library/pull/220
* Merge Prod hotfixes into Main (prod-2.5.24-to-main) by github-actions in https://github.com/validmind/validmind-library/pull/221
* fix: threshold test comparisons not working with param_grid changes by johnwalz97 in https://github.com/validmind/validmind-library/pull/224
* FEAT: run custom R tests by erichare in https://github.com/validmind/validmind-library/pull/167
* 226: Use system tempdir for R save_model by erichare in https://github.com/validmind/validmind-library/pull/227
* [SC-7312] Update rag tests for compatibility with latest ragas package by juanmleng in https://github.com/validmind/validmind-library/pull/225
* [SC7201] Spike POC for the option pricer model using quantlib by AnilSorathiya in https://github.com/validmind/validmind-library/pull/219
* fix: run integration tests on large runners by eggshell in https://github.com/validmind/validmind-library/pull/229
* [SC-7379] Updates and small fixes to NLP data validation tests by juanmleng in https://github.com/validmind/validmind-library/pull/231
* Updated product terminology — `developer-framework` repo side by validbeck in https://github.com/validmind/validmind-library/pull/233
* Ignore some files when running `make docs` on Mac by cachafla in https://github.com/validmind/validmind-library/pull/234
* Python docs intro adjust by validbeck in https://github.com/validmind/validmind-library/pull/235
* Bye old repo 39 4 ur service by validbeck in https://github.com/validmind/validmind-library/pull/236
* [SC 7399] Serialize date, time, datetime and Date objects to log test results by AnilSorathiya in https://github.com/validmind/validmind-library/pull/232
* Run docs on Ubuntu large by cachafla in https://github.com/validmind/validmind-library/pull/238
* [SC 7431] Update the custom tests names in the option pricer models notebooks by AnilSorathiya in https://github.com/validmind/validmind-library/pull/237
* Updated logos in python docs & readme by validbeck in https://github.com/validmind/validmind-library/pull/239
* John6797/sc 6728/table consolidation step 6 add support for by johnwalz97 in https://github.com/validmind/validmind-library/pull/216
* Fix main history by johnwalz97 in https://github.com/validmind/validmind-library/pull/249
* Don't Run GitHub Actions for Docs Updates by johnwalz97 in https://github.com/validmind/validmind-library/pull/250
* Updated "Get your code snippet" section for relevant notebooks by validbeck in https://github.com/validmind/validmind-library/pull/251
* [SC-7605] Fix: input data mutation in PSI test affecting other tests during documentation suite execution by juanmleng in https://github.com/validmind/validmind-library/pull/253
* [SC-7587] Add logging image example to implement_custom_tests.ipynb notebook by juanmleng in https://github.com/validmind/validmind-library/pull/254
* [SC 7429] Add title as an optional parameter in the run_test by AnilSorathiya in https://github.com/validmind/validmind-library/pull/244
* Improved README.pypi.md by validbeck in https://github.com/validmind/validmind-library/pull/257
* chore: removing metrics references by johnwalz97 in https://github.com/validmind/validmind-library/pull/252
* Juan5508/sc 6028/create basic structure for dedicated unit tests for vm library tests by johnwalz97 in https://github.com/validmind/validmind-library/pull/255
* [SC 7682] Hotfix for run composite test missing 2 required by AnilSorathiya in https://github.com/validmind/validmind-library/pull/258
* Some more outdated client library references by validbeck in https://github.com/validmind/validmind-library/pull/259

External

* Add parameter grid support in the comparison tests functionality by AnilSorathiya in https://github.com/validmind/validmind-library/pull/198
* [SC 7521] Move capital markets notebooks from code sharing to code samples by AnilSorathiya in https://github.com/validmind/validmind-library/pull/243

New Contributors
* nateshim made their first contribution in https://github.com/validmind/validmind-library/pull/210
* eggshell made their first contribution in https://github.com/validmind/validmind-library/pull/213
* erichare made their first contribution in https://github.com/validmind/validmind-library/pull/167

**Full Changelog**: https://github.com/validmind/validmind-library/compare/v2.5.18...v2.6.7

What's Changed

Internal

* Merge Main into Prod (prod-2.4.4) by github-actions in https://github.com/validmind/validmind-library/pull/139
* Merge Main into Prod (prod-2.4.5) by github-actions in https://github.com/validmind/validmind-library/pull/142
* Merge Main into Prod (prod-2.4.6) by github-actions in https://github.com/validmind/validmind-library/pull/145
* Merge Main into Prod (prod-2.4.7) by github-actions in https://github.com/validmind/validmind-library/pull/147
* Merge Main into Prod (prod-2.4.9) by github-actions in https://github.com/validmind/validmind-library/pull/150
* Merge Main into Prod (prod-2.4.10) by github-actions in https://github.com/validmind/validmind-library/pull/157
* Merge Main into Prod (prod-2.4.13) by github-actions in https://github.com/validmind/validmind-library/pull/160
* Merge Main into Prod (prod-2.5.1) by github-actions in https://github.com/validmind/validmind-library/pull/162
* Merge Main into Prod (prod-2.5.2) by github-actions in https://github.com/validmind/validmind-library/pull/164
* Merge Main into Prod (prod-2.5.6) by github-actions in https://github.com/validmind/validmind-library/pull/171
* Merge Main into Prod (prod-2.5.8) by github-actions in https://github.com/validmind/validmind-library/pull/174
* Merge Main into Prod (prod-2.5.15) by github-actions in https://github.com/validmind/validmind-library/pull/189
* Merge Main into Prod (prod-2.5.18) by github-actions in https://github.com/validmind/validmind-library/pull/199
* Fix PyPI publish by cachafla in https://github.com/validmind/validmind-library/pull/200
* Merge Main into Prod (prod-2.5.18) by github-actions in https://github.com/validmind/validmind-library/pull/201
* John6797/sc 6723/step 1 get rid of test runs by johnwalz97 in https://github.com/validmind/validmind-library/pull/202
* Removed references to projects in Jupyter Notebooks by validbeck in https://github.com/validmind/validmind-library/pull/203
* Quick fixes for ongoing monitoring by validbeck in https://github.com/validmind/validmind-library/pull/204
* fix: fixing issue with missing dependency by johnwalz97 in https://github.com/validmind/validmind-library/pull/206
* Hotfix: Add standardized handling for missing dependencies by johnwalz97 in https://github.com/validmind/validmind-library/pull/207
* [SC-6651] edit reference developer framework -> library by nateshim in https://github.com/validmind/validmind-library/pull/210
* fix: fixing dependency issues in workflow files and doing some cleanup by johnwalz97 in https://github.com/validmind/validmind-library/pull/208
* chore: undo some testing changes by eggshell in https://github.com/validmind/validmind-library/pull/213
* Added Upgrade ValidMind instructions to Jupyter Notebooks by validbeck in https://github.com/validmind/validmind-library/pull/212
* [SC 5606] POC for the option pricer model by AnilSorathiya in https://github.com/validmind/validmind-library/pull/153
* Prod 2.5.19 to main by cachafla in https://github.com/validmind/validmind-library/pull/217
* Merge Main into Prod (prod-2.5.23) by github-actions in https://github.com/validmind/validmind-library/pull/218
* Cachafla/sc 7304/fix seaborn warnings on overfit and weakness by cachafla in https://github.com/validmind/validmind-library/pull/220
* Hotfix prod/broken ragas version by johnwalz97 in https://github.com/validmind/validmind-library/pull/223
* Update pypi page to refer to library by cachafla in https://github.com/validmind/validmind-library/pull/222

External

* Add parameter grid support in the comparison tests functionality by AnilSorathiya in https://github.com/validmind/validmind-library/pull/198
* [SC-7262] Update RAG documentation demo notebook by juanmleng in https://github.com/validmind/validmind-library/pull/214

New Contributors
* nateshim made their first contribution in https://github.com/validmind/validmind-library/pull/210

**Full Changelog**: https://github.com/validmind/validmind-library/compare/v2.5.18...v2.5.25

What's Changed

Internal

* Fix: Clean Docs Build Folder Before Regenerating by johnwalz97 in https://github.com/validmind/developer-framework/pull/192
* Fix Broken RAGAS Test and Add New by johnwalz97 in https://github.com/validmind/developer-framework/pull/190
* Replaced static links to prod UI with docs links by validbeck in https://github.com/validmind/developer-framework/pull/195
* [SC-6552] Fix tests with no outputs by juanmleng in https://github.com/validmind/developer-framework/pull/193
* Edits to intialization for run unit metrics by validbeck in https://github.com/validmind/developer-framework/pull/197
* Dev framework notebooks refer to `model` instead of `project` in `vm.init()` by panchicore in https://github.com/validmind/developer-framework/pull/196
* John6797/sc 6242/store existing prompts in a central location by johnwalz97 in https://github.com/validmind/developer-framework/pull/185

External

* [SC-6060] Initial support for bias and fairness tests by juanmleng in https://github.com/validmind/developer-framework/pull/191

New Contributors
* panchicore made their first contribution in https://github.com/validmind/developer-framework/pull/196

**Full Changelog**: https://github.com/validmind/developer-framework/compare/v2.5.15...v2.5.18

What's Changed

Internal

* [SC-5709] Fix figure titles mismatch when using input grid by juanmleng in https://github.com/validmind/developer-framework/pull/156
* Pass X-MONITORING on every request by cachafla in https://github.com/validmind/developer-framework/pull/159
* [SC-5732] Fix inconsistent AUC calculations using class predictions instead of prediction probabilities by juanmleng in https://github.com/validmind/developer-framework/pull/158
* Fixes to multiple tests by cachafla in https://github.com/validmind/developer-framework/pull/161
* Update shap to 0.44.1 by cachafla in https://github.com/validmind/developer-framework/pull/163
* fix: [sc-5827] Let User Pass a `task` Attribute To Indicate Classification or Regression by johnwalz97 in https://github.com/validmind/developer-framework/pull/165
* [SC-5784] Fix errors in unit metrics notebook by juanmleng in https://github.com/validmind/developer-framework/pull/166
* [SC-5838] PipelineModel and ragas fixes by juanmleng in https://github.com/validmind/developer-framework/pull/168
* John6797/sc 5851/add regression support to robustness diagnosis by johnwalz97 in https://github.com/validmind/developer-framework/pull/169
* fix: use dict instead of df for test result in robustness diagnosis by johnwalz97 in https://github.com/validmind/developer-framework/pull/170
* John/upgrade robustness to plotly by johnwalz97 in https://github.com/validmind/developer-framework/pull/172
* Update LLM notebooks by cachafla in https://github.com/validmind/developer-framework/pull/173
* [SC-5932] Replace accessing features in tests using parameters and instead use the feature columns by juanmleng in https://github.com/validmind/developer-framework/pull/177
* Refactor add_test_description script by cachafla in https://github.com/validmind/developer-framework/pull/178
* First-Class Support for Unit Metrics (Phase 1) by johnwalz97 in https://github.com/validmind/developer-framework/pull/176
* Remove RAGAS Scores Tables by johnwalz97 in https://github.com/validmind/developer-framework/pull/179
* Edited format of test descriptions so that they are uniform by validbeck in https://github.com/validmind/developer-framework/pull/180
* Edited model validation embeddings `StabilityAnalysis.py` by validbeck in https://github.com/validmind/developer-framework/pull/181
* John6797/hotfix/correctly log metric with only figures by johnwalz97 in https://github.com/validmind/developer-framework/pull/183
* Feat: Support PNG Images for Test Results Description Generation by johnwalz97 in https://github.com/validmind/developer-framework/pull/182
* Removed documentation projects from JN by validbeck in https://github.com/validmind/developer-framework/pull/184
* John6797/sc 6492/add support for unit metric template blocks by johnwalz97 in https://github.com/validmind/developer-framework/pull/186
* Ability to disable test descriptions on the developer framework via feature flags by cachafla in https://github.com/validmind/developer-framework/pull/187
* [SC 5885] Convert multi-dataset or multi-model tests into single dataset/model tests by AnilSorathiya in https://github.com/validmind/developer-framework/pull/175
* Bump pdoc from 14.5.0 to 14.5.1 by dependabot in https://github.com/validmind/developer-framework/pull/188

External

* Feat: Mechanism for Filtering Columns in a Dataset when Running a Test by johnwalz97 in https://github.com/validmind/developer-framework/pull/155
* [SC 5588] Create demo notebook for ongoing monitoring by AnilSorathiya in https://github.com/validmind/developer-framework/pull/154


New Contributors
* dependabot made their first contribution in https://github.com/validmind/developer-framework/pull/188

**Full Changelog**: https://github.com/validmind/developer-framework/compare/v2.4.10...v2.5.15

What's Changed

Internal

* fix: add openai as core dependency by johnwalz97 in https://github.com/validmind/developer-framework/pull/141
* Missed some Learn more ... Model documentation links by validbeck in https://github.com/validmind/developer-framework/pull/143
* Hotfix: Remove `openai` from `all` extras group by johnwalz97 in https://github.com/validmind/developer-framework/pull/146
* Hotfix/dependency issues by johnwalz97 in https://github.com/validmind/developer-framework/pull/148
* Fix `Text` type casting by cachafla in https://github.com/validmind/developer-framework/pull/149
* [SC 5587] Initial support ongoing monitoring through header by AnilSorathiya in https://github.com/validmind/developer-framework/pull/152

External

* [SC-5466] Exclude categorical and binary features from outlier tests by juanmleng in https://github.com/validmind/developer-framework/pull/140
* Generalize support for comparison tests by cachafla in https://github.com/validmind/developer-framework/pull/144
* Fix: Don't Include Internal Columns in Test Results by johnwalz97 in https://github.com/validmind/developer-framework/pull/151


**Full Changelog**: https://github.com/validmind/developer-framework/compare/v2.4.4...v2.4.10