Validmind

What's Changed
* Merge Main into Prod (prod-2.0.7) by github-actions in https://github.com/validmind/developer-framework/pull/40
* Merge Main into Prod (prod-2.1.0) by github-actions in https://github.com/validmind/developer-framework/pull/60
* Merge Main into Prod (prod-2.1.1) by github-actions in https://github.com/validmind/developer-framework/pull/62
* Merge Main into Prod (prod-2.2.2) by github-actions in https://github.com/validmind/developer-framework/pull/89
* Merge Main into Prod (prod-2.2.4) by github-actions in https://github.com/validmind/developer-framework/pull/95
* Merge Main into Prod (prod-2.2.5) by github-actions in https://github.com/validmind/developer-framework/pull/99
* Merge Main into Prod (prod-2.2.6) by github-actions in https://github.com/validmind/developer-framework/pull/101
* Merge Main into Prod (prod-2.3.1) by github-actions in https://github.com/validmind/developer-framework/pull/108
* Merge Main into Prod (prod-2.3.3) by github-actions in https://github.com/validmind/developer-framework/pull/116
* Updated the required Python versions for the Developer Intro .ipynb by validbeck in https://github.com/validmind/developer-framework/pull/121
* Merge Main into Prod (prod-2.3.5) by github-actions in https://github.com/validmind/developer-framework/pull/122
* Support for comparison tests by cachafla in https://github.com/validmind/developer-framework/pull/123
* Comparison tests notebook by cachafla in https://github.com/validmind/developer-framework/pull/125
* Merge Main into Prod (prod-2.4.0) by github-actions in https://github.com/validmind/developer-framework/pull/126
* `extract_descriptions.py` should support test functions as well by cachafla in https://github.com/validmind/developer-framework/pull/124
* Cachafla/fix vr template preview by cachafla in https://github.com/validmind/developer-framework/pull/128
* [SC-5175] Enhance add extra column to support 2d arrays by juanmleng in https://github.com/validmind/developer-framework/pull/127
* John6797/sc-4068/add-support-for-model-or-project-argument by johnwalz97 in https://github.com/validmind/developer-framework/pull/129
* [SC-5207] Fix `_add_column` integration test by juanmleng in https://github.com/validmind/developer-framework/pull/130
* Fixed broken docs links in `.ipynb` by validbeck in https://github.com/validmind/developer-framework/pull/131
* PR131 edit — Missed some anchor links, fixed now by validbeck in https://github.com/validmind/developer-framework/pull/132
* Workflows to bring hotfixes back into main and staging by cachafla in https://github.com/validmind/developer-framework/pull/134
* Prod -> Main by cachafla in https://github.com/validmind/developer-framework/pull/135
* Testing support for more tests by cachafla in https://github.com/validmind/developer-framework/pull/137

New Contributors
* github-actions made their first contribution in https://github.com/validmind/developer-framework/pull/40

**Full Changelog**: https://github.com/validmind/developer-framework/compare/v2.3.5...v2.4.4

What's Changed

Internal

* [Quickstart] Fixed "Get your code snippet" header by validbeck in https://github.com/validmind/developer-framework/pull/110
* [Low Priority] Add literal type for Test IDs by johnwalz97 in https://github.com/validmind/developer-framework/pull/112
* Cachafla/additional metric test edits by cachafla in https://github.com/validmind/developer-framework/pull/113
* FIxed the broken/incorrect anchors in the ToC for "Introduction for Model Developers" by validbeck in https://github.com/validmind/developer-framework/pull/114
* [SC-4949] Replace time series notebook in integration tests by juanmleng in https://github.com/validmind/developer-framework/pull/118

External

* Terminology consolidation: use "Test" to refer to a Metric or Threshold Test by cachafla in https://github.com/validmind/developer-framework/pull/106
* [SC 4318] Notebook that explains how to use Dataset and Model by AnilSorathiya in https://github.com/validmind/developer-framework/pull/109
* [SC-4848] Improve timeseries forecasting demo by juanmleng in https://github.com/validmind/developer-framework/pull/111
* Chore: Dependency Updates by johnwalz97 in https://github.com/validmind/developer-framework/pull/117
* John6797/dependency updates by johnwalz97 in https://github.com/validmind/developer-framework/pull/119
* John6797/dependency updates by johnwalz97 in https://github.com/validmind/developer-framework/pull/120

**Full Changelog**: https://github.com/validmind/developer-framework/compare/v2.3.1...v2.3.5

What's Changed
* Fixed broken links in integrate_external_test_providers.ipynb by noosheenv in https://github.com/validmind/developer-framework/pull/91
* Fix add extra columns and other fixes in preview template by juanmleng in https://github.com/validmind/developer-framework/pull/93
* Allow passing section_id and position to result.log() by cachafla in https://github.com/validmind/developer-framework/pull/92
* Enable LLM Descriptions for Function Metric and Composite Metric Results and Fix Support for Markdown Table in Descriptions by johnwalz97 in https://github.com/validmind/developer-framework/pull/94
* QuickStart notebook improvements by nrichers in https://github.com/validmind/developer-framework/pull/71
* Fixed callouts in notebooks by noosheenv in https://github.com/validmind/developer-framework/pull/90
* Hotfix: Use correct prefix test descriptions by johnwalz97 in https://github.com/validmind/developer-framework/pull/97
* FIxed broken link to dev framework docs by validbeck in https://github.com/validmind/developer-framework/pull/96
* Turn on LLM-Generated Descriptions by Default by johnwalz97 in https://github.com/validmind/developer-framework/pull/98
* Add support for the ValidMind LLM Service by johnwalz97 in https://github.com/validmind/developer-framework/pull/102
* [SC4572] Operational deposit model demo by AnilSorathiya in https://github.com/validmind/developer-framework/pull/100
* Various Fixes - Fixes to Ragas Tests, Prompt Validation Tests by johnwalz97 in https://github.com/validmind/developer-framework/pull/104
* Fix misspellings of "ValidMind" by noosheenv in https://github.com/validmind/developer-framework/pull/103
* run_test() integration tests by cachafla in https://github.com/validmind/developer-framework/pull/105
* [SC-4820] Fix failing timeseries tests by juanmleng in https://github.com/validmind/developer-framework/pull/107

New Contributors
* noosheenv made their first contribution in https://github.com/validmind/developer-framework/pull/91

**Full Changelog**: https://github.com/validmind/developer-framework/compare/v2.2.2...v2.3.1

What's Changed

Internal

* Improve use case and data description in notebook by juanmleng in https://github.com/validmind/developer-framework/pull/39
* Don't Log Figures in Batches by johnwalz97 in https://github.com/validmind/developer-framework/pull/42
* [SC4053] Update the SHAPGlobalImportance test by AnilSorathiya in https://github.com/validmind/developer-framework/pull/45
* New "how to run dataset based tests" notebook by cachafla in https://github.com/validmind/developer-framework/pull/46
* [SC 4057] Add residuals plot test for regression models by AnilSorathiya in https://github.com/validmind/developer-framework/pull/47
* Passing `VMModel` instead of `VMModel.input_id` to `VMDataset` methods by johnwalz97 in https://github.com/validmind/developer-framework/pull/49
* Fix prediction probabilities by juanmleng in https://github.com/validmind/developer-framework/pull/51
* [SC-3423] Improvements to credit risk scorecard notebook by juanmleng in https://github.com/validmind/developer-framework/pull/52
* Hotfix for Integration Tests Script by johnwalz97 in https://github.com/validmind/developer-framework/pull/53
* use more robust markdown library by johnwalz97 in https://github.com/validmind/developer-framework/pull/55
* Couple of Bug Fixes by johnwalz97 in https://github.com/validmind/developer-framework/pull/58
* Hotfix: Pass inputs used to `_build_result()` by johnwalz97 in https://github.com/validmind/developer-framework/pull/59
* Edited credit score notebook by validbeck in https://github.com/validmind/developer-framework/pull/57
* Cachafla/reduce shap sample by cachafla in https://github.com/validmind/developer-framework/pull/61
* Small notebook fixes by nrichers in https://github.com/validmind/developer-framework/pull/64
* Edited how to run dataset based tests notebook by validbeck in https://github.com/validmind/developer-framework/pull/65
* Fix prediction probabilities by juanmleng in https://github.com/validmind/developer-framework/pull/70
* [POC] RAG pipeline for RFP answer generation with LangChain and RAGAS by juanmleng in https://github.com/validmind/developer-framework/pull/56
* [SC-4213] Create a notebook with LlamaIndex as the RAG pipeline coordinator by juanmleng in https://github.com/validmind/developer-framework/pull/68
* [SC 4212] Build end to end notebook that uses langchain by AnilSorathiya in https://github.com/validmind/developer-framework/pull/69
* Fix rendering risk assessment blocks by cachafla in https://github.com/validmind/developer-framework/pull/72
* WIP: RAG Model Framework Support by johnwalz97 in https://github.com/validmind/developer-framework/pull/63
* fixing issue that was causing integration tests to fail by johnwalz97 in https://github.com/validmind/developer-framework/pull/73
* Fix notebook and ragas tests by AnilSorathiya in https://github.com/validmind/developer-framework/pull/74
* [SC-4213] Create embedding metrics by juanmleng in https://github.com/validmind/developer-framework/pull/75
* [SC 4211] Define and implement required output validation tests for RAG use case by AnilSorathiya in https://github.com/validmind/developer-framework/pull/78
* [SC 4211] Define and implement required output validation tests for RAG use case by AnilSorathiya in https://github.com/validmind/developer-framework/pull/80
* RAG Demo Notebook by johnwalz97 in https://github.com/validmind/developer-framework/pull/82
* [SC-4213] RAG with LlamaIndex end to end notebook by juanmleng in https://github.com/validmind/developer-framework/pull/79
* [SC 4445] Update rag langchain demo notebook by AnilSorathiya in https://github.com/validmind/developer-framework/pull/83
* Hotfix/predictions bug by johnwalz97 in https://github.com/validmind/developer-framework/pull/85
* fixing input tracking for composite metrics by johnwalz97 in https://github.com/validmind/developer-framework/pull/86
* John6797/sc 4573/fix input registration and tracking for foundationmodel by johnwalz97 in https://github.com/validmind/developer-framework/pull/88
* [SC-4444] Enhancements to NLP model evaluation metrics by juanmleng in https://github.com/validmind/developer-framework/pull/84
* [SC 4571] Initial poc for market basket analysis by AnilSorathiya in https://github.com/validmind/developer-framework/pull/87

External

* [SC-3423] Review credit scorecard notebook by juanmleng in https://github.com/validmind/developer-framework/pull/43
* John6797/sc 3882/metric decorator should work with test providers by johnwalz97 in https://github.com/validmind/developer-framework/pull/44
* John6797/sc 3881/support for metadata in new metric decorator by johnwalz97 in https://github.com/validmind/developer-framework/pull/48
* New introductory notebook for model developers by cachafla in https://github.com/validmind/developer-framework/pull/50
* Add more contextual information to Jupyter notebooks by nrichers in https://github.com/validmind/developer-framework/pull/54
* Support for external models by cachafla in https://github.com/validmind/developer-framework/pull/67
* [SC 4208] Define and implement required text data validation tests by AnilSorathiya in https://github.com/validmind/developer-framework/pull/76
* Initial Framework Support for LLM Agents by johnwalz97 in https://github.com/validmind/developer-framework/pull/77


New Contributors
* validbeck made their first contribution in https://github.com/validmind/developer-framework/pull/57

**Full Changelog**: https://github.com/validmind/developer-framework/compare/v2.0.7...v2.2.2

What's Changed

Internal

* Prod 1.27.5 by cachafla in https://github.com/validmind/developer-framework/pull/9
* Hotfix/fix log method by johnwalz97 in https://github.com/validmind/developer-framework/pull/19
* Release `main` branch to `prod` by cachafla in https://github.com/validmind/developer-framework/pull/23
* Fix some broken tests by cachafla in https://github.com/validmind/developer-framework/pull/25
* John6797/sc 3667/fix missing dependency by johnwalz97 in https://github.com/validmind/developer-framework/pull/24
* Add abstract definitions for VMDataset by cachafla in https://github.com/validmind/developer-framework/pull/26
* John6797/fix python dependencies by johnwalz97 in https://github.com/validmind/developer-framework/pull/28
* Improvements to create_new_test by cachafla in https://github.com/validmind/developer-framework/pull/21
* Improvements when using different models by cachafla in https://github.com/validmind/developer-framework/pull/30
* John6797/sc 3864/fix failing integration tests by johnwalz97 in https://github.com/validmind/developer-framework/pull/32
* Bug fixes by cachafla in https://github.com/validmind/developer-framework/pull/33
* Offline predictions for sentiment analysis and summarization by cachafla in https://github.com/validmind/developer-framework/pull/34
* [SC 3507] Add support for sklearn regression unit metrics by AnilSorathiya in https://github.com/validmind/developer-framework/pull/35
* [SC 3507] Add support for sklearn regression unit metrics by AnilSorathiya in https://github.com/validmind/developer-framework/pull/36
* [SC-3805] Improvements to summarization template and demo notebook by juanmleng in https://github.com/validmind/developer-framework/pull/37
* John6797/sc 3787/poc auto generate test result descriptions by johnwalz97 in https://github.com/validmind/developer-framework/pull/31

External

* [SC 3568] Support for Polars dataframe by AnilSorathiya in https://github.com/validmind/developer-framework/pull/17
* John6797/sc 3412/ability to compose a metric by combining by johnwalz97 in https://github.com/validmind/developer-framework/pull/18
* Support adding new extra columns on the fly by cachafla in https://github.com/validmind/developer-framework/pull/27
* Custom Metric Function Decorator by johnwalz97 in https://github.com/validmind/developer-framework/pull/29


New Contributors
* juanmleng made their first contribution in https://github.com/validmind/developer-framework/pull/37

**Full Changelog**: https://github.com/validmind/developer-framework/compare/v2.0.0...v2.0.7

What's Changed

Internal

* Use input_id to track inputs being accessed by cachafla in https://github.com/validmind/developer-framework/pull/2
* Updating numpy version to ^1.23.3 and shap to ^0.42.0 by even-steven in https://github.com/validmind/developer-framework/pull/5
* Fixes to ensure all public notebooks run end to end by cachafla in https://github.com/validmind/developer-framework/pull/6
* [Cherry Pick] Use input_id to track inputs being accessed by cachafla in https://github.com/validmind/developer-framework/pull/3
* Update main branches with fixes from release-v1 branch (1.27.4) by cachafla in https://github.com/validmind/developer-framework/pull/7
* Remove use of np.object by cachafla in https://github.com/validmind/developer-framework/pull/8
* Fix references to documentation project in Jupyter notebooks by nrichers in https://github.com/validmind/developer-framework/pull/10
* Fix some cells with invalid syntax by cachafla in https://github.com/validmind/developer-framework/pull/11
* Fix notebooks and tests to incorporate inputs by AnilSorathiya in https://github.com/validmind/developer-framework/pull/4
* Ensure all notebooks run end to end with new input/predictions syntax by cachafla in https://github.com/validmind/developer-framework/pull/12
* [SC 3406] Follow up fix notebooks and tests after merging by AnilSorathiya in https://github.com/validmind/developer-framework/pull/13
* Fix integration tests by cachafla in https://github.com/validmind/developer-framework/pull/14
* Update release_notes_check.yamlRun release notes check only if not in draft mode by nrichers in https://github.com/validmind/developer-framework/pull/15
* Update references to documentation projects on the main branch by cachafla in https://github.com/validmind/developer-framework/pull/16
* Hotfix/fix result log method by johnwalz97 in https://github.com/validmind/developer-framework/pull/20
* Cachafla/v2 fixes by cachafla in https://github.com/validmind/developer-framework/pull/22

External

* Apply changes from juan5508/sc-3259/Create-Metric-V2-class by nrichers in https://github.com/validmind/developer-framework/pull/1

New Contributors
* even-steven made their first contribution in https://github.com/validmind/developer-framework/pull/5
* nrichers made their first contribution in https://github.com/validmind/developer-framework/pull/10
* AnilSorathiya made their first contribution in https://github.com/validmind/developer-framework/pull/4

**Full Changelog**: https://github.com/validmind/developer-framework/commits/v2.0.0