Fmeval

What's Changed
* build: add fmeval support for python 3.11 and 3.12 by Satish615 in https://github.com/aws/fmeval/pull/339
* build: bump up fmeval version to 1.2.2 by Satish615 in https://github.com/aws/fmeval/pull/339

**Full Changelog**: https://github.com/aws/fmeval/compare/v1.2.1...v1.2.2

What's Changed
* build(deps) bump nltk from 3.8.1 to 3.9.1 by danielezhu in https://github.com/aws/fmeval/pull/327
* build: bump fmeval version to 1.2.1 by shrestha-bikash in https://github.com/aws/fmeval/pull/329


**Full Changelog**: https://github.com/aws/fmeval/compare/v1.2.0...v1.2.1

What's Changed
* refactor: `SummarizationAccuracyMetrics` transform to handle multiple target outputs more efficiently by kirupang-code in https://github.com/aws/fmeval/pull/317
* feat: Add `BERT_SCORE` to `QAAccuracy` and update unit/integration tests by kirupang-code in https://github.com/aws/fmeval/pull/314
* build(deps): pinned nltk version to address build failure by kirupang-code in https://github.com/aws/fmeval/pull/323
* feat: add `BERT_SCORE` to `QAAccuracySemanticRobustness` by kirupang-code in https://github.com/aws/fmeval/pull/315
* [Fix] Updated notebook rendering as suggested in issue 316 by polaschwoebel in https://github.com/aws/fmeval/pull/320
* chore: update urllib3 version by kirupang-code in https://github.com/aws/fmeval/pull/318
* build(deps): bump zipp from 3.19.0 to 3.19.1 by dependabot in https://github.com/aws/fmeval/pull/304
* build(deps): bump aiohttp from 3.9.5 to 3.10.2 by dependabot in https://github.com/aws/fmeval/pull/321
* doc: delete ROUGE/METEOR score from QAAccuracy documentation by kirupang-code in https://github.com/aws/fmeval/pull/325
* build: bump fmeval version to 1.2.0 by kirupang-code in https://github.com/aws/fmeval/pull/326


**Full Changelog**: https://github.com/aws/fmeval/compare/v1.1.0...v1.2.0

What's Changed
* chore: add support for proprietary models by shrestha-bikash in https://github.com/aws/fmeval/pull/276
* feat: allow placeholder dict for prompt composer by xiaoyi-cheng in https://github.com/aws/fmeval/pull/273
* feat: add target_context to dataset columns by oyangz in https://github.com/aws/fmeval/pull/266
* feat: add SaveStrategy to allow flexibility in saving localized evaluation outputs by keerthanvasist in https://github.com/aws/fmeval/pull/281
* feat: modify GeneratePrompt transform to take placeholder_dict by xiaoyi-cheng in https://github.com/aws/fmeval/pull/288
* Support multiple data configs in evaluate by athewsey in https://github.com/aws/fmeval/pull/283
* Fix comparisons for string enumerations by athewsey in https://github.com/aws/fmeval/pull/282
* feat: support embedding model runner by xiaoyi-cheng in https://github.com/aws/fmeval/pull/293
* build(deps): bump tornado from 6.4 to 6.4.1 by dependabot in https://github.com/aws/fmeval/pull/287
* build(deps): bump urllib3 from 1.26.18 to 1.26.19 by dependabot in https://github.com/aws/fmeval/pull/292
* feat: add error field in EvalScore by xiaoyi-cheng in https://github.com/aws/fmeval/pull/297
* build(deps-dev): bump pdoc from 14.5.0 to 14.5.1 by dependabot in https://github.com/aws/fmeval/pull/296
* feat: add validate_prompt_template util by xiaoyi-cheng in https://github.com/aws/fmeval/pull/300
* fix: register placeholder_to_record_key in GeneratePrompt transform by xiaoyi-cheng in https://github.com/aws/fmeval/pull/301
* build(deps): bump certifi from 2024.2.2 to 2024.7.4 by dependabot in https://github.com/aws/fmeval/pull/303
* feat: add `quasi_exact_inclusion` metric to factual knowledge; change `factual_knowledge` score name to `exact_inclusion` by kirupang-code in https://github.com/aws/fmeval/pull/302
* fix: update how default payloads get extracted from model spec by danielezhu in https://github.com/aws/fmeval/pull/309
* feat: update context to take lists and rename context field by oyangz in https://github.com/aws/fmeval/pull/305
* feat: add configurable param logical_operator (OR/AND) to factual knowledge by kirupang-code in https://github.com/aws/fmeval/pull/307
* feat: update s3 data source for us-isof partition by oyangz in https://github.com/aws/fmeval/pull/311
* chore: rename factual knowledge scores by danielezhu in https://github.com/aws/fmeval/pull/312
* build: bump fmeval version to 1.1.0 by danielezhu in https://github.com/aws/fmeval/pull/313

New Contributors
* shrestha-bikash made their first contribution in https://github.com/aws/fmeval/pull/276
* athewsey made their first contribution in https://github.com/aws/fmeval/pull/283
* kirupang-code made their first contribution in https://github.com/aws/fmeval/pull/302

**Full Changelog**: https://github.com/aws/fmeval/compare/v1.0.3...v1.1.0

What's Changed
* docs: update telemetry-related info in README and docstrings by danielezhu in https://github.com/aws/fmeval/pull/265
* feat: fetch log probability jmespath from JS metadata by keerthanvasist in https://github.com/aws/fmeval/pull/267
* build(deps): bump jinja2 from 3.1.3 to 3.1.4 by dependabot in https://github.com/aws/fmeval/pull/272
* build(deps): bump tqdm from 4.66.2 to 4.66.3 by dependabot in https://github.com/aws/fmeval/pull/271
* fix: update pinned sagemaker python sdk version and get_user_agent_extra util function by danielezhu in https://github.com/aws/fmeval/pull/274
* build: bump fmeval version to 1.0.3 by danielezhu in https://github.com/aws/fmeval/pull/275


**Full Changelog**: https://github.com/aws/fmeval/compare/v1.0.2...v1.0.3

What's Changed
* chore: simplify botocore/boto3-related util code by danielezhu in https://github.com/aws/fmeval/pull/256
* docs: create Github Actions workflow for generating docs via pdoc by danielezhu in https://github.com/aws/fmeval/pull/260
* test: update matplotlib version and figure cell init test by oyangz in https://github.com/aws/fmeval/pull/259
* chore: update lib versions based on dependabot recommendation by keerthanvasist in https://github.com/aws/fmeval/pull/258
* docs: add syntax highlighting by connorads in https://github.com/aws/fmeval/pull/261
* feat: add fmeval-specific user agent header to botocore config for telemetry purposes by danielezhu in https://github.com/aws/fmeval/pull/262
* fix: fix patching in unit tests by danielezhu in https://github.com/aws/fmeval/pull/264
* build: bump fmeval version to 1.0.2 by danielezhu in https://github.com/aws/fmeval/pull/263

New Contributors
* connorads made their first contribution in https://github.com/aws/fmeval/pull/261

**Full Changelog**: https://github.com/aws/fmeval/compare/v1.0.1...v1.0.2