Promptfoo

What's Changed
* feat: add `promptfoo generate dataset` by typpo in https://github.com/promptfoo/promptfoo/pull/397
* feat(webui): Ability to comment on outputs by typpo in https://github.com/promptfoo/promptfoo/pull/395
* feat(azure): Add response_format support by streichsbaer in https://github.com/promptfoo/promptfoo/pull/402
* feat(azure): add support for `passthrough` and `apiVersion` by typpo in https://github.com/promptfoo/promptfoo/pull/399
* fix: typo by Wehzie in https://github.com/promptfoo/promptfoo/pull/401

New Contributors
* streichsbaer made their first contribution in https://github.com/promptfoo/promptfoo/pull/402

**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.35.1...0.36.0

What's Changed
* feat(bedrock): introduce amazon titan models as another option for Bedrock by igorlima in https://github.com/promptfoo/promptfoo/pull/380
* fix: proper support for multiple types of test providers by typpo in https://github.com/promptfoo/promptfoo/pull/386
* feat(openai): add support for `passthrough` request args by typpo in https://github.com/promptfoo/promptfoo/pull/388
* feat(azure): add support for client id/secret auth by typpo in https://github.com/promptfoo/promptfoo/pull/389
* feat(webui): label evals using `description` field by typpo in https://github.com/promptfoo/promptfoo/pull/391
* feat: update CSV and HTML outputs with more details by typpo in https://github.com/promptfoo/promptfoo/pull/393

New Contributors
* igorlima made their first contribution in https://github.com/promptfoo/promptfoo/pull/380

**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.35.0...0.35.1

What's Changed
* feat: support standalone assertions on CLI by typpo in https://github.com/promptfoo/promptfoo/pull/368
* feat(webview): add regex search by typpo in https://github.com/promptfoo/promptfoo/pull/378
* feat: add perplexity-score metric by typpo in https://github.com/promptfoo/promptfoo/pull/377
* feat: add logprobs support for azure openai by typpo in https://github.com/promptfoo/promptfoo/pull/376
* fix: use relative paths consistently and handle object formats by typpo in https://github.com/promptfoo/promptfoo/pull/375
* [fix: restore __prefix and __suffix column handlers when loading test csv](https://github.com/promptfoo/promptfoo/commit/3a058684b3389693f4c5899f786fb090b04e3c93)


**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.34.1...0.35.0

What's Changed
* feat: Support for evaluating cost of LLM inference by typpo in https://github.com/promptfoo/promptfoo/pull/358
* feat: save manual edits to test outputs in webview by typpo in https://github.com/promptfoo/promptfoo/pull/362
* feat: add `cost` assertion type by typpo in https://github.com/promptfoo/promptfoo/pull/367
* fix: handle huggingface text generation returning dict by typpo in https://github.com/promptfoo/promptfoo/pull/357
* fix: disable cache when using repeat by typpo in https://github.com/promptfoo/promptfoo/pull/361
* fix: do not dereference tools and functions in config by typpo in https://github.com/promptfoo/promptfoo/pull/365
* docs: optimize docs of openai tool usage by Undertone0809 in https://github.com/promptfoo/promptfoo/pull/355


**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.33.2...0.34.0

What's Changed
* fix: bad indentation for inline python sript by typpo in https://github.com/promptfoo/promptfoo/pull/353
* [fix: truncate CLI table headers](https://github.com/promptfoo/promptfoo/commit/9aa9106cc9bc1660df40117d3c8f053f361fa09c)
* feat: add openai tool parameter by Undertone0809 in https://github.com/promptfoo/promptfoo/pull/350
* feat: add `is-valid-openai-tools-call` assertion type by typpo in https://github.com/promptfoo/promptfoo/pull/354

New Contributors
* Undertone0809 made their first contribution in https://github.com/promptfoo/promptfoo/pull/350

**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.33.1...0.33.2

What's changed
* [fix: pass env to providers when using CLI](https://github.com/promptfoo/promptfoo/commit/e8170a7f0e9d4033ef219169115f6474d978f1a7)
* [fix: correctly handle bedrock models containing :](https://github.com/promptfoo/promptfoo/commit/4469b693993934192fee2e84cc27c21e31267e5f)