Promptfoo

What's Changed
* feat(mistral): Add Mistral provider by streichsbaer in https://github.com/promptfoo/promptfoo/pull/455
* feat(openai): add support for `apiKeyEnvar` by typpo in https://github.com/promptfoo/promptfoo/pull/456
* feat(azureopenai): add apiBaseUrl config by typpo in https://github.com/promptfoo/promptfoo/pull/459
* feat: cohere api support by typpo in https://github.com/promptfoo/promptfoo/pull/457
* feat: ability to override select-best prompt. 289
* fix(vertex/gemini): add support for llm-rubric and other OpenAI-formatted prompts by typpo in https://github.com/promptfoo/promptfoo/pull/450
* fix: support for gemini generationConfig and safetySettings by typpo in https://github.com/promptfoo/promptfoo/pull/454
* documentation: update python.md typo in yaml by romaintoub in https://github.com/promptfoo/promptfoo/pull/446

New Contributors
* romaintoub made their first contribution in https://github.com/promptfoo/promptfoo/pull/446

**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.39.1...0.40.0

What's Changed
* fix: func => function in index.ts by joeltjames in https://github.com/promptfoo/promptfoo/pull/443
* feat: add support for google ai studio gemini by typpo in https://github.com/promptfoo/promptfoo/pull/445

New Contributors
* joeltjames made their first contribution in https://github.com/promptfoo/promptfoo/pull/443

What's Changed
* feat: Add DefaultGradingJsonProvider to improve `llm-rubric` reliability by typpo in https://github.com/promptfoo/promptfoo/pull/432
* feat: add caching for exec and python providers by typpo in https://github.com/promptfoo/promptfoo/pull/435
* feat: add `--watch` option to eval command by typpo in https://github.com/promptfoo/promptfoo/pull/439
* feat: ability to transform output on per-assertion level by typpo in https://github.com/promptfoo/promptfoo/pull/437
* feat: compare between multiple outputs with `select-best` by typpo in https://github.com/promptfoo/promptfoo/pull/438
* fix: pass through cost to runAssertion
* fix: pass through cost to runAssertion


**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.38.0...0.39.0

What's Changed
* fix: Only open previous results when necessary (uses lots of memory) by greysteil in https://github.com/promptfoo/promptfoo/pull/418
* fix: html output by mautini in https://github.com/promptfoo/promptfoo/pull/430
* feat(openai): Jan 25 model updates by typpo in https://github.com/promptfoo/promptfoo/pull/416
* feat: add a `python` provider that supports native python function calls by typpo in https://github.com/promptfoo/promptfoo/pull/419
* feat(webui): eval deeplinks by typpo in https://github.com/promptfoo/promptfoo/pull/426
* feat(huggingface): Support sentence similarity inference API by typpo in https://github.com/promptfoo/promptfoo/pull/425
* feat: support for image models such as dall-e by typpo in https://github.com/promptfoo/promptfoo/pull/406
* feat: support for `PROMPTFOO_PROMPT_SEPARATOR envar. 424

New Contributors
* mautini made their first contribution in https://github.com/promptfoo/promptfoo/pull/430

**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.37.1...0.38.0

What's Changed
* fix: do not require token usage info on openai provider by typpo in https://github.com/promptfoo/promptfoo/pull/414


**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.37.0...0.37.1

What's Changed
* feat: standalone share server by typpo in https://github.com/promptfoo/promptfoo/pull/408
* feat(webui): add markdown support by typpo in https://github.com/promptfoo/promptfoo/pull/403
* feat: `PROMPTFOO_DISABLE_TEMPLATING` disables nunjucks templates by typpo in https://github.com/promptfoo/promptfoo/pull/405


**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.36.0...0.37.0