What's Changed * feat: Support for Azure OpenAI Cognitive Search by Elio-Khater in https://github.com/promptfoo/promptfoo/pull/274 * [feat: Add PROMPTFOO_PYTHON environment variable](https://github.com/promptfoo/promptfoo/commit/33ecca3dab9382f063e68529c047cfd3fbd959e5)
What's Changed * fix(openai): Improve handling for function call responses by typpo in https://github.com/promptfoo/promptfoo/pull/270 * [feat(AzureOpenAI): Add support for deployment_id and dataSources](https://github.com/promptfoo/promptfoo/commit/3f6dee99b4ef860af1088c4ceda1a74726070f37) * [Stringify output display string if output is a JSON object](https://github.com/promptfoo/promptfoo/commit/e6eff1fb75e09bfd602c08edd89ec154e3e61bf9) * [Add JSON schema dereferencing support for JSON configs](https://github.com/promptfoo/promptfoo/commit/c32f9b051a51ee6e1ee08738e0921b4e05a5c23d)
What's Changed * [Fix issue with named prompt function imports](https://github.com/promptfoo/promptfoo/commit/18a4d751af15b996310eceafc5a75e114ce1bf56) * [Fix OpenAI finetuned model parsing](https://github.com/promptfoo/promptfoo/commit/b52de61c6e1fd0a9e67d2476a9f3f9153084ad61) * [Add new OpenAI models](https://github.com/promptfoo/promptfoo/commit/d9432d3b5747516aea1a7e8a744167fbd10a69d2) * Fix: Broken custom api host for OpenAI. by leonleonho in https://github.com/promptfoo/promptfoo/pull/261 * Add `classifier` assert type by typpo in https://github.com/promptfoo/promptfoo/pull/263 * Send provider options and test context to ScriptCompletion (exec) provider by typpo in https://github.com/promptfoo/promptfoo/pull/268 * Support for loading JSON schema from external file by typpo in https://github.com/promptfoo/promptfoo/pull/266
New Contributors * leonleonho made their first contribution in https://github.com/promptfoo/promptfoo/pull/261
What's Changed * Fix broken default config for OpenAI evals created in web app by finnless in https://github.com/promptfoo/promptfoo/pull/255 * Fix prompt per provider by nirkopler in https://github.com/promptfoo/promptfoo/pull/253 * Add support for custom config directory by typpo in https://github.com/promptfoo/promptfoo/pull/257 * Add latency and token metrics per prompt by typpo in https://github.com/promptfoo/promptfoo/pull/258 * Add caching support to Anthropic provider by sihil in https://github.com/promptfoo/promptfoo/pull/259 * webview: Preserve formatting of LLM outputs * Bump langchain from 0.0.317 to 0.0.325 in /examples/langchain-python by dependabot in https://github.com/promptfoo/promptfoo/pull/254
New Contributors * finnless made their first contribution in https://github.com/promptfoo/promptfoo/pull/255 * nirkopler made their first contribution in https://github.com/promptfoo/promptfoo/pull/253 * sihil made their first contribution in https://github.com/promptfoo/promptfoo/pull/259
What's Changed * cli: Add support for raw text prompts by typpo in https://github.com/promptfoo/promptfoo/pull/252 * Ensure the directory for the output file is created if it does not exist
What's Changed * allow Python in tests.csv by Wehzie in https://github.com/promptfoo/promptfoo/pull/237 * Improve escaping in matchers by typpo in https://github.com/promptfoo/promptfoo/pull/242 * Add support for nunjucks filters by typpo in https://github.com/promptfoo/promptfoo/pull/243 * Fix issue where outputPath from the configuration file is not used when `-c` option is provided * Add envar PROMPTFOO_DISABLE_CONVERSATION_VAR * Resolve promises in external assert files