What's Changed * feat: add latency assertion type by typpo in https://github.com/promptfoo/promptfoo/pull/344 * feat: add perplexity assertion type by typpo in https://github.com/promptfoo/promptfoo/pull/346 * feat: add support for ollama chat API by typpo in https://github.com/promptfoo/promptfoo/pull/342 * feat: retry when getting internal server error with PROMPTFOO_RETRY_5XX envar by jtsai-quid in https://github.com/promptfoo/promptfoo/pull/327 * fix: properly escape arguments for external python assertions by typpo in https://github.com/promptfoo/promptfoo/pull/338 * fix: use execFile/spawn for external processes by typpo in https://github.com/promptfoo/promptfoo/pull/343 * [fix: handle null score in custom metrics](https://github.com/promptfoo/promptfoo/commit/514feed49e2f83f3e04d3e167e5833dc075e6c10) * [fix: increment failure counter for script errors.](https://github.com/promptfoo/promptfoo/commit/61d1b068f26c63f3234dc49c9d5f5104b9cf1cda)
New Contributors * jtsai-quid made their first contribution in https://github.com/promptfoo/promptfoo/pull/327
What's Changed * feat: add support for Google Gemini model by typpo in https://github.com/promptfoo/promptfoo/pull/336 * feat(webview): Layout and styling improvements by typpo in https://github.com/promptfoo/promptfoo/pull/333 * feat: add download yaml button in config modal. Related to 330 by typpo in https://github.com/promptfoo/promptfoo/pull/332 * fix: set process exit code on failure
What's Changed * feat(webview): Show aggregated named metrics at top of column by typpo in https://github.com/promptfoo/promptfoo/pull/322 * fix: sharing option is degraded by mocyuto in https://github.com/promptfoo/promptfoo/pull/325
New Contributors * mocyuto made their first contribution in https://github.com/promptfoo/promptfoo/pull/325
What's Changed * fix: issues when evaling multiple config files * feat: support for web viewer running remotely by typpo in https://github.com/promptfoo/promptfoo/pull/321
What's Changed * feat: add support for ajv formats by typpo in https://github.com/promptfoo/promptfoo/pull/314 * feat: support prompt functions via nodejs interface by typpo in https://github.com/promptfoo/promptfoo/pull/315 * feat(openai): Adds support for function call validation by typpo in https://github.com/promptfoo/promptfoo/pull/316 * fix: webview handling of truncated cell contents with html by typpo in https://github.com/promptfoo/promptfoo/pull/318 * docs: Merge docs into main repo by typpo in https://github.com/promptfoo/promptfoo/pull/317
What's Changed * fix(openai): add support for overriding api key, host, baseurl, org in Assistants API by typpo in https://github.com/promptfoo/promptfoo/pull/311