What's Changed * fix: add support for anthropic bedrock tools by typpo in https://github.com/promptfoo/promptfoo/pull/1229 * chore(redteam): add a warning for no openai key set by typpo in https://github.com/promptfoo/promptfoo/pull/1230
What's Changed * feat(redteam): add 4 new basic plugins by typpo in https://github.com/promptfoo/promptfoo/pull/1201 * feat(redteam): improve test generation logic and add batching by mldangelo in * feat(redteam): settings dialog by typpo in https://github.com/promptfoo/promptfoo/pull/1215https://github.com/promptfoo/promptfoo/pull/1208 * feat(redteam): introduce redteam section for promptfooconfig.yaml by mldangelo in https://github.com/promptfoo/promptfoo/pull/1192 * fix(validator): fix errors in default example by mldangelo in https://github.com/promptfoo/promptfoo/pull/1220 * fix(webui): misc fixes and improvements to webui visuals by typpo in https://github.com/promptfoo/promptfoo/pull/1213 * fix(redteam): mismatched categories and better overall scoring by typpo in https://github.com/promptfoo/promptfoo/pull/1214 * fix(gemini): improve error handling by typpo in https://github.com/promptfoo/promptfoo/pull/1193 * fix: gpt-4o-mini price by kongmoumou in https://github.com/promptfoo/promptfoo/pull/1218 * chore(deps): update multiple dependencies to latest minor and patch versions by mldangelo in https://github.com/promptfoo/promptfoo/pull/1210 * chore(openai): update model list by mldangelo in https://github.com/promptfoo/promptfoo/pull/1219 * test: improve type safety and resolve TypeScript errors by mldangelo in https://github.com/promptfoo/promptfoo/pull/1216 * refactor: resolve circular dependencies and improve code organization by mldangelo in https://github.com/promptfoo/promptfoo/pull/1212 * docs: fix broken links by mldangelo in https://github.com/promptfoo/promptfoo/pull/1211 * site: image updates and bugfixes by typpo in https://github.com/promptfoo/promptfoo/pull/1217 * site: improve human readability of validator errors by typpo in https://github.com/promptfoo/promptfoo/pull/1221 * site: yaml/json config validator for promptfoo configs by typpo in https://github.com/promptfoo/promptfoo/pull/1207
New Contributors * kongmoumou made their first contribution in https://github.com/promptfoo/promptfoo/pull/1218
Features - **feat:** add schema validation to `promptfooconfig.yaml` by [mldangelo](https://github.com/promptfoo/promptfoo/pull/1185) - **feat(openai):** add GPT-4o-mini models by [mldangelo](https://github.com/promptfoo/promptfoo/pull/1196)
Fixes - **fix(webui):** eval ID not being properly set by [typpo](https://github.com/promptfoo/promptfoo/pull/1195) - **fix:** base path for custom filter resolution by [onyck](https://github.com/promptfoo/promptfoo/pull/1198) - **fix(Dockerfile):** install curl for healthcheck by [orange-anjou](https://github.com/promptfoo/promptfoo/pull/1204)
Tests - **test(webui):** add unit tests for `InfoModal` component by [mldangelo](https://github.com/promptfoo/promptfoo/pull/1187)
Chores - **chore(redteam):** refactor PII categories and improve plugin handling by [mldangelo](https://github.com/promptfoo/promptfoo/pull/1191) - **build(deps-dev):** bump `aws-sdk/client-bedrock-runtime` from 3.614.0 to 3.616.0 by [dependabot](https://github.com/promptfoo/promptfoo/pull/1203)
Documentation - **docs:** add guide for comparing GPT-4o vs GPT-4o-mini by [mldangelo](https://github.com/promptfoo/promptfoo/pull/1200)
Site Updates - **site:** contact page by [typpo](https://github.com/promptfoo/promptfoo/pull/1190) - **site:** newsletter form by [typpo](https://github.com/promptfoo/promptfoo/pull/1194) - **site:** miscellaneous images and improvements by [typpo](https://github.com/promptfoo/promptfoo/pull/1199)
New Contributors - [onyck](https://github.com/onyck) made their first contribution in [#1198](https://github.com/promptfoo/promptfoo/pull/1198) - [orange-anjou](https://github.com/orange-anjou) made their first contribution in [#1204](https://github.com/promptfoo/promptfoo/pull/1204)
Fix * Fix: Consider model name when caching Bedrock responses by fvdnabee in [1181](https://github.com/promptfoo/promptfoo/pull/1181) * Fix: Parsing of the model name tag in Ollama embeddings provider by minamijoyo in [1189](https://github.com/promptfoo/promptfoo/pull/1189)
Refactor * Refactor (redteam): Simplify CLI command structure and update provider options by mldangelo in [1174](https://github.com/promptfoo/promptfoo/pull/1174) * Refactor (types): Convert interfaces to Zod schemas by mldangelo in [1178](https://github.com/promptfoo/promptfoo/pull/1178) * Refactor (redteam): Improve type safety and simplify code structure by mldangelo in [1175](https://github.com/promptfoo/promptfoo/pull/1175)
Chore * Chore (redteam): Another injection by typpo in [1173](https://github.com/promptfoo/promptfoo/pull/1173) * Chore (deps): Upgrade inquirer to v10 by mldangelo in [1176](https://github.com/promptfoo/promptfoo/pull/1176) * Chore (redteam): Update CLI for test case generation by mldangelo in [1177](https://github.com/promptfoo/promptfoo/pull/1177) * Chore: Include hostname in share confirmation by typpo in [1183](https://github.com/promptfoo/promptfoo/pull/1183)
Build * Build (deps-dev): Bump azure/identity from 4.3.0 to 4.4.0 by dependabot in [1180](https://github.com/promptfoo/promptfoo/pull/1180)
New Contributors * minamijoyo made their first contribution in [1189](https://github.com/promptfoo/promptfoo/pull/1189)
What's Changed * feat(webui): add about component with helpful links by mldangelo in https://github.com/promptfoo/promptfoo/pull/1149 * feat: manual input provider by typpo in https://github.com/promptfoo/promptfoo/pull/1168 * feat(webui): Ability to compare evals by typpo in https://github.com/promptfoo/promptfoo/pull/1148 * fix(webui): dark mode toggle by mldangelo in https://github.com/promptfoo/promptfoo/pull/1171 * fix(redteam): set harmCategory label for harmful tests by typpo in https://github.com/promptfoo/promptfoo/pull/1172 * chore(mistral): add codestral-mamba by streichsbaer in https://github.com/promptfoo/promptfoo/pull/1170 * chore: static imports for iterative providers by typpo in https://github.com/promptfoo/promptfoo/pull/1169