Promptfoo

What's Changed
* feat(redteam): `extra-jailbreak` plugin that applies jailbreak to all probes by typpo in https://github.com/promptfoo/promptfoo/pull/1085
* feat: `llm-rubric` uses tools API for model-grading anthropic evals by typpo in https://github.com/promptfoo/promptfoo/pull/1079
* feat: `--filter-providers` eval option by typpo in https://github.com/promptfoo/promptfoo/pull/1089
* feat(webui): show metrics as % in column header by typpo in https://github.com/promptfoo/promptfoo/pull/1087
* feat: add `author` field to evals by typpo in https://github.com/promptfoo/promptfoo/pull/1045
* fix(webui): Ability to toggle visibility of description column by typpo in https://github.com/promptfoo/promptfoo/pull/1095
* fix: improper path resolution for file:// prefixes by typpo in https://github.com/promptfoo/promptfoo/pull/1094
* chore(webui): small changes to styling by typpo in https://github.com/promptfoo/promptfoo/pull/1088
* docs: guide on how to do sandboxed evals on generated code by typpo in https://github.com/promptfoo/promptfoo/pull/1097
* build(deps): bump replicate from 0.30.2 to 0.31.0 by dependabot in https://github.com/promptfoo/promptfoo/pull/1090


**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.68.3...0.69.0

What's Changed


- **Features:**
- Added support for attachments in OpenAI assistants by [typpo](https://github.com/promptfoo/promptfoo/pull/1080)

- **Fixes:**
- Removed test mutation for classifier and select-best assertion types by [typpo](https://github.com/promptfoo/promptfoo/pull/1083)
- Treated non-existent files as prompt strings by [typpo](https://github.com/promptfoo/promptfoo/pull/1084)
- Fixed assertion result mock pollution by [mldangelo](https://github.com/promptfoo/promptfoo/pull/1086)

- **Dependencies:**
- Bumped `openai` from 4.52.2 to 4.52.3 by [dependabot](https://github.com/promptfoo/promptfoo/pull/1073)
- Bumped `aws-sdk/client-bedrock-runtime` from 3.606.0 to 3.609.0 by [dependabot](https://github.com/promptfoo/promptfoo/pull/1072)

**Full Changelog**: [0.68.2...0.68.3](https://github.com/promptfoo/promptfoo/compare/0.68.2...0.68.3)

What's Changed
* feat(webui): add scenarios to test suite configuration in yaml editor by mldangelo in https://github.com/promptfoo/promptfoo/pull/1071


**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.68.1...0.68.2

What's Changed

- **feat:** Support calling specific function from Python provider by [typpo](https://github.com/promptfoo/promptfoo/pull/1053)
- **fix:** Resolve issues with relative prompt paths by [mldangelo](https://github.com/promptfoo/promptfoo/pull/1066)
- **fix:** Handle replicate IDs without version by [typpo](https://github.com/promptfoo/promptfoo/pull/1059)
- **build(deps):** Bump `anthropic-ai/sdk` from 0.24.2 to 0.24.3 by [dependabot](https://github.com/promptfoo/promptfoo/pull/1062)

**Full Changelog:** [0.68.0...0.68.1](https://github.com/promptfoo/promptfoo/compare/0.68.0...0.68.1)

What's Changed

New Features
- feat: support for image model redteaming by typpo in [1051](https://github.com/promptfoo/promptfoo/pull/1051)
- feat(webui): Add support for markdown tables and other extras by typpo in [1042](https://github.com/promptfoo/promptfoo/pull/1042)
- feat: prompt syntax for bedrock llama3 by fvdnabee in [1038](https://github.com/promptfoo/promptfoo/pull/1038)

Fixes
- fix: http provider returns the correct response format by typpo in [1027](https://github.com/promptfoo/promptfoo/pull/1027)
- fix: handle when stdout columns are not set by typpo in [1029](https://github.com/promptfoo/promptfoo/pull/1029)
- fix: support additional models via AWS Bedrock and update documentation by mldangelo in [1034](https://github.com/promptfoo/promptfoo/pull/1034)
- fix: handle imported single test case by typpo in [1041](https://github.com/promptfoo/promptfoo/pull/1041)
- fix: dereference promptfoo test files by fvdnabee in [1035](https://github.com/promptfoo/promptfoo/pull/1035)

Chores
- chore: expose runAssertion and runAssertions to node package by typpo in [1026](https://github.com/promptfoo/promptfoo/pull/1026)
- chore: add Node.js version check to ensure compatibility by mldangelo in [1030](https://github.com/promptfoo/promptfoo/pull/1030)
- chore: enable 'typescript-eslint/no-use-before-define' linter rule by mldangelo in [1043](https://github.com/promptfoo/promptfoo/pull/1043)

Documentation
- docs: fix broken documentation links by mldangelo in [1033](https://github.com/promptfoo/promptfoo/pull/1033)
- docs: update anthropic.md by Codeshark-NET in [1036](https://github.com/promptfoo/promptfoo/pull/1036)

Continuous Integration
- ci: add GitHub Action for automatic version tagging by mldangelo in [1046](https://github.com/promptfoo/promptfoo/pull/1046)
- ci: npm publish workflow by typpo in [1044](https://github.com/promptfoo/promptfoo/pull/1044)

Dependencies
- build(deps): bump openai from 4.52.1 to 4.52.2 by dependabot in [1057](https://github.com/promptfoo/promptfoo/pull/1057)
- build(deps): bump anthropic-ai/sdk from 0.24.1 to 0.24.2 by dependabot in [1056](https://github.com/promptfoo/promptfoo/pull/1056)
- build(deps-dev): bump aws-sdk/client-bedrock-runtime from 3.602.0 to 3.606.0 by dependabot in [1055](https://github.com/promptfoo/promptfoo/pull/1055)
- build(deps): bump docker/setup-buildx-action from 2 to 3 in the github-actions group by dependabot in [1054](https://github.com/promptfoo/promptfoo/pull/1054)

New Contributors
- Codeshark-NET made their first contribution in [1036](https://github.com/promptfoo/promptfoo/pull/1036)

**Full Changelog**: [0.67.0...0.68.0](https://github.com/promptfoo/promptfoo/compare/0.67.0...0.68.0)

What's Changed
* feat: add support for gemini embeddings via vertex by typpo in https://github.com/promptfoo/promptfoo/pull/1004
* feat(bedrock): add proxy support for AWS SDK by mldangelo in https://github.com/promptfoo/promptfoo/pull/1021
* feat(redteam): Expose modified prompt for iterative jailbreaks by typpo in https://github.com/promptfoo/promptfoo/pull/1024
* feat: normalize prompt input formats, introduce single responsibility handlers, improve test coverage, and fix minor bugs by mldangelo in https://github.com/promptfoo/promptfoo/pull/994
* fix: more robust json extraction for llm-rubric by typpo in https://github.com/promptfoo/promptfoo/pull/1019
* build(deps): bump openai from 4.52.0 to 4.52.1 by dependabot in https://github.com/promptfoo/promptfoo/pull/1015
* build(deps): bump anthropic-ai/sdk from 0.24.0 to 0.24.1 by dependabot in https://github.com/promptfoo/promptfoo/pull/1016
* chore: sort imports by mldangelo in https://github.com/promptfoo/promptfoo/pull/1006
* chore: switch to smaller googleapis dependency by typpo in https://github.com/promptfoo/promptfoo/pull/1009
* chore: add config telemetry by typpo in https://github.com/promptfoo/promptfoo/pull/1005
* docs: update GitHub urls to reflect promptfoo github org repository location by mldangelo in https://github.com/promptfoo/promptfoo/pull/1011
* docs: fix incorrect yaml ref in guide by fvdnabee in https://github.com/promptfoo/promptfoo/pull/1018

New Contributors
* fvdnabee made their first contribution in https://github.com/promptfoo/promptfoo/pull/1018

**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.66.0...0.67.0