Promptfoo

Latest version: v0.1.0

Safety actively analyzes 682457 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 3 of 28

0.73.8

What's Changed
* feat: Imitation redteam plugin by will-holley in https://github.com/promptfoo/promptfoo/pull/1163
* feat(webui): tooltip with provider config on hover by typpo in https://github.com/promptfoo/promptfoo/pull/1312
* fix(webui): make it easier to select text without toggling cell by typpo in https://github.com/promptfoo/promptfoo/pull/1295
* fix(docker): add sqlite-dev to runtime dependencies by mldangelo in https://github.com/promptfoo/promptfoo/pull/1297
* fix(redteam): update CompetitorsGrader rubric by mldangelo in https://github.com/promptfoo/promptfoo/pull/1298
* fix: report cached tokens from assertions by onyck in https://github.com/promptfoo/promptfoo/pull/1299
* fix(redteam): improve plugin and strategy selection UI by mldangelo in https://github.com/promptfoo/promptfoo/pull/1300
* fix(redteam): decrease false positives in hallucination grader by mldangelo in https://github.com/promptfoo/promptfoo/pull/1305
* fix: trim model-graded-closedqa response by minamijoyo in https://github.com/promptfoo/promptfoo/pull/1309
* fix(redteam): misc fixes in grading and calculations by typpo in https://github.com/promptfoo/promptfoo/pull/1313
* refactor(utils): move transform logic to separate file by mldangelo in https://github.com/promptfoo/promptfoo/pull/1310
* chore(cli): add option to strip auth info from shared URLs by mldangelo in https://github.com/promptfoo/promptfoo/pull/1304


**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.73.7...0.73.8

0.73.7

What's Changed
Features
- **Standalone graders for redteam** by [typpo](https://github.com/typpo) in [#1256](https://github.com/promptfoo/promptfoo/pull/1256)

Fixes
- **Punycode deprecation warning on node 22** by [typpo](https://github.com/typpo) in [#1287](https://github.com/promptfoo/promptfoo/pull/1287)
- **Improve iterative providers and update provider API interface to pass original prompt** by [mldangelo](https://github.com/mldangelo) in [#1293](https://github.com/promptfoo/promptfoo/pull/1293)

Chores
- **Add issue templates** by [typpo](https://github.com/typpo) in [#1288](https://github.com/promptfoo/promptfoo/pull/1288)
- **Support TS files for prompts providers and assertions** by [benasher44](https://github.com/benasher44) in [#1286](https://github.com/promptfoo/promptfoo/pull/1286)
- **Update dependencies** by [mldangelo](https://github.com/mldangelo) in [#1292](https://github.com/promptfoo/promptfoo/pull/1292)

CI/CD
- **Move circular dependency check to style-check job** by [mldangelo](https://github.com/mldangelo) in [#1291](https://github.com/promptfoo/promptfoo/pull/1291)

Documentation
- **Add examples for embedding and classification providers** by [Luca-Hackl](https://github.com/Luca-Hackl) in [#1296](https://github.com/promptfoo/promptfoo/pull/1296)

New Contributors
- **Luca-Hackl** made their first contribution in [1296](https://github.com/promptfoo/promptfoo/pull/1296)

**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.73.6...0.73.7

0.73.6

What's Changed

Features
* feat(ci): add Docker image publishing to GitHub Container Registry by mldangelo in https://github.com/promptfoo/promptfoo/pull/1263
* feat(webui): add yaml upload button by typpo in https://github.com/promptfoo/promptfoo/pull/1264

Documentation
* docs: fix javascript configuration guide variable example by onyck in https://github.com/promptfoo/promptfoo/pull/1268
* site(careers): update application instructions and preferences by mldangelo in https://github.com/promptfoo/promptfoo/pull/1270
* chore(python): enhance documentation, tests, formatting, and CI by mldangelo in https://github.com/promptfoo/promptfoo/pull/1282

Fixes
* fix: treat .cjs and .mjs files as javascript vars by onyck in https://github.com/promptfoo/promptfoo/pull/1267
* fix: add xml tags for better delineation in `llm-rubric`, reduce `harmful` plugin false positives by typpo in https://github.com/promptfoo/promptfoo/pull/1269
* fix: improve handling of json objects in http provider by typpo in https://github.com/promptfoo/promptfoo/pull/1274
* fix: support provider json filepath by typpo in https://github.com/promptfoo/promptfoo/pull/1279

Chores
* chore(ci): implement multi-arch Docker image build and push by mldangelo in https://github.com/promptfoo/promptfoo/pull/1266
* chore(docker): add multi-arch image description by mldangelo in https://github.com/promptfoo/promptfoo/pull/1271
* chore(deps): update ajv-formats from 2.1.1 to 3.0.1 by mldangelo in https://github.com/promptfoo/promptfoo/pull/1276
* chore(eslint): add new linter rules and improve code quality by mldangelo in https://github.com/promptfoo/promptfoo/pull/1277
* chore: move types files by typpo in https://github.com/promptfoo/promptfoo/pull/1278
* chore(deps): update swc/core to version 1.7.1 by mldangelo in https://github.com/promptfoo/promptfoo/pull/1285

Refactor
* refactor(redteam): rename strategies and improve type safety by mldangelo in https://github.com/promptfoo/promptfoo/pull/1275

CI
* ci: re-enable Node 22.x in CI matrix by mldangelo in https://github.com/promptfoo/promptfoo/pull/1272

New Contributors
* benasher44 made their first contribution in https://github.com/promptfoo/promptfoo/pull/1284

**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.73.5...0.73.6

0.73.5

What's Changed

Features
- **feat(cli):** Add the ability to share a specific eval by [typpo](https://github.com/promptfoo/promptfoo/pull/1250)
- **feat(webui):** Hide long metrics lists by [typpo](https://github.com/promptfoo/promptfoo/pull/1262)

Fixes
- **fix:** Resolve node-fetch TypeScript errors by [mldangelo](https://github.com/promptfoo/promptfoo/pull/1254)
- **fix:** Correct color error in local `checkNodeVersion` test by [mldangelo](https://github.com/promptfoo/promptfoo/pull/1255)
- **fix(redteam):** Allow arbitrary `injectVar` name for redteam providers by [mldangelo](https://github.com/promptfoo/promptfoo/pull/1253)
- **fix:** Multiple Docker fixes by [typpo](https://github.com/promptfoo/promptfoo/pull/1257)
- **fix:** Improve `--add-strategies` validation error messages by [typpo](https://github.com/promptfoo/promptfoo/pull/1260)

Chores
- **chore:** Warn when a variable is named `assert` by [typpo](https://github.com/promptfoo/promptfoo/pull/1259)
- **chore:** Update Llama examples and add support for chat-formatted prompts in Replicate by [typpo](https://github.com/promptfoo/promptfoo/pull/1261)

**Full Changelog**: [0.73.4...0.73.5](https://github.com/promptfoo/promptfoo/compare/0.73.4...0.73.5)

0.73.4

What's Changed

Fixes
- **schema**: Update config schema for strategies by mldangelo in [1244](https://github.com/promptfoo/promptfoo/pull/1244)
- **defaultTest**: Fix scenario assert merging by onyck in [1251](https://github.com/promptfoo/promptfoo/pull/1251)

Chores
- **webui**: Handle port already in use error by mldangelo in [1246](https://github.com/promptfoo/promptfoo/pull/1246)
- **webui**: Update provider list in `ProviderSelector` and add tests by mldangelo in [1245](https://github.com/promptfoo/promptfoo/pull/1245)

Site Updates
- **site**: Add blog post by typpo in [1247](https://github.com/promptfoo/promptfoo/pull/1247)
- **site**: Improve navigation and consistency by mldangelo in [1248](https://github.com/promptfoo/promptfoo/pull/1248)
- **site**: Add careers page by mldangelo in [1222](https://github.com/promptfoo/promptfoo/pull/1222)

Documentation
- **docs**: Full RAG example by typpo in [1228](https://github.com/promptfoo/promptfoo/pull/1228)

**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.73.3...0.73.4

0.73.3

What's Changed

Features
- **WebUI:** Make eval switcher more obvious by typpo in [1232](https://github.com/promptfoo/promptfoo/pull/1232)
- **Redteam:** Add iterative tree provider and strategy by mldangelo in [1238](https://github.com/promptfoo/promptfoo/pull/1238)

Fixes
- Improve `CallApiFunctionSchema`/`ProviderFunction` type by aloisklink in [1235](https://github.com/promptfoo/promptfoo/pull/1235)
- **Redteam:** CLI nits, plugins, provider functionality, and documentation by mldangelo in [1231](https://github.com/promptfoo/promptfoo/pull/1231)
- **Redteam:** PII false positives by typpo in [1233](https://github.com/promptfoo/promptfoo/pull/1233)
- **Redteam:** `--add-strategies` flag didn't work by typpo in [1234](https://github.com/promptfoo/promptfoo/pull/1234)
- Cleanup logging and fix nextui TS error by mldangelo in [1243](https://github.com/promptfoo/promptfoo/pull/1243)
- **CI:** Add registry URL to npm publish workflow by mldangelo in [1241](https://github.com/promptfoo/promptfoo/pull/1241)

Refactors
- Remove redundant chalk invocations by mldangelo in [1240](https://github.com/promptfoo/promptfoo/pull/1240)

Chores
- Update dependencies by mldangelo in [1242](https://github.com/promptfoo/promptfoo/pull/1242)

Site Updates
- Update some images by typpo in [1236](https://github.com/promptfoo/promptfoo/pull/1236)
- More image updates by typpo in [1237](https://github.com/promptfoo/promptfoo/pull/1237)

Documentation
- Update capitalization of Promptfoo and fix site deprecation warning by mldangelo in [1239](https://github.com/promptfoo/promptfoo/pull/1239)

**Full Changelog**: [0.73.2...0.73.3](https://github.com/promptfoo/promptfoo/compare/0.73.2...0.73.3)

Page 3 of 28

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.