Promptfoo

Latest version: v0.1.0

Safety actively analyzes 706267 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 27 of 28

0.8.2

- Fix cache behavior edge case

For more info on backwards compatibility with configs before 0.8.0, see: https://github.com/typpo/promptfoo/releases/tag/0.8.0

**Full Changelog**: https://github.com/typpo/promptfoo/compare/0.8.1...0.8.2

0.8.1

- Fix some issues with `--vars` and `--tests` backwards compatibility

For more info on backwards compatibility, see: https://github.com/typpo/promptfoo/releases/tag/0.8.0

**Full Changelog**: https://github.com/typpo/promptfoo/compare/0.8.0...0.8.1

0.8.0

What's Changed
* Simplify API and add support for unified test suite definition by typpo in https://github.com/typpo/promptfoo/pull/14

Breaking changes

**If you're using the CLI:** The format of `promptfooconfig` has updated. Although it is mostly backwards compatible, but:
- The following options have moved inside `evaluateOptions`: `maxConcurrency`, `showProgressBar`, `generateSuggestions`.
- The following options have moved inside `commandLineOptions`: `write`, `cache`, `verbose`, `view`, and similar.

See [configuration guide](https://www.promptfoo.dev/docs/configuration/guide) for more details.

**If you're using the library**: The function signature of `promptfoo.evaluate` has updated. See [Using the node package](https://www.promptfoo.dev/docs/usage/node-package) docs.


**Full Changelog**: https://github.com/typpo/promptfoo/compare/0.7.0...0.8.0

0.7.0

What's Changed
* Improve caching and cache all requests by default

0.6.0

What's Changed
* Add support for open-source LLMs like Llama, Alpaca, Vicuna, GPT4All via LocalAI
* Add glob support
* Jest and mocha integrations
* Rename eval: to fn: for custom js fnc tests by MentalGear
* Add exports for types and useful utility functions
* Support non-es module requires
* Web viewer dark mode
* Improved handling of third-party API errors
* Many other fixes and improvements

New Contributors
* MentalGear made their first contribution in https://github.com/typpo/promptfoo/pull/11
* dependabot made their first contribution in https://github.com/typpo/promptfoo/pull/15

**Full Changelog**: https://github.com/typpo/promptfoo/commits/0.6.0

0.5.1

- Fix issue with running promptfoo without `OPENAI_API_KEY` set

Page 27 of 28

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.