Promptfoo

Latest version: v0.1.0

Safety actively analyzes 706267 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 19 of 28

0.25.1

What's Changed
* Fix issue with loading google sheets directly. by typpo in https://github.com/promptfoo/promptfoo/pull/222
* Add _conversation variable for testing multiple-turn chat conversations by typpo in https://github.com/promptfoo/promptfoo/pull/224
* Allow multiple output formats simultaneously with `outputPath` by Wehzie in https://github.com/promptfoo/promptfoo/pull/229
* Fall back to default embedding model if provided model doesn't support embeddings
* Various fixes and improvements

New Contributors
* Wehzie made their first contribution in https://github.com/promptfoo/promptfoo/pull/229

**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.25.0...0.25.1

0.25.0

What's Changed
* Add support for icontains-any and icontains-all by typpo in https://github.com/promptfoo/promptfoo/pull/210
* Bump langchain from 0.0.279 to 0.0.308 in /examples/langchain-python by dependabot in https://github.com/promptfoo/promptfoo/pull/213
* Add support for .cjs file extensions by typpo in https://github.com/promptfoo/promptfoo/pull/214
* Add Prompts and Datasets pages by typpo in https://github.com/promptfoo/promptfoo/pull/211
* Add CLI commands for listing and showing evals, prompts, and datasets by typpo in https://github.com/promptfoo/promptfoo/pull/218
* Add support for `config` object in webhook provider payload. by typpo in https://github.com/promptfoo/promptfoo/pull/217
* Other misc changes and improvements


**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.24.4...0.25.0

0.24.4

What's Changed
* Fix bug in custom function boolean return value score by typpo in https://github.com/promptfoo/promptfoo/pull/208
* Fix ollama provider with `--no-cache` and improve error handling
* Add support for HuggingFace Inference API (text generation) by typpo in https://github.com/promptfoo/promptfoo/pull/205
* Add `apiHost` config key to Azure provider


**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.24.3...0.24.4

0.24.3

What's Changed
* Better LocalAI/Ollama embeddings traversal failure by jamesbraza in https://github.com/promptfoo/promptfoo/pull/191
* `OPENAI_API_HOST` to `OPENAI_API_BASE_URL` by jamesbraza in https://github.com/promptfoo/promptfoo/pull/187
* Ability to include files as assertion values by typpo in https://github.com/promptfoo/promptfoo/pull/180
* Add hosted db for evals by typpo in https://github.com/promptfoo/promptfoo/pull/149
* Webview details pane improvements by typpo in https://github.com/promptfoo/promptfoo/pull/196
* Add support for ollama options by typpo in https://github.com/promptfoo/promptfoo/pull/199
* Adding TXT and HTML to `--output` help/error message by jamesbraza in https://github.com/promptfoo/promptfoo/pull/201


**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.24.2...0.24.3

0.24.2

What's Changed
* Specify repo in package.json by greysteil in https://github.com/promptfoo/promptfoo/pull/174
* Add support for parsing multiple json blobs in responses by IanCal in https://github.com/promptfoo/promptfoo/pull/178
* Updated node version update of Google Colab notebook example by gnakan in https://github.com/promptfoo/promptfoo/pull/171
* Fix arg escaping for external python prompts on Windows by typpo in https://github.com/promptfoo/promptfoo/pull/179
* Better OpenAI embeddings traversal failure by jamesbraza in https://github.com/promptfoo/promptfoo/pull/190
* Adds embeddings providers for LocalAI and Oolama by typpo in https://github.com/promptfoo/promptfoo/pull/189
* Add `noindex` to shared results
* Many other misc fixes and improvements

New Contributors
* IanCal made their first contribution in https://github.com/promptfoo/promptfoo/pull/178
* gnakan made their first contribution in https://github.com/promptfoo/promptfoo/pull/171
* jamesbraza made their first contribution in https://github.com/promptfoo/promptfoo/pull/190

**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.24.1...0.24.2

0.24.1

What's Changed
* Fix prompt errors caused by leading and trailing whitespace for var file imports
* Fix an issue with response parsing in LocalAI chat
* Fix issue preventing custom provider for similarity check by typpo in https://github.com/promptfoo/promptfoo/pull/152
* Fix escaping in python asserts by typpo in https://github.com/promptfoo/promptfoo/pull/156
* Fix README link to providers docs by greysteil in https://github.com/promptfoo/promptfoo/pull/153
* Allow object with function name as a value for function_call by greysteil in https://github.com/promptfoo/promptfoo/pull/158
* Add a -y/--yes option to `promptfoo view` command to skip confirmation by typpo in https://github.com/promptfoo/promptfoo/pull/166
* Other misc fixes and improvements

New Contributors
* greysteil made their first contribution in https://github.com/promptfoo/promptfoo/pull/153

**Full Changelog**: https://github.com/promptfoo/promptfoo/compare/0.24.0...0.24.1

Page 19 of 28

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.