Garak

Latest version: v0.9.0.16

Safety actively analyzes 666181 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 3 of 3

0.9.0.4

New in `garak`

Happy 4th! πŸ‡ΊπŸ‡ΈπŸŽ†

* full exchange capture and better progress tracking in the auto-red-team module (`probes.art`)
* new generator: load Hugging Face models directly instead of via `transformers.pipeline`
* handle OpenAI server-side errors more gracefully
* remove default random seed
* support custom reporting locations with `--report_prefix` option
* add module documentation

0.9.0.0.16

What's Changed

New plugins

* probe: topic pushing by leondz in https://github.com/leondz/garak/pull/764
* probe: ruby package hallucination by arjun-krishna1 in https://github.com/leondz/garak/pull/851
* probe: Latent prompt injection by leondz in https://github.com/leondz/garak/pull/877
* probe: npm package hallucination by arjun-krishna1 in https://github.com/leondz/garak/pull/861
* probe: rust crate hallucination by arjun-krishna1 in https://github.com/leondz/garak/pull/873
* generator: Groq API by mmilenkovic-groq in https://github.com/leondz/garak/pull/896

New features

* extract `generations` param to be set on probes instead of generators by jmartin-tech in https://github.com/leondz/garak/pull/837
* secure garak HF assets by leondz in https://github.com/leondz/garak/pull/854
* Rename `knownbadsignatures` to `av_spam_scanning` by leondz in https://github.com/leondz/garak/pull/850
* enable tokenizer customization in HFDetector by jmartin-tech in https://github.com/leondz/garak/pull/855
* refactor calibration / z-score code, so z-scores can be shown in CLI at run time by leondz in https://github.com/leondz/garak/pull/847

Tuning & fixes

* add automation action for plugin_cache.json by jmartin-tech in https://github.com/leondz/garak/pull/819
* add automation action for plugin_cache.json by jmartin-tech in https://github.com/leondz/garak/pull/819
* Docs/readmefaqdc32 by leondz in https://github.com/leondz/garak/pull/828
* fix initialization bug for kwargs in function by soumilinandi in https://github.com/leondz/garak/pull/827
* suppress LiteLLM logging during import by jmartin-tech in https://github.com/leondz/garak/pull/834
* relax `--probe_tags` as supported when other probe options are passed by jmartin-tech in https://github.com/leondz/garak/pull/836
* rename harness test module by leondz in https://github.com/leondz/garak/pull/848
* Surface underlying exception msg at plugin load by leondz in https://github.com/leondz/garak/pull/846
* relax litellm provider constraint by arjun-krishna1 in https://github.com/leondz/garak/pull/820
* plugin metadata tests by leondz in https://github.com/leondz/garak/pull/849
* Add explanation of how we treat the word "vulnerability" by leondz in https://github.com/leondz/garak/pull/852
* add faq items by leondz in https://github.com/leondz/garak/pull/857
* test buff transform() methods, to get them to load and run by leondz in https://github.com/leondz/garak/pull/856
* expand doc string that fails test requirements for verbosity by jmartin-tech in https://github.com/leondz/garak/pull/859
* refresh tutorial on contributing a generator by leondz in https://github.com/leondz/garak/pull/858
* avoid lambda in `_config` module level code by jmartin-tech in https://github.com/leondz/garak/pull/860
* add logging dir, new generator questions to FAQ by leondz in https://github.com/leondz/garak/pull/866
* revise default generations value to 5 by leondz in https://github.com/leondz/garak/pull/868
* validate detector doc_uri by leondz in https://github.com/leondz/garak/pull/865
* fix output error when parallel_requests > 1 and supports_multiple_generations is False by arjun-krishna1 in https://github.com/leondz/garak/pull/864
* improved messaging & error handling around NIM names by leondz in https://github.com/leondz/garak/pull/867
* look at the right var for NIM name checking by leondz in https://github.com/leondz/garak/pull/871
* filter detector template in tests by jmartin-tech in https://github.com/leondz/garak/pull/874
* have CLI UI render 100% w/o using scientific notation by leondz in https://github.com/leondz/garak/pull/882
* Generator docs are now tested for as intended by leondz in https://github.com/leondz/garak/pull/897
* reporting tweaks by leondz in https://github.com/leondz/garak/pull/901

New Contributors
* soumilinandi made their first contribution in https://github.com/leondz/garak/pull/827
* arjun-krishna1 made their first contribution in https://github.com/leondz/garak/pull/820
* mmilenkovic-groq made their first contribution in https://github.com/leondz/garak/pull/896
* greshake made their first contribution in https://github.com/leondz/garak/pull/877

**Full Changelog**: https://github.com/leondz/garak/compare/v0.9.0.15...v0.9.0.0.16

0.9.post3

Updates:

* detect exfiltration-via-markdown attack
* detect if models will help generate malware
* accept newer OpenAI generators
* broader test coverage
* refactoring for probe readability
* use smaller versions of snowball + promptinject by default
* add mappings to AVID taxonomy
* add a "hit log" to record successful attacks
* add analysis script for rough HTML report generation
* bug fixes around longer inputs
* handle server-side OpenAI API failures nicely


v0.9.post1-alpha
first alpha

Page 3 of 3

Β© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.