Sae-lens

Feature

* feat: Adding Mistral SAEs (178)

Note: normalize_activations is now a string and should be either &39;none&39;, &39;expected_average_only_in&39; (Anthropic April Update, not yet folded), &39;constant_norm_rescale&39; (Anthropic Feb update).

* Adding code to load mistral saes

* Black formatting

* Removing library changes that allowed forward pass normalization

* feat: support feb update style norm scaling for mistral saes

* Adding code to load mistral saes

* Black formatting

* Removing library changes that allowed forward pass normalization

* Adding code to load mistral saes

* Black formatting

* Removing library changes that allowed forward pass normalization

* feat: support feb update style norm scaling for mistral saes

* remove accidental inclusion

---------
Co-authored-by: jbloomAus <jbloomausgmail.com> ([`227d208`](https://github.com/jbloomAus/SAELens/commit/227d2089f6fdadb54b5554056eb7721574608b58))

Unknown

* Update README.md Slack Link Expired (this one shouldn&39;t expire) ([`209696a`](https://github.com/jbloomAus/SAELens/commit/209696a4f74007559a650ad5357c4fd923205923))

* add expected perf for pretrained (179)

Co-authored-by: jbloom-md <josephmassdynamics.com> ([`10bd9c5`](https://github.com/jbloomAus/SAELens/commit/10bd9c58fd4d731bd453e49943d40f2ac01ff0fc))

* fix progress bar updates (171) ([`4d92975`](https://github.com/jbloomAus/SAELens/commit/4d92975cc1aa8cd7485e73597fd52e13a0f8e44e))

Feature

* feat: updating docs and standardizing PretokenizeRunner export (176) ([`03f071b`](https://github.com/jbloomAus/SAELens/commit/03f071b41e77ef07c8f8b892e52969337f5e94aa))

Unknown

* add tutorial (175) ([`8c67c23`](https://github.com/jbloomAus/SAELens/commit/8c67c2355211910bc5054ba9bc140e98424fa026))

Fix

* fix: allow tutorial packages for colab install to use latest version (173)

fix: allow tutorial packages for colab install to use latest version (173) ([`f73cb73`](https://github.com/jbloomAus/SAELens/commit/f73cb73072e006f6dda0984e05e8accda014a2d8))

Unknown

* fix pip install in HookedSAETransformer Demo (172) ([`5d0faed`](https://github.com/jbloomAus/SAELens/commit/5d0faedf868d6e68035527a52ba718807e8ed196))

Fix

* fix: removing truncation in activations store data loading (62) ([`43c93e2`](https://github.com/jbloomAus/SAELens/commit/43c93e2c3e19e9e9d81b48d3a472d894dac83d65))

Fix

* fix: moving non-essential deps to dev (121) ([`1a2cde0`](https://github.com/jbloomAus/SAELens/commit/1a2cde04d306061e7765a61e44d77ad1f3f8a1d4))

Feature

* feat: activation norm scaling factor folding (170)

* feat: add convenience function for folding scaling factor

* keep playing around with benchmark ([`773e308`](https://github.com/jbloomAus/SAELens/commit/773e30898bb0957d4c9bd79343776ff3e225d13c))