Transformer-lens

Quick little bug fix in the Abstract Attention component shape.

What's Changed
* Fix attention result projection by callummcdougall in https://github.com/TransformerLensOrg/TransformerLens/pull/666


**Full Changelog**: https://github.com/TransformerLensOrg/TransformerLens/compare/v2.2.0...v2.2.1

New Contributors
* ianand made their first contribution in https://github.com/TransformerLensOrg/TransformerLens/pull/636
* FlyingPumba made their first contribution in https://github.com/TransformerLensOrg/TransformerLens/pull/643

**Full Changelog**: https://github.com/TransformerLensOrg/TransformerLens/compare/v2.1.0...v2.2.0

Here's an important one! This release adds Gemma-2, and it also greatly improves model accuracy across the board. It is highly recommended that everyone update to this version immediately to take advantage of these accuracy improvements.

What's Changed
* Fix typo in Main_Demo.ipynb by ianand in https://github.com/TransformerLensOrg/TransformerLens/pull/636
* Add comparing-to-huggingface.ipynb. by joelburget in https://github.com/TransformerLensOrg/TransformerLens/pull/637
* Add tests for gated mlp by anthonyduong9 in https://github.com/TransformerLensOrg/TransformerLens/pull/638
* Match Huggingface MLP implementation exactly. by joelburget in https://github.com/TransformerLensOrg/TransformerLens/pull/641
* Add tests for ActivationCache by FlyingPumba in https://github.com/TransformerLensOrg/TransformerLens/pull/643
* Moved mixtral weights to another module by bryce13950 in https://github.com/TransformerLensOrg/TransformerLens/pull/646
* Fixed weight conversion by bryce13950 in https://github.com/TransformerLensOrg/TransformerLens/pull/648
* Move out pretrained weight conversions by richardkronick in https://github.com/TransformerLensOrg/TransformerLens/pull/647
* Match Huggingface GPT2 implementation *exactly* by joelburget in https://github.com/TransformerLensOrg/TransformerLens/pull/645
* Fix Out bias not being summed in attention component when using 4 bit precision by FlyingPumba in https://github.com/TransformerLensOrg/TransformerLens/pull/654
* Mlp cleanup by bryce13950 in https://github.com/TransformerLensOrg/TransformerLens/pull/652
* Added support for Gemma-2 by neelnanda-io in https://github.com/TransformerLensOrg/TransformerLens/pull/650
* add tests for Attention by anthonyduong9 in https://github.com/TransformerLensOrg/TransformerLens/pull/639

New model support, and a handful of bug fixes to documentation!

What's Changed
* Encoder-Decoder (T5) support by somvy in https://github.com/TransformerLensOrg/TransformerLens/pull/605
* Update README links to ARENA mech interp tutorials by gileshd in https://github.com/TransformerLensOrg/TransformerLens/pull/630
* Lock datasets version by courtney-sims in https://github.com/TransformerLensOrg/TransformerLens/pull/632

New Contributors
* somvy made their first contribution in https://github.com/TransformerLensOrg/TransformerLens/pull/605
* gileshd made their first contribution in https://github.com/TransformerLensOrg/TransformerLens/pull/630
* courtney-sims made their first contribution in https://github.com/TransformerLensOrg/TransformerLens/pull/632

**Full Changelog**: https://github.com/TransformerLensOrg/TransformerLens/compare/v2.0.1...v2.1.0

Minor little fix to demos. There were some bad Urls within the demos that have been fixed. Test coverage has also been increased with this release.

What's Changed
* Fix demos pip install packages from unfound repos by anthonyduong9 in https://github.com/TransformerLensOrg/TransformerLens/pull/625
* Unit tests loading from pretrained fill missing keys by richardkronick in https://github.com/TransformerLensOrg/TransformerLens/pull/623

New Contributors
* richardkronick made their first contribution in https://github.com/TransformerLensOrg/TransformerLens/pull/623

**Full Changelog**: https://github.com/TransformerLensOrg/TransformerLens/compare/v2.0.0...v2.0.1

New Contributors
* fakerybakery made their first contribution in https://github.com/TransformerLensOrg/TransformerLens/pull/579
* slash3g made their first contribution in https://github.com/TransformerLensOrg/TransformerLens/pull/573
* bmillwood made their first contribution in https://github.com/TransformerLensOrg/TransformerLens/pull/609
* starship006 made their first contribution in https://github.com/TransformerLensOrg/TransformerLens/pull/607
* anthonyduong9 made their first contribution in https://github.com/TransformerLensOrg/TransformerLens/pull/610

**Full Changelog**: https://github.com/TransformerLensOrg/TransformerLens/compare/v1.19.0...v2.0.0