TPU first release, allowing to have TPU Text Generation Inference and Inference Endpoints container images available.
What's Changed
* Basic TGI server on XLA by tengomucho in https://github.com/huggingface/optimum-tpu/pull/1
* Enable CI/CD by tengomucho in https://github.com/huggingface/optimum-tpu/pull/2
* Fix TGI Dockerfile by shub-kris in https://github.com/huggingface/optimum-tpu/pull/3
* Add static KV cache and test on Gemma-2B by tengomucho in https://github.com/huggingface/optimum-tpu/pull/4
* Small optimizations by tengomucho in https://github.com/huggingface/optimum-tpu/pull/5
* Enable compilation by tengomucho in https://github.com/huggingface/optimum-tpu/pull/6
* Revert "fix: attention mask should be 1 or 0" by tengomucho in https://github.com/huggingface/optimum-tpu/pull/8
* feat: use dynamic batching when generating by tengomucho in https://github.com/huggingface/optimum-tpu/pull/9
* Repo layout by tengomucho in https://github.com/huggingface/optimum-tpu/pull/10
* Add PyPI release workflow by regisss in https://github.com/huggingface/optimum-tpu/pull/11
* Xla parallel proxy by tengomucho in https://github.com/huggingface/optimum-tpu/pull/12
* Add documentation to the repository by mfuntowicz in https://github.com/huggingface/optimum-tpu/pull/13
* Adopt naming convention of transformers API by mfuntowicz in https://github.com/huggingface/optimum-tpu/pull/14
* Fix main doc build workflow by regisss in https://github.com/huggingface/optimum-tpu/pull/15
* Improve readme by mfuntowicz in https://github.com/huggingface/optimum-tpu/pull/16
* Fix layout in README by mfuntowicz in https://github.com/huggingface/optimum-tpu/pull/17
* Fix rule and instructions for TGI by mfuntowicz in https://github.com/huggingface/optimum-tpu/pull/18
* Fix typo in index.mdx by mfuntowicz in https://github.com/huggingface/optimum-tpu/pull/19
* Added some links to Cloud TPU documentation by mikegre-google in https://github.com/huggingface/optimum-tpu/pull/20
* Parallel sharding by tengomucho in https://github.com/huggingface/optimum-tpu/pull/21
* Bump version to 0.1.0.dev1 by mfuntowicz in https://github.com/huggingface/optimum-tpu/pull/24
* Bump version to 0.1.0.dev2 by mfuntowicz in https://github.com/huggingface/optimum-tpu/pull/25
* Fix TGI missing import by mfuntowicz in https://github.com/huggingface/optimum-tpu/pull/27
* Forward arguments from TGI launcher to the model by mfuntowicz in https://github.com/huggingface/optimum-tpu/pull/28
* Fix optimum-tpu pip install instructions by mfuntowicz in https://github.com/huggingface/optimum-tpu/pull/29
* Fix tests with do_sample=True by tengomucho in https://github.com/huggingface/optimum-tpu/pull/30
* Sharding in tgi by tengomucho in https://github.com/huggingface/optimum-tpu/pull/31
* Fix missing '=' to assign environment variables in the default case w… by mfuntowicz in https://github.com/huggingface/optimum-tpu/pull/33
* Include two different stages for building TGI image: by mfuntowicz in https://github.com/huggingface/optimum-tpu/pull/34
* Llama support by tengomucho in https://github.com/huggingface/optimum-tpu/pull/32
* chore(ci): added workflow for nightly tests by tengomucho in https://github.com/huggingface/optimum-tpu/pull/35
* fix(build): setup.py removed from build_dist dependencies by tengomucho in https://github.com/huggingface/optimum-tpu/pull/36
* Try again to fix nightly builds by tengomucho in https://github.com/huggingface/optimum-tpu/pull/37
* Basic Llama2 Tuning by tengomucho in https://github.com/huggingface/optimum-tpu/pull/39
* Bug doc builder by pagezyhf in https://github.com/huggingface/optimum-tpu/pull/40
* Fix typo ; Update llama_tuning.md by furkanakkurt1335 in https://github.com/huggingface/optimum-tpu/pull/42
* Update to Pytorch 2.3.0 and transformers v4.40.2 by tengomucho in https://github.com/huggingface/optimum-tpu/pull/41
* Fine tuning with FSDP v2 by tengomucho in https://github.com/huggingface/optimum-tpu/pull/44
* Minor fix for mispelled stage in TGI dockerfile. by thealmightygrant in https://github.com/huggingface/optimum-tpu/pull/46
* Align to Transformers 4.41.1 by tengomucho in https://github.com/huggingface/optimum-tpu/pull/45
* chore(training): Allow training on torch xla > 2.3.0, add warning by tengomucho in https://github.com/huggingface/optimum-tpu/pull/48
* fix(build): add missing setuptools_scm section by tengomucho in https://github.com/huggingface/optimum-tpu/pull/49
* fix(logging): correct logging usage by tengomucho in https://github.com/huggingface/optimum-tpu/pull/50
* fix(tests): fix decode sample expected outputs again by tengomucho in https://github.com/huggingface/optimum-tpu/pull/52
* fix(doc): update server and port when serving TGI by tengomucho in https://github.com/huggingface/optimum-tpu/pull/53
* fix(ci): correct secrets leak workflow check by tengomucho in https://github.com/huggingface/optimum-tpu/pull/55
* Add Mistral support 💨 by tengomucho in https://github.com/huggingface/optimum-tpu/pull/54
* Mistral nits by tengomucho in https://github.com/huggingface/optimum-tpu/pull/57
* chore: bump to version v0.1.0a1 by tengomucho in https://github.com/huggingface/optimum-tpu/pull/60
* feat(TGI): add release docker image build and push to registry workflow by tengomucho in https://github.com/huggingface/optimum-tpu/pull/62
* chore: bump to version v0.1.1 by tengomucho in https://github.com/huggingface/optimum-tpu/pull/63
New Contributors
* tengomucho made their first contribution in https://github.com/huggingface/optimum-tpu/pull/1
* shub-kris made their first contribution in https://github.com/huggingface/optimum-tpu/pull/3
* regisss made their first contribution in https://github.com/huggingface/optimum-tpu/pull/11
* mfuntowicz made their first contribution in https://github.com/huggingface/optimum-tpu/pull/13
* mikegre-google made their first contribution in https://github.com/huggingface/optimum-tpu/pull/20
* pagezyhf made their first contribution in https://github.com/huggingface/optimum-tpu/pull/40
* furkanakkurt1335 made their first contribution in https://github.com/huggingface/optimum-tpu/pull/42
* thealmightygrant made their first contribution in https://github.com/huggingface/optimum-tpu/pull/46
**Full Changelog**: https://github.com/huggingface/optimum-tpu/commits/v0.1.1