What's Changed
* AWQ: Separate the AWQ kernels to separate repository by casper-hansen in https://github.com/casper-hansen/AutoAWQ/pull/279
* Add CPU-loaded multi-GPU quantization by xNul in https://github.com/casper-hansen/AutoAWQ/pull/289
* GGUF compatible quantization (2, 3, 4 bit / any bit) by casper-hansen in https://github.com/casper-hansen/AutoAWQ/pull/285
* Exllama kernels support by IlyasMoutawwakil in https://github.com/casper-hansen/AutoAWQ/pull/313
* Cleanup requirements by casper-hansen in https://github.com/casper-hansen/AutoAWQ/pull/295
* Torch only inference + any-device quantization by casper-hansen in https://github.com/casper-hansen/AutoAWQ/pull/319
* Up to 60% faster context processing by casper-hansen in https://github.com/casper-hansen/AutoAWQ/pull/316
* Evaluation: Add more evals by casper-hansen in https://github.com/casper-hansen/AutoAWQ/pull/283
* Fixes a breaking change in autoawq by younesbelkada in https://github.com/casper-hansen/AutoAWQ/pull/325
* AMD ROCM Support by IlyasMoutawwakil in https://github.com/casper-hansen/AutoAWQ/pull/315
* Marlin symmetric quantization and inference by IlyasMoutawwakil in https://github.com/casper-hansen/AutoAWQ/pull/320
* Add qwen2 by JustinLin610 in https://github.com/casper-hansen/AutoAWQ/pull/321
* Fix n_samples by casper-hansen in https://github.com/casper-hansen/AutoAWQ/pull/326
* PEFT compatible GEMM by casper-hansen in https://github.com/casper-hansen/AutoAWQ/pull/324
* [`PEFT`] Fix PEFT batch size > 1 by younesbelkada in https://github.com/casper-hansen/AutoAWQ/pull/338
* v0.2.0 by casper-hansen in https://github.com/casper-hansen/AutoAWQ/pull/330
* Fix ROCm build by casper-hansen in https://github.com/casper-hansen/AutoAWQ/pull/342
* Fix dependency by casper-hansen in https://github.com/casper-hansen/AutoAWQ/pull/343
* Fix importlib by casper-hansen in https://github.com/casper-hansen/AutoAWQ/pull/344
* Fix workflow by casper-hansen in https://github.com/casper-hansen/AutoAWQ/pull/345
* Fix typo in setup.py by casper-hansen in https://github.com/casper-hansen/AutoAWQ/pull/346
New Contributors
* xNul made their first contribution in https://github.com/casper-hansen/AutoAWQ/pull/289
* IlyasMoutawwakil made their first contribution in https://github.com/casper-hansen/AutoAWQ/pull/313
* JustinLin610 made their first contribution in https://github.com/casper-hansen/AutoAWQ/pull/321
**Full Changelog**: https://github.com/casper-hansen/AutoAWQ/compare/v0.1.8...v0.2.0