Python-terrier

Minor release with minor improvements and bug fixes.

What's Changed
* add [sbert](https://www.sbert.net/) example notebook by cmacdonald in https://github.com/terrier-org/pyterrier/pull/344
* Update scikit-learn requirement from the deprecated sklearn, which was causing [build errors at some times](https://github.com/scikit-learn/sklearn-pypi-package).
* adding batching operations to `apply.generic()` and `apply.by_query()` by cmacdonald in https://github.com/terrier-org/pyterrier/pull/351 - thanks to Xun Zhou, University of Michigan via #350
* improve error messages for invalid indexing configurations by cmacdonald in https://github.com/terrier-org/pyterrier/pull/349 -- thanks to maxhenze in #348
* Various empty dataframe fixes by cmacdonald in https://github.com/terrier-org/pyterrier/pull/353 -- thanks to report by [Prithvijit Dasgupta](https://github.com/prithvidasgupta), University of Michigan in #352
* improved error message for add_ranks by cmacdonald in https://github.com/terrier-org/pyterrier/pull/354


**Full Changelog**: https://github.com/terrier-org/pyterrier/compare/0.9.1...0.9.2

Bugfix release addressing a problem with pretokenised indices on Windows

What's Changed
* Nofifo pretok indexing fixes by cmacdonald in https://github.com/terrier-org/pyterrier/pull/343

**Full Changelog**: https://github.com/terrier-org/pyterrier/compare/0.9.0...0.9.1

Significant update - refactoring of [public API](https://pyterrier.readthedocs.io/en/latest/transformer.html) (e.g. `pt.transformer.TransformerBase` -> `pt.Transformer`) and support in the Terrier backend for [making indices from pre-tokenised documents](https://pyterrier.readthedocs.io/en/latest/terrier-indexing.html#pretokenised). Python 3.10 is now supported.


What's Changed
* fix error in IRDSDataset when a query field is named "query" by seanmacavaney in https://github.com/terrier-org/pyterrier/pull/303
* Fix type annotation by heinrichreimer in https://github.com/terrier-org/pyterrier/pull/313
* addresses 315 IRDS corpus_iter are not subscriptable by cmacdonald in https://github.com/terrier-org/pyterrier/pull/316
* Missing comma in bm25_qe example by JohnGiorgi in https://github.com/terrier-org/pyterrier/pull/319
* Argument meta should be supplied as dictionary by JohnGiorgi in https://github.com/terrier-org/pyterrier/pull/320
* use Jnius 1.4 by cmacdonald in https://github.com/terrier-org/pyterrier/pull/249
* Python 3.10 support by cmacdonald in https://github.com/terrier-org/pyterrier/pull/322
* Lz4 support for pt.io.autoopen() by cmacdonald in https://github.com/terrier-org/pyterrier/pull/323
* addresses 326 faster version of add_ranks for single queries by cmacdonald in https://github.com/terrier-org/pyterrier/pull/327
* addresses 321 pt.apply.doc_score batching by cmacdonald in https://github.com/terrier-org/pyterrier/pull/325
* IterDictIndexer can index pre-tokenised documents by cmacdonald in https://github.com/terrier-org/pyterrier/pull/328
* Bump logback-core from 1.2.0 to 1.2.9 in /terrier-python-helper by dependabot in https://github.com/terrier-org/pyterrier/pull/336
* documenting BM25F controls and tuning by cmacdonald in https://github.com/terrier-org/pyterrier/pull/296, addresses #294
* 0.9refactor by cmacdonald in https://github.com/terrier-org/pyterrier/pull/314, https://github.com/terrier-org/pyterrier/pull/339, addresses #271
* pt.Experiment() alters the input measures list to drop "mrt" 301
* Expose Termpipelines in Terrier index backend by cmacdonald in https://github.com/terrier-org/pyterrier/pull/338
* pt.rewrite.tokenise() impl by cmacdonald in https://github.com/terrier-org/pyterrier/pull/340 addresses #252 253
* upgraded GitHub actions by cmacdonald in https://github.com/terrier-org/pyterrier/pull/341, https://github.com/terrier-org/pyterrier/pull/342
* fix LTR groupby for xgboost & lightgbm by cmacdonald in https://github.com/terrier-org/pyterrier/pull/284

New Contributors
* heinrichreimer made their first contribution in https://github.com/terrier-org/pyterrier/pull/313
* JohnGiorgi made their first contribution in https://github.com/terrier-org/pyterrier/pull/319

**Full Changelog**: https://github.com/terrier-org/pyterrier/compare/0.8.1...0.9.0

Minor release with minor improvements and bug fixes.

What's Changed
* fixed bug with is_transformer by seanmacavaney in https://github.com/terrier-org/pyterrier/pull/274
* addresses [275 issue k in kmaxavg](https://github.com/terrier-org/pyterrier/issue/275), improved testing by cmacdonald in https://github.com/terrier-org/pyterrier/pull/276
* defer loading ir_datasets by seanmacavaney in https://github.com/terrier-org/pyterrier/pull/280
* Set meta and meta_lengths in constructor by MWschutte in https://github.com/terrier-org/pyterrier/pull/282
* Anserini fixes by cmacdonald in https://github.com/terrier-org/pyterrier/pull/279, reported by Azouu
* prevent use of nptyping v2 by cmacdonald in https://github.com/terrier-org/pyterrier/pull/291, reported by tabonnet
* SourceTransformer pass through extra columns, addresses 287 by cmacdonald in https://github.com/terrier-org/pyterrier/pull/288, reported by Xiao0728
* more transformers with repr by cmacdonald in https://github.com/terrier-org/pyterrier/pull/289

New Contributors
* MWschutte made their first contribution in https://github.com/terrier-org/pyterrier/pull/282

**Full Changelog**: https://github.com/terrier-org/pyterrier/compare/0.8.0...0.8.1

PyTerrier 0.8.0 Release Notes

Released on 18/01/2022

What's Changed - Major

* Require Python 3.7 by cmacdonald in https://github.com/terrier-org/pyterrier/pull/255
* Deprecate automatic coercion of transformers by cmacdonald in https://github.com/terrier-org/pyterrier/pull/258
* introduce `pt.Transformer` as public API; * `pt.transformer.TransformerBase` will be deprecated in 0.9; by cmacdonald in https://github.com/terrier-org/pyterrier/pull/258
* introduce query biased summarisation - addresses 205 by cmacdonald in https://github.com/terrier-org/pyterrier/pull/223, suggested by adambaker
* provide re-ranking runs from datasets by seanmacavaney in https://github.com/terrier-org/pyterrier/pull/262

What's Changed - Minor
* faster testing in Github Actions: focus on requested jnius, rather than changing jnius version 3 times by cmacdonald in https://github.com/terrier-org/pyterrier/pull/256
* Faster tests by cmacdonald in https://github.com/terrier-org/pyterrier/pull/257
* Use Flake to identify bugs, reduce imports etc by cmacdonald in https://github.com/terrier-org/pyterrier/pull/259
* pyterrier loaded message to stderr by seanmacavaney in https://github.com/terrier-org/pyterrier/pull/260
* Fix code block in `ltr.rst` in section `Working with Features` by bart-kosmala in https://github.com/terrier-org/pyterrier/pull/261
* `get_dataset()` for non-existant irds dataset by seanmacavaney in https://github.com/terrier-org/pyterrier/pull/263
* Filter out non-indexed/metadata fields when indexing by seanmacavaney in https://github.com/terrier-org/pyterrier/pull/267, reported by bjoernengelmann in https://github.com/terrier-org/pyterrier/issues/266
* mirroring of Vaswani dataset files by seanmacavaney in https://github.com/terrier-org/pyterrier/pull/268
* `pt.io.read_results()` can merge topics by seanmacavaney in https://github.com/terrier-org/pyterrier/pull/265
* addresses 264, `text.scorer()` will default to `takes='docs'` by cmacdonald in https://github.com/terrier-org/pyterrier/pull/269
* change paths and exercise names by cmacdonald in https://github.com/terrier-org/pyterrier/pull/270

New Contributors
* bart-kosmala made their first contribution in https://github.com/terrier-org/pyterrier/pull/261

**Full Changelog**: https://github.com/terrier-org/pyterrier/compare/0.7.2...0.8.0

Minor release addressing some useful bug fixes and small features. This is the last release that will support Python 3.6.

What's Changed
* using chunked instead of ichunked - this fixes indexing speed/memory-consumption/crashes with indexing pipelines, by seanmacavaney in https://github.com/terrier-org/pyterrier/pull/238
* remove deprecated code by cmacdonald in https://github.com/terrier-org/pyterrier/pull/239
* combsum dropping documents not appearing on both sides of + by cmacdonald in https://github.com/terrier-org/pyterrier/pull/240
* addresses 203, verbose in pt.Experiment by cmacdonald in https://github.com/terrier-org/pyterrier/pull/245
* Py37 minimum warning, addresses 241 by cmacdonald in https://github.com/terrier-org/pyterrier/pull/246
* use caching in GitHub Actions by cmacdonald in https://github.com/terrier-org/pyterrier/pull/248
* save run files automatically in pt.Experiment 163 by cmacdonald in https://github.com/terrier-org/pyterrier/pull/247
* Set dtype for qrels columns at read time in io method by jjdelvalle in https://github.com/terrier-org/pyterrier/pull/254
* support meta config in IterDictIndexer constructor, addresses 250, by cmacdonald in https://github.com/terrier-org/pyterrier/pull/251

New Contributors
* jjdelvalle made their first contribution in https://github.com/terrier-org/pyterrier/pull/254

**Full Changelog**: https://github.com/terrier-org/pyterrier/compare/0.7.1...0.7.2