Argilla

[0.11.1](https://github.com/recognai/rubrix/compare/v0.11.0...v0.11.1) (2022-03-11)


Bug Fixes

* **1238:** show prediction labels when annotating rule ([1239](https://github.com/recognai/rubrix/issues/1239)) ([28e97c6](https://github.com/recognai/rubrix/commit/28e97c6f0599c0487b2c03ee8334fea430d572df)), closes [#1238](https://github.com/recognai/rubrix/issues/1238)

[0.11.0](https://github.com/recognai/rubrix/compare/v0.10.0...v0.11.0) (2022-02-19)

Highlights

Introducing `rb.Dataset*` and 🤗 Hub integration

The Dataset classes are lightweight containers for Rubrix records. These classes facilitate importing from and exporting to different formats (e.g., `pandas.DataFrame`, `datasets.Dataset`) as well as sharing and versioning Rubrix datasets using the Hugging Face Hub.

With this release, Rubrix users and teams can use the Hugging Face Hub to share and read both public and private Rubrix datasets for TextClassification, TokenClassification, and Text2Text datasets. This opens up a whole new world of possibilities for data reproducibility and sharing. Let's see an example:

python
import rubrix as rb
from datasets import load_datasets

👧🏻 🏷️ Leire has labeled a text classification dataset using a local Rubrix instance
dataset_rb = rb.load("text_classification_ds", as_pandas=False)

👧🏻 exports a Rubrix Dataset to a hf Dataset
dataset_ds = dataset_rb.to_datasets()

👧🏻 🚀 Leire shares the labelled dataset with the world
dataset_ds.push_to_hub("text_classification_ds")

👨 John downloads the dataset from the Hugging Face Hub
dataset_ds = load_dataset("leire/text_classification_ds", split="train")

👨 reads in dataset
dataset_rb = rb.read_datasets(dataset_ds, task="TextClassification")

👨 🏷️ logs the dataset and continues labeling with his own Rubrix instance
rb.log(dataset_rb, "john_text_classification_ds")


You can read more at https://rubrix.readthedocs.io/en/stable/guides/datasets.html

For each record type, there’s a corresponding Dataset class called `DatasetFor<RecordType>`. You can look up their API in the [reference section](https://rubrix.readthedocs.io/en/stable/reference/python/python_client.html#module-rubrix.client.datasets).

Improving NER UI and UX
The UI for Token Classification has been completely redesigned to provide a better user experience for exploration and annotation. This is the first of a set of changes focusing on annotation productivity for token classification.

<img width="1564" alt="Screenshot 2022-02-21 at 12 39 22" src="https://user-images.githubusercontent.com/1107111/154948266-e458f604-1a8b-4e18-8f70-48f5f1c6b7b4.png">


Features

* **1051:** keep predictions labels when annotating ([1077](https://github.com/recognai/rubrix/issues/1077)) ([f1824ba](https://github.com/recognai/rubrix/commit/f1824ba2c759d6eb310de10c3791dde740e68118)), closes [#1051](https://github.com/recognai/rubrix/issues/1051)
* **1063:** Token Classifier fine tuning content selection ([1084](https://github.com/recognai/rubrix/issues/1084)) ([9e14d05](https://github.com/recognai/rubrix/commit/9e14d0566f033e1e12fba4f1f2fc1d194ee108f8)), closes [#1063](https://github.com/recognai/rubrix/issues/1063)
* **1127:** raise startup app error from es connection error ([1145](https://github.com/recognai/rubrix/issues/1145)) ([7e7e9d8](https://github.com/recognai/rubrix/commit/7e7e9d83ec73708d0f6bf13efd2933e0fb7ecdf7)), closes [#1127](https://github.com/recognai/rubrix/issues/1127)
* **422:** introducing the rb.Dataset* classes ([1109](https://github.com/recognai/rubrix/issues/1109)) ([b5bbca6](https://github.com/recognai/rubrix/commit/b5bbca62f9d8a833088c009ff1539d2843b30859)), closes [#422](https://github.com/recognai/rubrix/issues/422)
* **821:** token classifier show predictions in explore view ([1009](https://github.com/recognai/rubrix/issues/1009)) ([6ba6764](https://github.com/recognai/rubrix/commit/6ba6764c8ceef09037f6c76bc01f84f4660e9b36)), closes [#821](https://github.com/recognai/rubrix/issues/821)
* **951:** new *"not covered records by rules"* filter ([991](https://github.com/recognai/rubrix/issues/991)) ([0649f2a](https://github.com/recognai/rubrix/commit/0649f2ab30430e0f2486e2e4fd0f0c2096bd94cc)), closes [#951](https://github.com/recognai/rubrix/issues/951) [#1156](https://github.com/recognai/rubrix/issues/1156)


Bug Fixes

* **1140:** fix/make client models more consistent ([1147](https://github.com/recognai/rubrix/issues/1147)) ([926bb16](https://github.com/recognai/rubrix/commit/926bb1605c14cf4afbe6431f5914303b0cb01328)), closes [#1140](https://github.com/recognai/rubrix/issues/1140)
* **client:** parse unauthorized api error properly ([1164](https://github.com/recognai/rubrix/issues/1164)) ([1a5a08d](https://github.com/recognai/rubrix/commit/1a5a08d8cce98efa6c9d5ea2fc7ccc4b71494684))
* **search:** prevent metrics computation breaks searches ([1175](https://github.com/recognai/rubrix/issues/1175)) ([9f2adc9](https://github.com/recognai/rubrix/commit/9f2adc97d9958798be52cce5c2dd3e6af264a221))

[0.10.0](https://github.com/recognai/rubrix/compare/v0.9.0...v0.10.0) (2022-02-12)

Now you can use filters in the Define Rules mode (weak labeling). These filters are useful for seeing the impact of rules on specific dataset subpopulations/subsets (e.g., with certain metadata fields, annotated records, etc.):

<img width="1680" alt="Screenshot 2022-02-14 at 11 56 27" src="https://user-images.githubusercontent.com/1107111/153851489-1da12d0e-41fb-4656-bc23-c80e7030292a.png">

Features

* **1061:** unify records results title ([1111](https://github.com/recognai/rubrix/issues/1111)) ([54ebb15](https://github.com/recognai/rubrix/commit/54ebb1587b526551fb4ef7150ba61ad88dcc4ef5)), closes [#1061](https://github.com/recognai/rubrix/issues/1061)
* **982:** show filters in labelling rules view ([1038](https://github.com/recognai/rubrix/issues/1038)) ([7ff677b](https://github.com/recognai/rubrix/commit/7ff677b7dee03a66a2c7f32f325a04fc7ffba62e)), closes [#982](https://github.com/recognai/rubrix/issues/982)


Bug Fixes

* **1054:** reduce collapsable area. Optimize for annotation ([1106](https://github.com/recognai/rubrix/issues/1106)) ([48024ba](https://github.com/recognai/rubrix/commit/48024ba639481d9fa7006635768fac4635137fc3)), closes [#1054](https://github.com/recognai/rubrix/issues/1054)
* **1054:** remove old scroll padlock button ([a1d6444](https://github.com/recognai/rubrix/commit/a1d6444f30dc3c2c3f65aa4b28139d94fe71bc97)), closes [#1054](https://github.com/recognai/rubrix/issues/1054)
* **1094:** remove computed record fields returned in API results ([1095](https://github.com/recognai/rubrix/issues/1095)) ([cd61d1e](https://github.com/recognai/rubrix/commit/cd61d1eb2d96d85e16e349e7ce4075d050c9db1b)), closes [#1094](https://github.com/recognai/rubrix/issues/1094)
* **831:** Remove sort field when only one is applied ([1116](https://github.com/recognai/rubrix/issues/1116)) ([36b276b](https://github.com/recognai/rubrix/commit/36b276bab7d7d27fc3290e0aa64fad9f1b362e46)), closes [#831](https://github.com/recognai/rubrix/issues/831)
* convert pd.NaT to `None` for `event_timestamp` ([1105](https://github.com/recognai/rubrix/issues/1105)) ([21e78e4](https://github.com/recognai/rubrix/commit/21e78e4efe9aceda1411b6fe2a7d4ca2fbfd1713))

🎉 [0.9.0](https://github.com/recognai/rubrix/compare/v0.8.2...v0.9.0) (2022-02-02)

- Improve logging
- Small improvements to the labelling module and weak labeling mode
- Better setup documentation (`python -m rubrix`)


Features

* **932:** label models now modify the prediction_agent when calling LabelModel.predict ([1049](https://github.com/recognai/rubrix/issues/1049)) ([4a024ee](https://github.com/recognai/rubrix/commit/4a024ee949d3cf3735f08e0a5f99aaf359282e7d)), closes [#932](https://github.com/recognai/rubrix/issues/932)
* **953:** add additional metrics to `LabelModel.score` method ([979](https://github.com/recognai/rubrix/issues/979)) ([2887907](https://github.com/recognai/rubrix/commit/2887907e9bd94de67cdde7da991ff692c2653b4a)), closes [#953](https://github.com/recognai/rubrix/issues/953)
* **955:** add default for `rules` in WeakLabels ([976](https://github.com/recognai/rubrix/issues/976)) ([34389d3](https://github.com/recognai/rubrix/commit/34389d3f42823540a75779cb48b6767555fd7955)), closes [#955](https://github.com/recognai/rubrix/issues/955) [#1011](https://github.com/recognai/rubrix/issues/1011)


Bug Fixes

* **1045:** calculate overall precision from overall correct/incorrect in rules ([1086](https://github.com/recognai/rubrix/issues/1086)) ([1c76d81](https://github.com/recognai/rubrix/commit/1c76d811b994d6c57b773b080b2b1f5b64ef8450)), closes [#1045](https://github.com/recognai/rubrix/issues/1045) [#1087](https://github.com/recognai/rubrix/issues/1087)
* **1053:** metadata modal position ([1068](https://github.com/recognai/rubrix/issues/1068)) ([09b88cc](https://github.com/recognai/rubrix/commit/09b88ccc8445cd4e5be477c406d948a60da083a0)), closes [#1053](https://github.com/recognai/rubrix/issues/1053) [#1053](https://github.com/recognai/rubrix/issues/1053)
* **1054:** optimize Long records ([1080](https://github.com/recognai/rubrix/issues/1080)) ([fdd797a](https://github.com/recognai/rubrix/commit/fdd797acc8b0d39e881ff4f890885ae1f81bf659)), closes [#1054](https://github.com/recognai/rubrix/issues/1054)
* **1067:** fix rule definition link when no labels are defined ([1069](https://github.com/recognai/rubrix/issues/1069)) ([eb958bf](https://github.com/recognai/rubrix/commit/eb958bf04f683f251aa81ab7e00271fa0294a71d)), closes [#1067](https://github.com/recognai/rubrix/issues/1067)
* **1081:** prevent add records of different task ([1085](https://github.com/recognai/rubrix/issues/1085)) ([5296e52](https://github.com/recognai/rubrix/commit/5296e52bc9a4f17d82a671448f050888b4af37a6)), closes [#1081](https://github.com/recognai/rubrix/issues/1081) [#1081](https://github.com/recognai/rubrix/issues/1081)
* **924:** parse new error format in UI ([1082](https://github.com/recognai/rubrix/issues/1082)) ([f26c79c](https://github.com/recognai/rubrix/commit/f26c79c07bbd9d47a4c4b682b6f6b91acb5aa109)), closes [#924](https://github.com/recognai/rubrix/issues/924)

[0.8.2](https://github.com/recognai/rubrix/compare/v0.8.1...v0.8.2) (2022-01-31)


Features

* **1036:** remove prediction ok/ko in labelling rules ([1037](https://github.com/recognai/rubrix/issues/1037)) ([672b852](https://github.com/recognai/rubrix/commit/672b852871b36b0f0e69459b603b8b5d15e24158)), closes [#1036](https://github.com/recognai/rubrix/issues/1036)
* **735:** add warning when agent but no prediction/annotation is provided ([987](https://github.com/recognai/rubrix/issues/987)) ([ba88c34](https://github.com/recognai/rubrix/commit/ba88c345c210e72b6e411204a737257a9146b6e6)), closes [#735](https://github.com/recognai/rubrix/issues/735)


Bug Fixes

* **1008:** set the event_timestamp when annotating ([1024](https://github.com/recognai/rubrix/issues/1024)) ([c24fdad](https://github.com/recognai/rubrix/commit/c24fdadb6d5be9a60b552c313ecf79f1086afbec)), closes [#1008](https://github.com/recognai/rubrix/issues/1008)
* **1015:** manage emojis in Token Classification records ([1016](https://github.com/recognai/rubrix/issues/1016)) ([8b570fb](https://github.com/recognai/rubrix/commit/8b570fbb514e2d823a9b8efb839f80d69d93ecac)), closes [#1015](https://github.com/recognai/rubrix/issues/1015)
* **1023:** handle elasticsearch connection problems on server startup ([1030](https://github.com/recognai/rubrix/issues/1030)) ([e8c8d86](https://github.com/recognai/rubrix/commit/e8c8d8627e8c40a334965a8458ca1ca268c93e49)), closes [#1023](https://github.com/recognai/rubrix/issues/1023)
* **1027:** Improve client models by reordering fields + forbidding extra args ([1032](https://github.com/recognai/rubrix/issues/1032)) ([6c1ae7f](https://github.com/recognai/rubrix/commit/6c1ae7fd99e76305391ef50f448bf389597be403)), closes [#1027](https://github.com/recognai/rubrix/issues/1027)
* **1028:** Add videos to Monitoring tutorial ([1033](https://github.com/recognai/rubrix/issues/1033)) ([6ff3326](https://github.com/recognai/rubrix/commit/6ff33264bb177f22a5ad823c617497c40cdf4e2a)), closes [#1028](https://github.com/recognai/rubrix/issues/1028)
* **1050:** generalizes entity span validation ([1055](https://github.com/recognai/rubrix/issues/1055)) ([37207bc](https://github.com/recognai/rubrix/commit/37207bc5ae3c148369c6d34b297ef92744a7ef14)), closes [#1050](https://github.com/recognai/rubrix/issues/1050)
* **1058:** sort by % data in rules list ([1062](https://github.com/recognai/rubrix/issues/1062)) ([9735f22](https://github.com/recognai/rubrix/commit/9735f228d9a44e5795d00116c7e27ff4a352f788)), closes [#1058](https://github.com/recognai/rubrix/issues/1058)
* **1065:** 'B' tag for beginning tokens ([1066](https://github.com/recognai/rubrix/issues/1066)) ([a5ed329](https://github.com/recognai/rubrix/commit/a5ed3294472d5585e7272a470ba1a1c6101e0ef5)), closes [#1065](https://github.com/recognai/rubrix/issues/1065)
* **cleanlab:** set cleanlab n_jobs=1 as default ([1059](https://github.com/recognai/rubrix/issues/1059)) ([189cbcb](https://github.com/recognai/rubrix/commit/189cbcb792861e6b18632b38af3427abd322f730))

[0.8.1](https://github.com/recognai/rubrix/compare/v0.8.0...v0.8.1) (2022-01-20)

Bug Fixes

* **1002:** Show 0 records overall metrics when no rules defined ([1013](https://github.com/recognai/rubrix/issues/1013)) ([a8a5c79](https://github.com/recognai/rubrix/commit/a8a5c795c33d98233460ea6ffc3751e9b7a37611)), closes [#1002](https://github.com/recognai/rubrix/issues/1002) [#1002](https://github.com/recognai/rubrix/issues/1002)
* **Breadcrumbs:** copy workspace from the breadcrumbs when dataset loading has errors [1003](https://github.com/recognai/rubrix/issues/1003) ([33e372d](https://github.com/recognai/rubrix/commit/33e372d2e356b107b5feea7a6cd3a2e62c9ecb46)), closes [#844](https://github.com/recognai/rubrix/issues/844)
* **statics:** handle 404 errors for static files ([1006](https://github.com/recognai/rubrix/issues/1006)) ([f4b656a](https://github.com/recognai/rubrix/commit/f4b656ab3894ccd44644ddcd493b86c2847d08b7))
* **800:** compute common aggregations one by one ([990](https://github.com/recognai/rubrix/issues/990)) ([8cf420a](https://github.com/recognai/rubrix/commit/8cf420abfc05c77afca09b5d3d191d937a309ca1)), closes [#800](https://github.com/recognai/rubrix/issues/800)
* **800:** limit number of metadata fields ([993](https://github.com/recognai/rubrix/issues/993)) ([bb6b76b](https://github.com/recognai/rubrix/commit/bb6b76b93acf86bfde114ef181961b9eb37f33a5)), closes [#800](https://github.com/recognai/rubrix/issues/800)
* **905:** copy dataset with rules ([948](https://github.com/recognai/rubrix/issues/948)) ([8597b83](https://github.com/recognai/rubrix/commit/8597b8322a0e3ce90eadcf70ac9e10348a1a11e3)), closes [#905](https://github.com/recognai/rubrix/issues/905)
* **974:** display the dropdown in the last record of the scroll ([986](https://github.com/recognai/rubrix/issues/986)) ([e5f8d53](https://github.com/recognai/rubrix/commit/e5f8d533ec6eb7cf67d65f78487b750dee603981)), closes [#974](https://github.com/recognai/rubrix/issues/974)
* **977:** Remove redirection when accessing login ([996](https://github.com/recognai/rubrix/issues/996)) ([b3fe2cb](https://github.com/recognai/rubrix/commit/b3fe2cbf1395da434aa21390e2cf2e4fbfdf558e)), closes [#977](https://github.com/recognai/rubrix/issues/977)