Argilla

[0.8.1-alpha.2](https://github.com/recognai/rubrix/compare/v0.8.1-alpha.1...v0.8.1-alpha.2) (2022-01-20)


Bug Fixes

* **1002:** Show 0 records overall metrics when no rules defined ([1007](https://github.com/recognai/rubrix/issues/1007)) ([a890e17](https://github.com/recognai/rubrix/commit/a890e17ab97be2eab0f13081f852791b1e979c90)), closes [#1002](https://github.com/recognai/rubrix/issues/1002) [#1002](https://github.com/recognai/rubrix/issues/1002)
* **Breadcrumbs:** copy workspace from the breadcrumbs when dataset loading has errors [1003](https://github.com/recognai/rubrix/issues/1003) ([33e372d](https://github.com/recognai/rubrix/commit/33e372d2e356b107b5feea7a6cd3a2e62c9ecb46)), closes [#844](https://github.com/recognai/rubrix/issues/844)
* **statics:** handle 404 errors for static files ([1006](https://github.com/recognai/rubrix/issues/1006)) ([f4b656a](https://github.com/recognai/rubrix/commit/f4b656ab3894ccd44644ddcd493b86c2847d08b7))

[0.8.1-alpha.0](https://github.com/recognai/rubrix/compare/v0.8.0...v0.8.1-alpha.0) (2022-01-19)


Bug Fixes

* **800:** compute common aggregations one by one ([990](https://github.com/recognai/rubrix/issues/990)) ([8cf420a](https://github.com/recognai/rubrix/commit/8cf420abfc05c77afca09b5d3d191d937a309ca1)), closes [#800](https://github.com/recognai/rubrix/issues/800)
* **800:** limit number of metadata fields ([993](https://github.com/recognai/rubrix/issues/993)) ([bb6b76b](https://github.com/recognai/rubrix/commit/bb6b76b93acf86bfde114ef181961b9eb37f33a5)), closes [#800](https://github.com/recognai/rubrix/issues/800)
* **905:** copy dataset with rules ([948](https://github.com/recognai/rubrix/issues/948)) ([8597b83](https://github.com/recognai/rubrix/commit/8597b8322a0e3ce90eadcf70ac9e10348a1a11e3)), closes [#905](https://github.com/recognai/rubrix/issues/905)
* **974:** display the dropdown in the last record of the scroll ([986](https://github.com/recognai/rubrix/issues/986)) ([e5f8d53](https://github.com/recognai/rubrix/commit/e5f8d533ec6eb7cf67d65f78487b750dee603981)), closes [#974](https://github.com/recognai/rubrix/issues/974)
* **977:** Remove redirection when accessing login ([996](https://github.com/recognai/rubrix/issues/996)) ([b3fe2cb](https://github.com/recognai/rubrix/commit/b3fe2cbf1395da434aa21390e2cf2e4fbfdf558e)), closes [#977](https://github.com/recognai/rubrix/issues/977)

Introducing interactive Weak labeling (Define rules mode) 🚀

We are glad to introduce the most important feature to date: now it's possible to iterate on labeling queries directly in the UI with initial support for multi-class text classification. Multilabel and token classification support is coming soon.

See the video for the recommended workflow:


https://user-images.githubusercontent.com/1107111/149346471-93cbd7ee-96a2-451a-8f5e-f9e26b246407.mp4


Check the updated tutorial: https://rubrix.readthedocs.io/en/master/tutorials/weak-supervision-with-rubrix.html

What's changed
- [WeakSupervision] Change load_rules import path in guide and tutorial (939)
- fix links to new web app reference (936)
- Bugfixes/avoid infinite loop when dataset loading (934)
- show nan instead of 0 for precision in summary (930)
- fix(api): include_metrics param only for search endponts (929)
- [Documentation] Update title page video for docs (928)
- update skweak tutorial (922)
- [Documentation] Updating the web app docu (827)
- publish python package to test.pypi for master and releases branches (927)
- [WeakLabels] Align WeakLabels.summary() with web app (925)
- UI: show rules without precision properly (919)
- chore(build): build docker images for release branches (921)
- Docs: Updates readme front video (923)
- Docs: Updates weak supervision resources (920)
- feat(rules): compute total & ann. coverage before label selection (916)
- fix(rules): compute annotated coverage when no label properly (915)
- Tutorial: Human-in-the-loop weak supervision with skweak (869)
- UI: include affected records to overall coverage/ann. coverage metrics (914)
- fix lint build (913)
- UI: manage precision and rules without annotation coverage (909)
- fix(876): process 400 response detail properly (889)
- feat(rules): allow compute partial query rule metrics (907)
- fix(security): providing default workspace should pass check (911)
- UI: reset filters from define rules view (908)
- UI: Show number of created rules in rules management view (910)
- UI: drop access to rule name field (904)
- fix(rules): prevent lost rules with dataset updates (892)
- fix(datasets): process owner as part of dataset id (870)
- (UI) Rules summary metrics format (888)
- UI: Improve code snippet for empty workspace (886)
- fix(UI): Remove case sensitive when filtering labels (882)
- Docs: Updates Flair zeroshot tutorial (887)
- removing wrong video (885)
- Update readme (883)
- fix(UI) Metrics value by default if no metric (875)
- feat(metrics): add token level metrics for token classification from client (849)
- UI: New rule metrics layout (861)
- chore: expose load_rules from base module (866)
- Docs: Regenerates graphs metrics guide (865)
- updating loss video (864)
- Docs: Update weak supervision guide (863)
- Update README.md (862)
- Fix: Link loss tutorial (859)
- Docs: Improve loss tutorial (858)
- Docs: Improve AL and ws tutorials (857)
- chore(ci): Include component testing configuration (839)
- fix/loss video updated (853)
- Docs: Weak supervision guide update (855)
- chore(app): upgrade lint dependencies (841)
- feat: weak supervision mode (814)
- Docs: Review hf tutorial (852)
- fix: error link to workspace home (845)
- fix(metrics): compute token length for each token (850)
- add streaming (851)
- fix(rules): prevent division by 0 for overall metrics (848)
- small change
- [Tutorials] Update media structure, remove TLDR heading (847)
- Updating videos and images for sentiment classification tutorial (846)
- fix(rules): prevent division by zero (843)
- new folder and videos for model loss tutorial (805)
- feat(token class): add metrics at token level (838)
- new folder and images for active learning tutorial (796)
- [Tutorials] Typo fix in find label errors tutorial (842)
- [Tutorials] Add the new find_label_errors tutorial (833)
- [Rule] Modify the client API to the server's weak supervision feature (840)
- [LabelModel] Improve Snorkel to not modify the passed in WeakLabels object (836)
- feat (search): allow to filtering record metrics fields in search (837)
- fix(ui): remove workspace home from code snippet api url (834)
- ui: Hide validate button for binary cases in Text classifier (830)
- fix print message (829)
- feat: Include workspace in url path (820)
- fix(ui): align records and global action layouts 825
- fix(ui): Show labels as selected after validate (826)
- feat(labeling rule): implements api endpoint to fetch a single rule (817)
- [LabelErrors] Add find_label_errors method (775)
- fix(ui): Fix styles in Safari (815)
- docs: Add contributors to readme (822)
- add missing rubrix import (819)
- new folder and images for spacy tutorial (794)
- feat(labeling rules): allow edition for rule label and description (813)
- refactor(labeling rules): optional label for rule metrics (811)
- Fix token alignment on CreationTokenClassificationRecord (812)
- feat(server): add overall dataset labeling rules metrics (807)
- feat(labeling rules): add coverage for annotated records (806)
- fix(ui): Unique ID for scroll state to avoid same state for different dataset records (809)
- new folder and images for zeroshot ner tutorial (804)
- new folder and images for zeroshot data annotation tutorial (803)
- fix(log): check multi-label integrity without search aggregations (802)
- updated images, added folder for fastapi tutorial (801)
- added folder for weak supervision tutorial (795)
- feat(weak supervision): client labeling rules from server (799)
- feat(server): labeling rule metrics (790)
- fix/edit zero-shot tutorial (774)
- fix/edited fastapi tutorial (773)
- Fix/edit ner flair tutorial (766)
- Fix/edit weaksupervision tutorial (759)
- fix(ui): Little changes in fonts (793)
- fix(ui): Allow open dataset in new tab from datasets list (792)
- feat(server): rubrix namespaces for elasticsearch indices (789)
- fix(ui): Show annotation after global validation (786)
- remove reload arg launching server using python (787)
- updated readme with `conda` install instruction (788)
- fix(ui): Hide scroller component when loading or paginate (784)
- fix(ui): allow remove metadata filter from record metadata modal (772)
- fix(ui): Token Classifier: validate record without annotation or prediction (782)
- Fix/edit active learning tutorial (760)
- Docs:minor changes to loss tutorial (778)
- Fix/edit model loss tutorial (767)
- fix(server): missing deprecated dep (777)
- fix(ui): Global validate for records without annotation or prediction (746)
- Fix/edit spacy tutorial (758)
- Fix/edit labeling tutorial (750)
- fix(server) - misaligned entity mentions on CreationTokenClassificationRecord (771)
- [Requirements] Require python>=3.7 (770)
- [Labeling] Add FlyingSquid label model (755)
- Update README.md (769)
- Adds Flair example to guide (762)
- docs: Updates huggingface examples and adds monitor for Flair (761)
- feat(search): show boolean values in metadata (753)
- feat(server): allow handle labeling rules for datasets from API (744)
- fix(imports): import monitoring with spacy<3.0 fails (754)
- [UI] new fonts families (751)
- fix(scroll): using new scroll component (710)
- fix(ui): filter "validatable" records for global action validate button (741)
- feat(monitor): flair ner auto-monitor (738)

New Contributors
* sugatoray made their first contribution
* ruanchaves made their first contribution

- Bugfixes/avoid infinite loop when dataset loading (934)
- show nan instead of 0 for precision in summary (930)
- fix(api): include_metrics param only for search endponts (929)
- [Documentation] Update title page video for docs (928)
- update skweak tutorial (922)
- [Documentation] Updating the web app docu (827)
- revert test.pypi publish
- publish python package to test.pypi for master and releases branches (927)
- [WeakLabels] Align WeakLabels.summary() with web app (925)
- UI: show rules without precision properly (919)
- chore(build): build docker images for release branches (921)
- Docs: Updates readme front video (923)
- Docs: Updates weak supervision resources (920)
- feat(rules): compute total & ann. coverage before label selection (916)
- fix(rules): compute annotated coverage when no label properly (915)
- Tutorial: Human-in-the-loop weak supervision with skweak (869)
- UI: include affected records to overall coverage/ann. coverage metrics (914)
- fix lint build (913)
- UI: manage precision and rules without annotation coverage (909)
- fix(876): process 400 response detail properly (889)
- feat(rules): allow compute partial query rule metrics (907)
- fix(security): providing default workspace should pass check (911)
- UI: reset filters from define rules view (908)
- UI: Show number of created rules in rules management view (910)
- UI: drop access to rule name field (904)
- fix(rules): prevent lost rules with dataset updates (892)
- fix(datasets): process owner as part of dataset id (870)
- (UI) Rules summary metrics format (888)
- UI: Improve code snippet for empty workspace (886)
- fix(UI): Remove case sensitive when filtering labels (882)
- Docs: Updates Flair zeroshot tutorial (887)
- removing wrong video (885)
- Update readme (883)
- fix(UI) Metrics value by default if no metric (875)
- feat(metrics): add token level metrics for token classification from client (849)
- UI: New rule metrics layout (861)
- chore: expose load_rules from base module (866)
- Docs: Regenerates graphs metrics guide (865)
- updating loss video (864)
- Docs: Update weak supervision guide (863)
- Update README.md (862)
- Fix: Link loss tutorial (859)
- Docs: Improve loss tutorial (858)
- Docs: Improve AL and ws tutorials (857)
- chore(ci): Include component testing configuration (839)
- fix/loss video updated (853)
- Docs: Weak supervision guide update (855)
- chore(app): upgrade lint dependencies (841)
- feat: weak supervision mode (814)
- Docs: Review hf tutorial (852)
- fix: error link to workspace home (845)
- fix(metrics): compute token length for each token (850)
- chore: improve dockerignore files
- add streaming (851)
- fix(rules): prevent division by 0 for overall metrics (848)
- small change
- [Tutorials] Update media structure, remove TLDR heading (847)
- Updating videos and images for sentiment classification tutorial (846)
- fix(rules): prevent division by zero (843)
- new folder and videos for model loss tutorial (805)
- feat(token class): add metrics at token level (838)
- new folder and images for active learning tutorial (796)
- [Tutorials] Typo fix in find label errors tutorial (842)
- [Tutorials] Add the new find_label_errors tutorial (833)
- [Rule] Modify the client API to the server's weak supervision feature (840)
- [LabelModel] Improve Snorkel to not modify the passed in WeakLabels object (836)
- feat (search): allow to filtering record metrics fields in search (837)
- fix(ui): remove workspace home from code snippet api url (834)
- ui: Hide validate button for binary cases in Text classifier (830)
- fix print message (829)
- feat: Include workspace in url path (820)
- fix(ui): align records and global action layouts 825
- fix(ui): Show labels as selected after validate (826)
- feat(labeling rule): implements api endpoint to fetch a single rule (817)
- [LabelErrors] Add find_label_errors method (775)
- fix(ui): Fix styles in Safari (815)
- docs: Add contributors to readme (822)
- add missing rubrix import (819)
- new folder and images for spacy tutorial (794)
- feat(labeling rules): allow edition for rule label and description (813)
- refactor(labeling rules): optional label for rule metrics (811)
- Fix token alignment on CreationTokenClassificationRecord (812)
- feat(server): add overall dataset labeling rules metrics (807)
- feat(labeling rules): add coverage for annotated records (806)
- fix(ui): Unique ID for scroll state to avoid same state for different dataset records (809)
- new folder and images for zeroshot ner tutorial (804)
- new folder and images for zeroshot data annotation tutorial (803)
- fix(log): check multi-label integrity without search aggregations (802)
- updated images, added folder for fastapi tutorial (801)
- added folder for weak supervision tutorial (795)
- feat(weak supervision): client labeling rules from server (799)
- feat(server): labeling rule metrics (790)
- fix/edit zero-shot tutorial (774)
- fix/edited fastapi tutorial (773)
- Fix/edit ner flair tutorial (766)
- Fix/edit weaksupervision tutorial (759)
- fix(ui): Little changes in fonts (793)
- fix(ui): Allow open dataset in new tab from datasets list (792)
- feat(server): rubrix namespaces for elasticsearch indices (789)
- fix(ui): Show annotation after global validation (786)
- remove reload arg launching server using python (787)
- updated readme with `conda` install instruction (788)
- fix(ui): Hide scroller component when loading or paginate (784)
- fix(ui): allow remove metadata filter from record metadata modal (772)
- fix(ui): Token Classifier: validate record without annotation or prediction (782)
- Fix/edit active learning tutorial (760)
- Docs:minor changes to loss tutorial (778)
- Fix/edit model loss tutorial (767)
- fix(server): missing deprecated dep (777)
- fix(ui): Global validate for records without annotation or prediction (746)
- Fix/edit spacy tutorial (758)
- Fix/edit labeling tutorial (750)
- fix(server) - misaligned entity mentions on CreationTokenClassificationRecord (771)
- [Requirements] Require python>=3.7 (770)
- [Labeling] Add FlyingSquid label model (755)
- Update README.md (769)
- Adds Flair example to guide (762)
- docs: Updates huggingface examples and adds monitor for Flair (761)
- feat(search): show boolean values in metadata (753)
- feat(server): allow handle labeling rules for datasets from API (744)
- fix(imports): import monitoring with spacy<3.0 fails (754)
- [UI] new fonts families (751)
- fix(scroll): using new scroll component (710)
- fix(ui): filter "validatable" records for global action validate button (741)
- feat(monitor): flair ner auto-monitor (738)


**Full Changelog**: https://github.com/recognai/rubrix/compare/v0.7.0...v0.8.0-alpha.0