v.0.6.0: Text2Text, better UX/UI, Weak supervision and Metrics
🔆 Highlights
Improved UX/UI for Text2Text tasks
Largely improved user experience and UI for text2text tasks.
<img width="1000" alt="Text2text" src="https://user-images.githubusercontent.com/1107111/140344243-11ef69fa-3670-4667-8b11-f9c58bb28c6b.png">
Weak Supervision [Experimental]
Added initial support for leveraging weak supervision for text classification, check this guide to get started: https://rubrix.readthedocs.io/en/stable/guides/weak-supervision.html
<img width="1000" alt="Weak supervision" src="https://user-images.githubusercontent.com/1107111/140341600-c8f3d698-11d6-4107-8e57-ca8f95250aab.png">
Metrics [Experimental]
Introduced Rubrix Metrics, a new feature for fine-grained analysis of token classification models, inspired by recent works on fine-grained model and dataset evaluation like Explainaboard.
Guide: https://rubrix.readthedocs.io/en/stable/guides/metrics.html
API reference: https://rubrix.readthedocs.io/en/stable/reference/python/python_metrics.html
What's Changed
* feat(UI): new text2text UI by leiyre in https://github.com/recognai/rubrix/pull/378
* svg generate-icons template by leiyre in https://github.com/recognai/rubrix/pull/379
* fix(ui): apply text2text review suggestions by leiyre in https://github.com/recognai/rubrix/pull/380
* refactor(UI): show filters options under each filter by leiyre in https://github.com/recognai/rubrix/pull/381
* fix(ui): show metadata filters by frascuchon in https://github.com/recognai/rubrix/pull/382
* fix(UI): better Text2Text edition behaviour by leiyre in https://github.com/recognai/rubrix/pull/383
* feat(UI): format quantities locale dependant by leiyre in https://github.com/recognai/rubrix/pull/384
* chore(UI): change sort arrows styles and search icon position by leiyre in https://github.com/recognai/rubrix/pull/387
* Bugfix: Convert None to "None" for prediction/annotation agents by dcfidalgo in https://github.com/recognai/rubrix/pull/386
* Restructure README by dvsrepo in https://github.com/recognai/rubrix/pull/389
* Feat: score per entity by dcfidalgo in https://github.com/recognai/rubrix/pull/385
* refactor(UI): Better Text2Text annotation experience (EXPERIMENTAL) by leiyre in https://github.com/recognai/rubrix/pull/393
* fix(UI): highlight predicted label using predicted_as info by leiyre in https://github.com/recognai/rubrix/pull/390
* refactor(UI): revise styles for Text2Text task by leiyre in https://github.com/recognai/rubrix/pull/396
* refactor(UI): Text2Text task ui revision by leiyre in https://github.com/recognai/rubrix/pull/400
* fix(UI): apply local format to percentage by leiyre in https://github.com/recognai/rubrix/pull/397
* fix(UI): Text2Text - prevent edition in exploration mode by leiyre in https://github.com/recognai/rubrix/pull/406
* refactor(UI): set pagination as fixed footer by leiyre in https://github.com/recognai/rubrix/pull/405
* feat(UI): new search sticky bar design by leiyre in https://github.com/recognai/rubrix/pull/417
* fix(server): delete dataset with refresh flag enabled by frascuchon in https://github.com/recognai/rubrix/pull/418
* feat(server): detect nested metadata fields by frascuchon in https://github.com/recognai/rubrix/pull/409
* [Docs] Remove first tutorial by dcfidalgo in https://github.com/recognai/rubrix/pull/425
* Add pre-commit hooks by krishnajalan in https://github.com/recognai/rubrix/pull/426
* feat(server): configure dataset metrics by frascuchon in https://github.com/recognai/rubrix/pull/412
* fix(UI): allow records with empty annotations for text classification by leiyre in https://github.com/recognai/rubrix/pull/430
* fix(server): Limit search pagination to 10000 by krishnajalan in https://github.com/recognai/rubrix/pull/435
* feat(UI): keep global state in filters by frascuchon in https://github.com/recognai/rubrix/pull/441
* [UI] experimental tag for Text2Text by leiyre in https://github.com/recognai/rubrix/pull/440
* Introduce custom SDK by dcfidalgo in https://github.com/recognai/rubrix/pull/413
* docs: improve zeroshot ner tutorial by dvsrepo in https://github.com/recognai/rubrix/pull/445
* docs: fix rubrix setup section by dvsrepo in https://github.com/recognai/rubrix/pull/447
* docs: Readme review by dvsrepo in https://github.com/recognai/rubrix/pull/448
* docs: Enhance tutorial fine-tuning by dvsrepo in https://github.com/recognai/rubrix/pull/449
* Fix the doctest format in the examples by dcfidalgo in https://github.com/recognai/rubrix/pull/450
* feat(UI): filters area improvement by leiyre in https://github.com/recognai/rubrix/pull/433
* Adding usage examples to docstrings in record models by issam9 in https://github.com/recognai/rubrix/pull/446
* fix(server): disable metrics calculation for search by frascuchon in https://github.com/recognai/rubrix/pull/460
* Implement TokenClassification part of the custom SDK by dcfidalgo in https://github.com/recognai/rubrix/pull/452
* fix(server): conditional metric results generation by frascuchon in https://github.com/recognai/rubrix/pull/463
* fix(UI): annotation animation for Text Classification by leiyre in https://github.com/recognai/rubrix/pull/438
* fix(UI): Text2Text Review by leiyre in https://github.com/recognai/rubrix/pull/456
* fix(UI): restore vuex action for Global Actions by leiyre in https://github.com/recognai/rubrix/pull/458
* fix(UI): new filters area QA by leiyre in https://github.com/recognai/rubrix/pull/462
* fix(UI): allow entity annotation for NER by frascuchon in https://github.com/recognai/rubrix/pull/464
* fix(UI): validate the model prediction when no annotation by leiyre in https://github.com/recognai/rubrix/pull/465
* Add docs on how to training/inference with flair text/token-classification model by sakares in https://github.com/recognai/rubrix/pull/442
* Allow disabling ES index template creation by environment var by torkashvand in https://github.com/recognai/rubrix/pull/469
* feat(server): generate automatic task dataset metrics endpoints by frascuchon in https://github.com/recognai/rubrix/pull/468
* chore(CI): codecov config only for CI builds by frascuchon in https://github.com/recognai/rubrix/pull/472
* refactor(client): remove old sdk files by frascuchon in https://github.com/recognai/rubrix/pull/470
* [Docs] small tutorial improvements by dcfidalgo in https://github.com/recognai/rubrix/pull/476
* feat(server): allows filtering by user team in API by frascuchon in https://github.com/recognai/rubrix/pull/392
* Fix hyperlink to Stanzs by Danielto1404 in https://github.com/recognai/rubrix/pull/480
* Fix: Enable to create new label in the Text Classification task by leiyre in https://github.com/recognai/rubrix/pull/481
* [UI] Records cards standardization by leiyre in https://github.com/recognai/rubrix/pull/483
* Docs: Add selectra tutorial by dvsrepo in https://github.com/recognai/rubrix/pull/485
* fix(UI): update loca record status before send backend request by frascuchon in https://github.com/recognai/rubrix/pull/487
* Review zero-shot tutorial by dvsrepo in https://github.com/recognai/rubrix/pull/488
* refactor(server):simplify datasets integrations by frascuchon in https://github.com/recognai/rubrix/pull/489
* refactor(UI): new right sidebar by leiyre in https://github.com/recognai/rubrix/pull/490
* fix(server): parameterize task for dataset operations by frascuchon in https://github.com/recognai/rubrix/pull/493
* fix(server): prevent index template recreation for records index by frascuchon in https://github.com/recognai/rubrix/pull/497
* fix:(UI): Implement feedback for new sidebar by leiyre in https://github.com/recognai/rubrix/pull/498
* feat(server): per-tast predefined metrics by frascuchon in https://github.com/recognai/rubrix/pull/491
* fix(server): better default params for token classification metrics by frascuchon in https://github.com/recognai/rubrix/pull/500
* Change dictionary key in RubrixLogHTTPMiddleware from probabilities into scores by iakhil in https://github.com/recognai/rubrix/pull/501
* feat(UI): new search box behaviour by leiyre in https://github.com/recognai/rubrix/pull/505
* feat(UI): allow copy to clipboard dataset names by leiyre in https://github.com/recognai/rubrix/pull/504
* fix(UI): annotate from global actions for text classification should overrides labels by leiyre in https://github.com/recognai/rubrix/pull/507
* Feat: Enhance `rubrix.load` by dcfidalgo in https://github.com/recognai/rubrix/pull/513
* chore(UI): review styles for modals by leiyre in https://github.com/recognai/rubrix/pull/514
* feat(UI): record cards standardization by leiyre in https://github.com/recognai/rubrix/pull/508
* refactor: sentence length -> tokens length metric by frascuchon in https://github.com/recognai/rubrix/pull/515
* [UI] Fix: Remove annotated_as or predicted_as filters in Text2Text by leiyre in https://github.com/recognai/rubrix/pull/517
* fix(UI): enable shortcut pagination only for global body focus by leiyre in https://github.com/recognai/rubrix/pull/518
* fix(ci): 'Pagination' is defined but never used by leiyre in https://github.com/recognai/rubrix/pull/522
* fix(UI): tooltip styles & replace copy-url icon by leiyre in https://github.com/recognai/rubrix/pull/520
* fix(UI): review styles for records cards by leiyre in https://github.com/recognai/rubrix/pull/519
* feat(client): support auto-monitor for spaCy and text-class transformers by frascuchon in https://github.com/recognai/rubrix/pull/506
* feat(UI): reset record status for single text classification by frascuchon in https://github.com/recognai/rubrix/pull/527
* feat(client): using task metrics by frascuchon in https://github.com/recognai/rubrix/pull/516
* Fix: Client to SDK, token classification model by dcfidalgo in https://github.com/recognai/rubrix/pull/524
* refactor: remove query_inputs alias for text-classification by frascuchon in https://github.com/recognai/rubrix/pull/528
* fix(server): validated records for single text-class must include annotations by frascuchon in https://github.com/recognai/rubrix/pull/530
* [UI] Cards Standardization QA 3 by leiyre in https://github.com/recognai/rubrix/pull/536
* fix(UI): Text2Text remove Validate button in edit mode by leiyre in https://github.com/recognai/rubrix/pull/539
* fix(server): include record timestamp to monitors by frascuchon in https://github.com/recognai/rubrix/pull/535
* feat(UI): better API error messages handling by frascuchon in https://github.com/recognai/rubrix/pull/531
* feat(server): remove partial update by frascuchon in https://github.com/recognai/rubrix/pull/533
* Added Automatic Logging using middleware notebook (recognai427) by Aymane11 in https://github.com/recognai/rubrix/pull/532
* feat(UI): remove annotation info completely by frascuchon in https://github.com/recognai/rubrix/pull/540
* fix(UI): review styles for global record cards by leiyre in https://github.com/recognai/rubrix/pull/541
* Feat: weak supervision by dcfidalgo in https://github.com/recognai/rubrix/pull/503
* feat(UI): disable "Validate" with records without prediction & annotation by leiyre in https://github.com/recognai/rubrix/pull/543
* feat: review client metrics by frascuchon in https://github.com/recognai/rubrix/pull/544
* feat(client): add zero-shot classifier monitor by frascuchon in https://github.com/recognai/rubrix/pull/538
* fix(UI): show annotation by default in annotation view for Text2Text by leiyre in https://github.com/recognai/rubrix/pull/547
* feat(UI): hide "Validate" for records without prediction and annotation by leiyre in https://github.com/recognai/rubrix/pull/550
* [UI] Fix: set record height in Text Classifier explore view by leiyre in https://github.com/recognai/rubrix/pull/555
* fix(client): monitor coroutine definition by frascuchon in https://github.com/recognai/rubrix/pull/558
* docs: review http monitoring tutorial by dvsrepo in https://github.com/recognai/rubrix/pull/560
* docs(metrics): add missing dependencies info by frascuchon in https://github.com/recognai/rubrix/pull/559
🥳 New Contributors
* krishnajalan made their first contribution in https://github.com/recognai/rubrix/pull/426
* issam9 made their first contribution in https://github.com/recognai/rubrix/pull/446
* sakares made their first contribution in https://github.com/recognai/rubrix/pull/442
* torkashvand made their first contribution in https://github.com/recognai/rubrix/pull/469
* Danielto1404 made their first contribution in https://github.com/recognai/rubrix/pull/480
* iakhil made their first contribution in https://github.com/recognai/rubrix/pull/501
* Aymane11 made their first contribution in https://github.com/recognai/rubrix/pull/532
**Full Changelog**: https://github.com/recognai/rubrix/compare/v0.5.0...v0.6.0-alpha.1