Scribe-data

✨ Features

- An option to remove the `is_base` and `rank` sub keys was added.

♻️ Code Refactoring

- The export filenames for emoji keywords were renamed to reflect their usage in autosuggestions and soon autocompletions as well.

✨ Features

- The number of suggested emojis for words can now be limited.
- The total number of emojis that suggestions can be made for can now be limited.

✨ Features

- Scribe-Data now allows the user to create JSONs of word-emoji key-value pairs ([24](https://github.com/scribe-org/Scribe-Data/issues/24)).

✨ Features

- Scribe-Data can now split Wikidata queries into multiple stages to break up those that were too large to run ([21](https://github.com/scribe-org/Scribe-Data/issues/21)).

✨ Features

- Scribe-Data now has the ability to download Wikipedia dumps of any language ([15](https://github.com/scribe-org/Scribe-Data/issues/15)).
- Functions have been added to parse and clean the above dumps ([15](https://github.com/scribe-org/Scribe-Data/issues/15)).
- Autosuggestions are generated from the cleaned texts by deriving most common words and those words that most commonly follow them ([15](https://github.com/scribe-org/Scribe-Data/issues/15)).
- A query for profane words has been added and integrated into the autosuggest flow to make sure that inappropriate words are not included ([16](https://github.com/scribe-org/Scribe-Data/issues/16)).
- The adjectives column has been removed from Scribe data tables until support is offered.

♻️ Code Refactoring

- The error messages for incorrect args in update_data.py have been updated.

✨ Features

- update_data.py now functions using SPARQLWrapper instead of wikidataintegrator.

🐞 Bug Fixes

- The data update process has been fixed to work for all queries.
- Hard coded strings for Spanish formatting files were fixed.
- The paths of update_data.py were changed to match the new package structure.