Webstruct

----------------

* A complete example (contact extractor) is added to the repo;
* fixed a lot of issues in the annotated data;
* fixed loading of ``<title>`` annotations;
* all annotated data is converted from GATE to WebAnnotator format;
* text tokenizers allow to optionally return original token positions;
* converting text from tokenized to raw is now lossless;
* ``webstruct.webannotator.to_webannotator`` is rewritten;
* ``<script>``, ``<style>`` elements, HTML comments and processing
instructions are ignored when they are inside entities;
* tutorial is rewritten for CRFSuite;
* Wapiti support is fixed in Python 3;
* top-N parsing support when using Wapiti; an option to merge top N chains,
to increase recall;
* benchmarking script;
* don't declare Python 3.3 support (it is EOL).

----------------

* webstruct.model.NER now uses ``requests`` library to make HTTP requests;
* changed default headers used by webstruct.model.NER;
* new ``webstruct.infer_domain`` module useful for proper cross-validation;
* webstruct.webannotator.to_webannotator got an option to add ``<base>``
tag with the original URL to the page;
* fixed a warning in webstruct.gazetteers.geonames.read_geonames;
* add a few more country names to countries.txt list.

------------------

* fixed a bug in NER.extract().

----------------

* sklearn-crfsuite_ is used as a CRFsuite wrapper, CRFsuiteCRF class
is removed;
* comments are preserved in HTML trees because recent Firefox puts
``<base>`` tags to a comment when saving pages, and this affects
WebAnnotator;
* fixed 'dont_penalize' argument of webstruct.NER.extract_groups_from_url;
* new webstruct.model.extract_entity_groups utility function;
* HtmlTokenizer and HtmlToken are moved to their own module
(webstruct.html_tokenizer);
* test improvements;

.. _sklearn-crfsuite: https://github.com/TeamHG-Memex/sklearn-crfsuite

----------------

There are many changes from previous version: API is changed,
Python 3 is supported, better gazetteers support, CRFsuite support, etc.