Concordancecrawler

ConcordanceCrawler now supports python2.7!

Xml output is temporarily disabled. Other functionality didn't change.

New version is also on PyPI:

https://testpypi.python.org/pypi/ConcordanceCrawler

any new functionality added, just support for all versions of python3

This is version 0.1.0.
This version uses simple filtering of concordances (just sentences containing the keyword in one given form) and simple sentence segmentation (every sentence ends with \n, ., ! or ?).

This will be improved in following versions.

Experiment showed that with this version it is possible to crawl 10303 concordances from 2151 links per hour.