Cloudfeaster

Added

* Nothing

Changed

* samples/pypi_spider.py -> samples/pythonwheels_spider.py
* spider metadata property name change = max_concurrency -> max_concurrent_crawls

Removed

* Nothing

Added

* Nothing

Changed

* Selenium 3.8.1 -> 3.9.0

Removed

* Nothing

Added

* Nothing

Changed

* [ChromeDriver](https://sites.google.com/a/chromium.org/chromedriver) 2.34 -> 2.35

Removed

* Nothing

Added

* max concurrency per spider property is now part of
the output from Spider.get_validated_metadata() regardless
of whether or not it is specified as part of the explicit spider
metadata declaration
* added paranoia_level to spider metadata
* added max_crawl_time_in_seconds to spider metadata
* ttl_in_seconds now has an upper bound of 86,400 (1 day in seconds)
* max_concurrency now has an upper bound of 25

Changed

* Selenium 3.7.0 -> 3.8.1
* [ChromeDriver](https://sites.google.com/a/chromium.org/chromedriver) 2.33 -> 2.34
* *breaking change* ttl -> ttl_in_seconds in spider metadata

Removed

* Nothing

Added

* added .prep-for-release-master-branch-changes.sh so package version number
is automatically bumped when cutting a relase
* .prep-for-release-master-branch-changes.sh now generates Python packages
for [PyPI](https://pypi.python.org/pypi) from release branch

Changed

* bug fix in .prep-for-release-release-branch-changes.sh to links in main README.md
work correctly after a release

Removed

* removed cloudfeaster.util module since it wasn't used

Added

* added --log command line option to spiders.py
* added --samples command line option to spiders.py
* cloudfeaster.webdriver_spider.WebElement now has
a is_element_present() method that functions just
like cloudfeaster.webdriver_spider.Browser

Changed

* per [this article](https://developers.google.com/web/updates/2017/04/headless-chrome)
[headless Chrome](https://chromium.googlesource.com/chromium/src/+/lkgr/headless/README.md)
is now available and Cloudfeaster will use it by default which means we're also
able to remove the need to [Xvfb](https://en.wikipedia.org/wiki/Xvfb) which is a really
nice simplification and reduction in required crawling resources - also, because we're
removing [Xvfb](https://en.wikipedia.org/wiki/Xvfb) bin/spiderhost.sh was also removed
* selenium 3.3.3 -> 3.7.0
* requests 2.13.0 -> >=2.18.2
* ndg-httpsclient 0.4.2 -> 0.4.3
* [ChromeDriver](https://sites.google.com/a/chromium.org/chromedriver) 2.29 -> 2.33
* [simonsdave/cloudfeaster](https://hub.docker.com/r/simonsdave/cloudfeaster/) docker image
now uses the latest version of pip

Removed

* removed all code related to Signal FX