Ooniprobe

-------------------------

* Add bouncer support for discovering test helpers and collectors

* Fix bug that lead to HTTP tests to stall

* Add support for connect_error and connection_lost_error error types

* Add support for additional Tor configuration keys

* Add disclaimer when running ooniprobe

-------------------------

Improvements to HTML/JS based user interface:

* XSRF protection

* user supplied input specification

Bugfixing and improvements to scheduler.

-------------------------

Implement JS/HTML based user interface.

Supports:

* Starting and stopping of tests

* Monitoring of test progress

--------------------------

* Parametrize task timeout and retry count

* Set the default collector via the command line option

* Add option to disable the default collector

* Add continuous integration with travis

--------------------------

ooniprobe:

* Fix bug that made HTTP based tests stall

* Update DNS Test example to not import the DNS Test template If you import the
DNS Test template it will be considered a valid test case and command line
argument parsing will not work as expected. see:
7795 for more details

* Fix major bug in DNS test template that prevented PTR lookups from working
properly I was calling the queryUDP function with the arguments in the wrong
order. Twisted, why you API no consistent?

* Add support for specifying the level of parallelism in tests (aka router
melt mode)

* Do not swallow failures when a test instance fails to run fixes 7714

scripts:

* Add report archival script

Fix bug in TCP connect test that made it not properly log errors

* Refactor failure handling code in nettest Add function that traps all the
supported failure and outputs the failure string representing it.

documentation:

* Add birdseye view of the ooniprobe architecture

* Add details on the current implementation status of ooni*

* Add draft ooniprobe API specification

* Add instructions for supervisord configuration and clean up README.md

------------------------

ooniprobe:

* Set the default ASN to 0

* Make Beautiful soup a soft depedency

* Add support for sending the ASN number of the probe:
the ASN number will get sent when creating a new report

* Add support for obtaining the probes IP address via getinfo address as per
https://trac.torproject.org/projects/tor/ticket/7447

* Fix bug in ooniprobe test decks
https://trac.torproject.org/projects/tor/ticket/7664

oonib:

* Use twisted fdesc when writing to files

* Add support for processing the ASN number of the probe

* Test reports shall follow the specification detailed inside of docs/reports.rst

* Add support for setting the tor binary path in oonib/config.py

scripts:

* Add a very simple example on how to securely parse the ooniprobe reports

documentation:

* Add documentation for the DNSSpoof test

* Add documentation for HTTPHeaderFieldManipulation

* Clean up writing_tests.rst

* Properly use the power of sphinx!

Tests:

* fixup Netalyzr third party plugin