Wpull

===================

* Fixes crash when a URL is incorrectly formatted by Wpull. (The incorrect formatting is not fixed yet however.)

=================

* Fixes file descriptor leak with ``--phantomjs`` and ``--delete-after``.
* Fixes case where robots.txt file was stuck in download loop if server was offline.
* Fixes loading of cookies file from Wget. Cookie file header checks are disabled.
* Removes unneeded ``--no-strong-robots`` (superseded with ``--no-strong-redirects``.)
* Fixes ``--no-phantomjs-snapshot`` option not respected.
* More link extraction on HTML pages with elements with ``onclick``, ``onkeyX``, ``onmouseX``, and ``data-`` attributes.
* Adds web-based debugging console with ``--debug-console-port``.

===================

* Fixes links not resolved correctly when document includes ``<base href="...">`` element.
* Different proxy URL rewriting for PhantomJS option.

===================

* Fixes ``--bind_address`` option not working. The option was never functional since the first release.
* Fixes AttributeError crash when ``--phantomjs`` and ``--X-script`` options were used. Thanks to yipdw for reporting.
* Fixes ``--warc-tempdir`` to use the current directory by default.
* Fixes bad formatting and crash on links with malformed IPv6 addresses.
* Uses more rules for link extraction from JavaScript to reduce false positives.

===================

* Fixes invalid XHTML documents not properly extracted for links.
* Fixes crash on empty page.
* Support for extracting links from JavaScript segments and files.
* Doesn't discard extracted links if document can only be parsed partially.

* API:

* Moves ``OrderedDefaultDict`` from ``util`` to ``collections``.
* Moves ``DeflateDecompressor``, ``gzip_decompress`` from ``util`` to ``decompression``.
* Moves ``sleep``, ``TimedOut``, ``wait_future``, ``AdjustableSemaphore`` from ``util`` to ``async``.
* Moves ``to_bytes``, ``to_str``, ``normalize_codec_name``, ``detect_encoding``, ``try_decoding``, ``format_size``, ``printable_bytes``, ``coerce_str_to_ascii`` from ``util`` to ``string``.
* Removes ``extended`` module.

* Scripting:

* Adds new `wait_time()` callback hook function.

===================

* Fixes XHTML documents not properly extracted for links.
* If a server responds with content declared as Gzip, the content is checked to see if it starts with the Gzip magic number. This check avoids misreading text as Gzip streams.