Rentier-scrapy-proxy-rotator

Latest version: v0.6.2

Safety actively analyzes 681775 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 2

0.6

----------------

Proxy information is added to scrapy stats:

* proxies/unchecked
* proxies/reanimated
* proxies/dead
* proxies/good
* proxies/mean_backoff

0.5

----------------

* ``ROTATING_PROXY_LIST_PATH`` option allows to pass file name
with a proxy list.

0.4

----------------

* ``ROTATING_PROXY_BACKOFF_CAP`` option allows to change max backoff time
from the default 1 hour.

0.3.2

------------------

* fixed proxy authentication issue.

0.3.1

------------------

* fixed OverflowError during backoff computation.

0.3

----------------

* redirects with empty bodies are no longer considered bans
(thanks Diga Widyaprana).
* ``ROTATING_PROXY_BAN_POLICY`` option allows to customize ban detection
for all spiders.

Page 1 of 2

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.