Scrapy-redis-statictyped

Latest version: v0.7.1

Safety actively analyzes 641872 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 3 of 3

0.6.0

------------------
* Updated code to be compatible with Scrapy 1.0.
* Added `-a domain=...` option for example spiders.

0.5.0

------------------
* Added `REDIS_URL` setting to support Redis connection string.
* Added `SCHEDULER_IDLE_BEFORE_CLOSE` setting to prevent the spider closing too
quickly when the queue is empty. Default value is zero keeping the previous
behavior.
* Schedule preemptively requests on item scraped.
* This version is the latest release compatible with Scrapy 0.24.x.

0.4.0

------------------
* Added `RedisSpider` and `RedisMixin` classes as building blocks for spiders
to be fed through a redis queue.
* Added redis queue stats.
* Let the encoder handle the item as it comes instead converting it to a dict.

0.3.0

------------------
* Added support for different queue classes.
* Changed requests serialization from `marshal` to `cPickle`.

0.2.0

------------------
* Improved backward compatibility.
* Added example project.

0.1.0

------------------
* First release on PyPI.

Page 3 of 3

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.