Zyte-spider-templates

Latest version: v0.7.2

Safety actively analyzes 629599 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 2

0.7.2

------------------

* Implemented :ref:`mixin classes for spider parameters <parameter-mixins>`, to
improve reuse.

* Improved docs, providing an example about overriding existing parameters when
:ref:`customizing parameters <custom-params>`, and featuring
:class:`~web_poet.AnyResponse` in the :ref:`example about overriding parsing
<override-parsing>`.

0.7.1

------------------

* The
:class:`~zyte_spider_templates.spiders.ecommerce.EcommerceSpiderParams.crawl_strategy`
parameter of
:class:`~zyte_spider_templates.spiders.ecommerce.EcommerceSpider`
now defaults to
:attr:`~zyte_spider_templates.spiders.ecommerce.EcommerceCrawlStrategy.full`
instead of
:attr:`~zyte_spider_templates.spiders.ecommerce.EcommerceCrawlStrategy.navigation`.
We also reworded some descriptions of :enum:`~.EcommerceCrawlStrategy` values
for clarification.

0.7.0

------------------

* Updated requirement versions:

* :doc:`scrapy-poet <scrapy-poet:index>` >= 0.21.0
* :doc:`scrapy-zyte-api <scrapy-zyte-api:index>` >= 0.16.0

* With the updated dependencies above, this fixes the issue of having 2 separate
Zyte API Requests (*productNavigation* and *httpResponseBody*) for the same URL. Note
that this issue only occurs when requesting product navigation pages.

* Moved :class:`zyte_spider_templates.spiders.ecommerce.ExtractFrom` into
:class:`zyte_spider_templates.spiders.base.ExtractFrom`.

0.6.1

------------------

* Improved the :attr:`zyte_spider_templates.spiders.base.BaseSpiderParams.url`
description.

0.6.0

------------------

* Fixed the ``extract_from`` spider parameter that wasn't working.

* The *"www."* prefix is now removed when setting the spider's
:attr:`~scrapy.Spider.allowed_domains`.

* The :attr:`zyte_common_items.ProductNavigation.nextPage` link won't be crawled
if :attr:`zyte_common_items.ProductNavigation.items` is empty.

* :class:`zyte_common_items.Product` items that are dropped due to low probability
*(below 0.1)* are now logged in stats: ``drop_item/product/low_probability``.

* :class:`zyte_spider_templates.pages.HeuristicsProductNavigationPage` now
inherits from :class:`zyte_common_items.AutoProductNavigationPage` instead of
:class:`zyte_common_items.BaseProductNavigationPage`.

* Moved e-commerce code from :class:`zyte_spider_templates.spiders.base.BaseSpider`
to :class:`zyte_spider_templates.spiders.ecommerce.EcommerceSpider`.

* Documentation improvements.

0.5.0

------------------

* The ``zyte_spider_templates.page_objects`` module is now deprecated in favor
of ``zyte_spider_templates.pages``, in line with ``web_poet.pages``.

Page 1 of 2

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.