Datasette-scraper

Latest version: v0.5.3

Safety actively analyzes 682361 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 2

0.5.3

Make the UI less daunting by hiding all tables except dss_crawl, and improving links from dss_crawl to dss_job, 51

0.5.2

Fix crawl status page when dss database is not the primary database (49)

0.5.1

Support installing datasette-scraper into a database with pre-existing tables (48)

0.5

- feature: generic support for extracting json+ld data
- feature: specific support for extracting json+ld `Product` data
- feature: add `discover-allow` to specify an allowlist of patterns to crawl
- enhancement: `seed-sitemaps` only activates for seeds that are at the top-level of the domain
- enhancement: `extract_from_response` can delete existing entries
- enhancement: `extract_from_response` can add indexed entries with `` sigil
- enhancement: `extract_from_response` skips doing writes that wouldn't change the database
- enhancement: prune pages that exceed max depth/max page limit earlier

0.4

0.3

Page 1 of 2

Links

Releases

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.