Scrape

Latest version: v0.11.3

Safety actively analyzes 682416 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 17 of 20

0.1.10

Not secure
------

- now compares urls scheme-less before updating links to prevent http:// and https:// duplicates and replaced set_scheme with remove_scheme in utils.py
- renamed write_pages to write_links

0.1.9

Not secure
------

- added behavior for --crawl keywords in crawl method
- added a domain check before outputting crawled message or adding to crawled links
- domain key in args is now set to base domain for proper --restrict behavior
- clean_url now rstrips / character for proper link crawling
- resolve_url now rstrips / character for proper out_file writing
- updated description of --crawl flag

0.1.8

Not secure
------

- removed url fragments
- replaced set_base with urlparse method urljoin
- out_file name construction now uses urlparse 'path' member
- raw_links is now an OrderedSet to try to eliminate as much processing as possible
- added clear method to OrderedSet in utils.py

0.1.7

Not secure
------

- removed validate_domain and replaced it with a lambda instead
- replaced domain with base_url in set_base as should have been done before
- crawled message no longer prints if url was a duplicate

0.1.6

Not secure
------

- uncommented import __version__

0.1.5

Not secure
------

- set_domain was replaced by set_base, proper solution for links that are relative
- fixed verbose behavior
- updated description in README

Page 17 of 20

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.