Transmogrify-webcrawler

Latest version: v1.2.1

Safety actively analyzes 682361 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 2 of 3

1.0b6

------------------
- only open cache files when needed so don't run out of handles [djay]
- follow http-equiv refresh links [djay]

1.0b5

------------------
- files use file pointers to reduce memory usage [djay]
- cache saves .metadata files to record and playback headersx [djay]

1.0b4

------------------
- improve logging [djay]
- fix encoding bug caused by cache [djay]

1.0b3

------------------

- Fixed bug in cache that caused many links to be ignored in some cases [djay]
- Fix documentation up [djay]

1.0b2

------------------

- Stopped localhost output when no output set [djay]

1.0b1

------------------

- change site_url to just url. [djay]

- rename maxpage to maxsize [djay]

- fix file: style urls [djay]

- Added cache option to replace base_alias [djay]

- fix _origin key set by webcrawler, instead of url now it is path as expected by further blue
[Vitaliy Podoba]

- add _orig_path to pipeline item to keep original path for any further purposes, we will need
[Vitaliy Podoba]

- make all url absolute taking into account base tags inside webcrawler blueprint
[Vitaliy Podoba]

Page 2 of 3

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.