ADDED
1) Added dnspython, builtwith, MechanicalSoup requirements
2) Added networking_processor.py module
3) Added SSL and DNS info gathering functions in networking_processor.py module
4) Added Shodan InternetDB API support and usage in networking_processor.py
5) Added new InternetDB-related part in PDF report
6) Added function to extract sitemap.xml (and parse links from it) and robots.txt in networking_processor.py
DELETED
1) Removed import net.asyncio and asyncio from crawl_processor.py
2) Removed some empty fields in report_template.html
3) Removed google dorking results amount selector
4) Removed timeout and sleep-interval settings in config.txt
5) Removed change_settings function in dpulse.py
6) Removed pring_cfg_edit_menu function in cli_init.py
7) Removed "edit config parameters" point in print_settings_menu function in cli_init.py
8) Removed get_proxies.py module
CHANGED
1) Redacted some error messages to see full situation which caused the error
2) Updated visual part of report_temlplate.html
3) updated requirements.txt and setup.py
4) Reworked the way of creation reports: now DPULSE creates folder with name of case and puts pdf report and 4 text files with robots.txt, sitemap.xml, extracted links from sitemap.xml and dorking results in this folder
EXPERIMENTAL
1) MechanicalSoup is now used for processing Google Dorking, we'll see if it's a good solution, but if it's not - we'll find a better one.
v0.7b_hf_1
Fixed wrong config.txt location