Subprober

- **New Probing configurations**

- **--http2** : **Now subprober support to request with Http/2 version**
- **--http-version** : **display the server supported http version of the host**
- **--http-reason** : **display the reason for http connection of the host**
- **--jarm-fingerprint** : **display the jarm figerprint hash of the host**

New Updates:

Subprober now supports HTTP/2 to give request and Improved concurrency using next generation http request client `httpx`
and also now gives jarm figerprints and other probe configurations. Subprober Concurrency performance improved with
more Asynchronous concurrency which make subprober more accurate and Concurrent tool for probing.

Subprober Probing Configuration:

| Probes | Default check | Flags to Use |
|----------------------|---------------|-------------------------------------|
| Url | True | |
| Title | True | `-tl`, `--title` |
| Status code | True | `-sc`, `--status-code` |
| Response Length | true | `-wc`. `--word-count` |
| Server | True | `-sv`, `--server` |
| Content Type | True | `-apt`, `--application-type` |
| Follow redirection | False | `-ar`, `--allow-redirect` |
| Path | False | `-p`, `--path` |
| Redirect location | False | `-l`, `--location` |
| Max redirect follow | False | `-maxr`, `--max-redirection` |
| Disable http probe | False | `-dhp`, `--disable-http-probe` |
| Random user agents | False | `-ra`, `--random-agent` |
| Ipaddress of Host | False | `-ip`, `--ipaddress` |
| Cname of Host | False | `-cn`, `--cname` |
| Proxy | False | `-px`, `--proxy` |
| Custom Headers | False | `-H`, `--header` |
| Jarm | False | `-jarm` `--jarm-fingerprint` |

bash
pip install git+https://github.com/sanjai-AK47/Subprober.git
subprober -h



Recommended Concurrencies:

**Info:** Subprober is improved with higher concurrency and accuracy for probings and recommend the users to use the concurrencies less which is efficient and accurate for probing
- 30-50 : this range of concurrency can be given when probing for more than 50K+ Subdomains, ips, domains etc..
- 50-80 : this range of concurrency can be given when probing for more than 100K+ Subdomains, ips, domains etc..
- 100-120 : this range of concurrency can be given when probing for more than 150K+ Subdomains, ips, domains etc..

Note higher concurrency values may results in inaccurate results because subprober builded with higher concurrency and more accurate than other probing tool with following mentioned concurrency values

- **New Probing configurations**

- **-ip** : **finds the ips of urls**
- **-cn** : **find the cname of urls**
- **-maxr** : **maximum redirection for url**
- **-ra** : **enable random agent to probe with random agent**
- **-X** : **custom method for urls to probe**
- **-H** : **set custom header for urls to probe**
- **-sc** : **removed default to show response code and this flag to improve the subprober I/O**

- **Improved Concurrency**

- **Subprober concurrency and accuracy are improved with asynchoronous libraries** `aiohttp`, `arsenic`, `aiodns` **which make subprober to asynchornously probe urls**

- **Headless**

- **-ss** : **enable to probe and take screenshots for urls (required: chormedriver, geckodriver to be installed)**
- **-st** : **set a timeout value for urls to take screenshots**
- **-bt** : **select your browser type to take screenshots**

- **IO Support**:

- **Subprober now support stdout when using `-nc` flag which make subprober output to be piped and extend your automated workflows**
- **Now Subprober automatically detect the stdin are connected or not and quits**
- **Improved Subprober is now capable to handle high load urls and probe for it and tested with 4m+ urls**

- **Patched issues**:
- **Fixed issue to probe urls when passing `u`, `--url`** by [blackcodersec](https://github.com/sanjai-AK47/SubProber/issues/4)
- **Fixed double appendence of path when using `-p`, `--path`**
- **Fixed update issue in previous version**
- **Fixed issue in saving scrennshots output when urls passed with `-p`, `--path`**

Speed and Loads:
Subprober is really concurrent in probing and taking screenshots asynchornously and speed may differ depends on your network
subprober can be used even in your less sources `aws` VPS server without causing any high load to your system but only when probing
but not when taking screenshots, ip, cnames and Subprober can handle high load of urls and subprober tested with 2m+ urls and probed
without any problem, users can also try more urls than tested

Installation and Updates

Method 1:

bash
pip install git+https://github.com/sanjai-AK47/Subprober.git
subprober -h


Method 2:

bash
git clone https://github.com/sanjai-AK47/SubProber.git
cd Subprober
pip install .
subprober -h

- **New Probing configurations**

- **-ip** : **finds the ips of urls**
- **-cn** : **find the cname of urls**
- **-maxr** : **maximum redirection for url**
- **-ra** : **enable random agent to probe with random agent**
- **-X** : **custom method for urls to probe**
- **-H** : **set custom header for urls to probe**
- **-sc** : **removed default to show response code and this flag to improve the subprober I/O**

- **Improved Concurrency**

- **Subprober concurrency and accuracy are improved with asynchoronous libraries** `aiohttp`, `arsenic`, `aiodns` **which make subprober to asynchornously probe
urls**

- **Headless**

- **-ss** : **enable to probe and take screenshots for urls (required: chormedriver, geckodriver to be installed)**
- **-st** : **set a timeout value for urls to take screenshots**
- **-bt** : **select your browser type to take screenshots**

- **IO Support**:

- **Subprober now support stdout when using `-nc` flag which make subprober output to be piped and extend your automated workflows**
- **Now Subprober automatically detect the stdin are connected or not and quits**
- **Improved Subprober is now capable to handle high load urls and probe for it and tested with 4m+ urls**

Speed and Loads:
Subprober is really concurrent in probing and taking screenshots asynchornously and speed may differ depends on your network
subprober can be used even in your less sources `aws` VPS server without causing any high load to your system but only when probing
but not when taking screenshots, ip, cnames and Subprober can handle high load of urls and subprober tested with 2m+ urls and probed
without any problem, users can also try more urls than tested

- Subprober is capable to handle high loads
- accuracy and concurrency are improved
- add extra configuration in probing saving outputs
- added new command `-dhp` `--disable-http-probe` to only probe https protocol
- improved subprober's memory allocations
- added deduplication that remove duplicated urls and etc..

Installation and Updates

Method 1:

bash
pip install git+https://github.com/sanjai-AK47/Subprober.git
subprober -h


Method 2:

bash
git clone https://github.com/sanjai-AK47/SubProber.git
cd Subprober
pip install .
subprober -h

- Subprober Concurrency and Accuracy are Improved than previous version
- Introduced new options and probes configuration
- Improved handling exception and increased the accuracy in results