Subprober - An essential HTTP multi-purpose Probing Tool for Penetration Testers and Security Researchers with Asynchronous httpx client support

Overview

Subprober is a powerful and efficient tool designed for penetration testers and security professionals. This release introduces several enhancements, bug fixes, and new features to elevate your subdomain probing experience. Subprober facilitates fast and reliable information extraction, making it an invaluable asset for penetration testing workflows.

• Fast and configurable probings
• Supported Inputs: hosts, URLS, IPs
• Supports multiple methods http requests
• Supports proxies and customizable Header for probing
• Progress your probing tasks

Features in V2.0.0:

• New Probing configurations

  • --http2 : Now subprober support to request with Http/2 version
  • --http-version : display the server supported http version of the host
  • --http-reason : display the reason for http connection of the host
  • --jarm-fingerprint : display the jarm figerprint hash of the host

New Updates:

Subprober now supports HTTP/2 to give request and Improved concurrency using next generation http request client httpx and also now gives jarm figerprints and other probe configurations. Subprober Concurrency performance improved with more Asynchronous concurrency which make subprober more accurate and Concurrent tool for probing.

Subprober Probing Configuration:

Probes	Default check	Flags to Use
Url	True
Title	True	-tl, --title
Status code	True	-sc, --status-code
Response Length	true	-wc. --word-count
Server	True	-sv, --server
Content Type	True	-apt, --application-type
Follow redirection	False	-ar, --allow-redirect
Path	False	-p, --path
Redirect location	False	-l, --location
Max redirect follow	False	-maxr, --max-redirection
Disable http probe	False	-dhp, --disable-http-probe
Random user agents	False	-ra, --random-agent
Ipaddress of Host	False	-ip, --ipaddress
Cname of Host	False	-cn, --cname
Proxy	False	-px, --proxy
Custom Headers	False	-H, --header
Jarm	False	-jarm --jarm-fingerprint

Subprober headless configurations:

1. Requirement: Subprober now offers a new headless screenshot feature, but before using it, you need to ensure you have the appropriate browser and driver installed. This feature supports both Chrome and Firefox browsers.

2. Browser and Driver Compatibility: It's crucial to match the versions of the browser and driver. If you're using Chrome, ensure that the installed Chromedriver version matches your Chrome browser version. The same applies if you're using Firefox and Geckodriver.

3. Installation Guide: If you're unsure how to install Chrome browser and Chromedriver there are helpful resources available. For example, you can refer to this blog for a step-by-step installation guide. It provides detailed instructions to set up Chrome browser and Chromedriver in system executable path

4. Following the Guide: Follow the guide carefully to ensure that you install the browser and driver correctly. It's essential to pay attention to version compatibility and to execute the installation steps accurately.

5. Browser Selection: Subprober allows users to choose their preferred browser type for taking screenshots. You can opt for either Chrome or Firefox, depending on your preference and requirements.

6. Usage: Once you've installed the browser and driver, you can configure Subprober to utilize the headless screenshot feature. Make sure to specify the browser type (Chrome or Firefox) and ensure that the versions are compatible.

Installation

To install Subprober you need python latest version to be installed and then you can follow the below steps to install subprober

Method 1:

pip install git+https://github.com/sanjai-AK47/Subprober.git
subprober -h

Method 2:

git clone https://github.com/sanjai-AK47/SubProber.git
cd Subprober
pip install .
subprober -h

Usage

subprober -h      

   _____       __    ____             __             
  / ___/__  __/ /_  / __ \_________  / /_  ___  _____
  \__ \/ / / / __ \/ /_/ / ___/ __ \/ __ \/ _ \/ ___/
 ___/ / /_/ / /_/ / ____/ /  / /_/ / /_/ /  __/ /    
/____/\__,_/_.___/_/   /_/   \____/_.___/\___/_/     
                                                         
                
                
                    @RevoltSecurities

Subprober - An essential HTTP multi-purpose Probing Tool for Penetration Testers and Security Researchers with Asynchronous httpx client support

[Description] :

    Subprober is a high-performance tool designed for probing and extract vital information efficiently with Asynchronous concurrency performance

[Options]:

    [INPUT]:

        -f,    --filename              specify the filename containing a list of urls for probing.                                       
        -u,    --url                   specify a target URL for direct probing
        stdin/stdout                   subprober supports both stdin/stdout and enable -nc to pipe the output of subprober
                                      
    [PROBES-CONFIG]:

        -sc,    --status-code           display the status code of the host
        -tl,    --title                 display the title of host
        -sv,    --server                display the server name of the host
        -wc,    --word-count            display the content length of host
        -l ,    --location              display the redirected location of the host
        -apt,   --application-type      display the content type of the host
        -p,     --path                  specify a path for probe and get results (example: -p admin.php)
        -px,    --proxy                 specify a proxy to send the requests through your proxy (ex: http://127.0.0.1:8080)
        -gw,    --grep-word             enable The grep word flag will be usefull when grepping particular status codes
        -ar,    --allow-redirect        enable  to follow the redirections
        -dhp,   --disable-http-probe    disables the subprober from probing to http protocols and only for https when no protocol is specified
        -X  ,   --method                request methods to probe and get response (supported: get, post, head, put, delete, patch, trace, connect, options) (default: get)
        -H  ,   --header                add a custom headers for probing and -H can be used multiple times to pass multiple header values (ex: -H application/json -H X-Forwarded-Host: 127.0.0.1)
        -ra ,   --random-agent          enable Random User-Agent to use for probing (default: subprober/Alpha)
        -ip ,   --ip                    display the ip of the host
        -cn ,   --cname                 display the cname of the host
        -maxr,  --max-redirection       set a max value to follow redirection (default: 10)
        -http2, --http2                 enable to request with http2 support (default: Http/1.1)
        -htv,   --http-version          display the server supported http version of the host
        -hrs,   --http-reason           display the reason for http connection of the host
        -jarm,  --jarm-fingerprint      display the jarm figerprint hash of the host
    
    [HEADLESS-Mode]:

        -ss,   --screenshot            enable to take screenshot of the page using headless browsers with asynchronous performance
        -st,   --screenshot-timeout    set a timeout values for taking screenshosts  
        -br,   --browser-type          select a browser for taking screenshots and browser available: chrome, firefox (default: chrome)
                                       and requires chrome driver, gecko driver to be installed
                                       
    [MATCHERS]:

        -ex,   --exclude               exclude specific response status code(s) from the analysis (example: -ex 404 403)
        -mc,   --match                 specify specific response status code(s) to include in the analysis (example: -mc 200 302)
                                      
    [OUTPUT]:
    
        -o,    --output                define the output filename to store the results of the probing operation.
        -das,  ---disable-auto-save    disable the autosave of the results when no output file is specified.
        -oD,   --output-directory      define a folder name to save  screenshot outputs.

    [Rate-Limits]:

        -c,    --concurrency           set the concurrency level for subprober (default 50)
        -to,   --timeout               set a custom timeout value for sending requests.
        
    [UPDATES]:
    
        -up,   --update                update subprober to the latest version (pip required to be installed)
        -sup,  --show-updates          display the current or latest version subprober updates 
        
    [DEBUG]:

        -h,    --help                  display this help message for you and exit!
        -s,    --silent                enable silent mode to suppress the display of Subprober banner and version information.
        -v,    --verbose               enable verbose mode to display error results on the console.
        -nc,   --no-color              enabling the --no-color will display the output without any CLI colors

License

Subprober is open-source software licensed under the GPL-3.0 License. See the LICENSE file for details.

Contributing

Contributions are welcome! Feel free to open issues or submit pull requests to help improve Subprober.

Author:

This tool is developed by D.Sanjai Kumar for support the open source community for CyberSecurity and Ethical Hacking and The Subprober is built for reconnaissance and ethical hacking purposes and developer is not responsible for any unethical purposes so please use the Subprober with responsible and Ethically . Happy Hacking Hackers you can support my contribution by giving a ⭐ to the Subprober which motivate me to develop more like this ♥️.