httpx to IP-Host CSV

Takes a list of URLs (with payloads in them) and turns it into a CSV of IP addresses and hostnames — handy for identifying which URLs actually point to the same host.

1. Reads a list of proof-of-concept URLs
2. Uses Unfurl to extract their subdomains
3. Uses httpx to find IPs and sites, output as http(s)://SITE [IP]
4. Uses output tricks to format that into ip,host.csv

cat LIST-OF-URLS.txt | unfurl domain | httpx -ip -rl 25 | cut -d '/' -f 3- | tr -dc 'a-z0-9. \n\-' | tr ' ' '\t' | awk '{print $2","$1}' | sort -u