Linux Bash one-liners December 22, 2012 admin Get a list of URLs for a website using wget: wget -r -nv -nd –delete-after “your-url-goes-here” 2>&1 | sed -n ‘/->/{/URL:/s/.*URL:\([^ ]*\).*/\1/;/^[ ]*$/d;p}’