Web

Browser

• Robots.txt

• Inspect

• View-source

Burp Suite

• Proxy

• Repeater

• Decoder

Curl

curl -I http://target_IP

• web content only

curl -I http://target_IP

• web header only

curl -i http://target_IP

• web header + body