GET /some/url.html HTTP/1.0 Host: www.delorie.com:81 Accept-Encoding: x-gzip, gzip, deflate User-Agent: CCBot/2.0 (http://commoncrawl.org/faq/) Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8