#Yo! Nothing to see here. ... User-Agent: * Disallow: / User-agent: Baiduspider Disallow: /cn-t/ User-agent: WWW-Mechanize/1.68 Disallow: / User-agent: HTMLParser/1.6 Disallow: / User-agent: Wget/1.11.4 Red Hat modified Disallow: / User-agent: Wget/* Disallow: / User-agent: Wget/1.12 (cygwin) Disallow: / User-agent: Wget/1.12 (linux-gnu) Disallow: / User-agent: Wget/1.11.4 Disallow: / User-agent: Python-urllib/1.17 Disallow: / User-agent: Lynx/2.8.8dev.2 libwww-FM/2.14 SSL-MM/1.4.1 Disallow: / User-agent: Java/1.6.0_16 Disallow: /