User-agent: * Disallow: /cgi-bin/ Disallow: /mailman/ Disallow: /pipermail/ User-agent: moget Disallow: /cgi-bin/ User-agent: Googlebot Disallow: /cgi-bin/ User-agent: Hatena Antenna Disallow: /cgi-bin/ User-agent: slurp Disallow: /cgi-bin/ User-agent: Pockey-GetHTML Disallow: / #User-agent: searchpreview #Disallow: / User-Agent: RufusBot Disallow: /page/diary/ #User-Agent: Baiduspider #Disallow: / User-Agent: Baiduspider+ Disallow: / #User-Agent: Yeti/1.0 #Disallow: / #ttp://www.exabot.com/go/robot User-agent: Exabot Disallow: /