# WebmasterWorld.com: robots.txt # Please, no more that 1 hit per minute and use off peak hours. # http://www.searchengineworld.com/robots/ User-Agent: Googlebot-Image Disallow: / User-agent: ia_archiver/1.6 Disallow: / User-agent: MJ12bot Disallow: / #User-agent: msnbot #Disallow: / #User-agent: Slurp #Disallow: / User-agent: * Disallow: /clients Disallow: /go