User-agent: * Disallow: /tools/ # This is not meant for search Disallow: /loginpage # This is not meant for search Disallow: /login # This is not meant for search Disallow: /logout # This is not meant for search Disallow: /loginandcheckuser # This is not meant for search Disallow: /submit* Disallow: /submitpost Disallow: /jump/ # This is not meant for search Disallow: /jump/* # This is not meant for search Disallow: /presence/ # This is not meant for search Disallow: /presence/* # This is not meant for search Disallow: /ajax/* # This is not meant for search Disallow: /scripts/main.js # This is not meant for search Disallow: /stylesheets/main.css # This is not meant for search User-agent: Slurp Disallow: /key/* # we hardly gain anything from yahoo so no reason to waste resources Disallow: /key/ # we hardly gain anything from yahoo so no reason to waste resources Disallow: /find/ # we hardly gain anything from yahoo so no reason to waste resources Disallow: /find/* # we hardly gain anything from yahoo so no reason to waste resources User-agent: baiduspider Disallow: /