User-agent: * Disallow: /search.php Disallow: /a/ Disallow: /db/ Disallow: /e/ Disallow: /i/ Disallow: /log/ Disallow: /songs/ Disallow: /reco/ Disallow: /mplayer-mail.html Disallow: /*? Disallow: /*/play Disallow: /*/download Disallow: /calvinandhobbes.html Disallow: /calvin_* Sitemap: http://www.s-anand.net/sitemap-index.xml User-agent: Slurp Crawl-delay: 30