User-agent: * Disallow: /command.php Disallow: /site.php Disallow: /dir Disallow: /search.php Disallow: /*mailto Disallow: /*print Disallow: /cl Crawl-delay: 2 User-Agent: Slurp Disallow: /