# Disallow the search engine. (Because Googlebot tries to crawl it, # leading to a heavy CPU load on the machine.) Also disallow icons # to provide a blocked trap page. And we disallow private standards. User-agent: * Disallow: /sresult.cgi Disallow: /search.cgi Disallow: /search* Disallow: /icons Disallow: /standards/private