User-agent: * Disallow: /css Disallow: /javascript Disallow: /nr Disallow: /search.php Disallow: /error.php Disallow: /store_directory_generator.php User-Agent: Microsoft Disallow: / User-Agent: Control Disallow: / User-Agent: MSIECrawler Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows NT) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 95) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 4.0; Windows 98) Disallow: / User-Agent: ia_archiver Disallow: / User-Agent: psbot Disallow: / User-agent: girafa Disallow: /