# ROBOTS.TXT created by Andrew Grant # 01 April 2008 # Purpose: Restrict extra traffic User-agent: * Crawl-delay: 5 Disallow: /cgi-bin/ Disallow: /advanced_search_result.html Disallow: /advanced_search.html