# Genereal robots
User-agent: * # match all bots
Disallow: /results.php
Crawl-delay: 10 # (Several major crawlers support a Crawl-delay parameter, set to the number of seconds to wait between successive requests)
Request-rate: 1/5 # maximum rate is one page every 5 seconds (An Extended Standard for Robot Exclusion)
Visit-time: 0300-0645 # only visit between 03:00 and 06:45 UTC (GMT) (An Extended Standard for Robot Exclusion)
Sitemap: http://www.quemmeama.co.cc/the.sitemap