User-agent: *
Crawl-delay: 5
Disallow: /dynres/
Sitemap: http://www.aria.co.uk/sitemap.gz
User-agent: TwengaBot
Crawl-delay: 20
Request-rate: 1/5
Visit-time: 0300-0700