robots.txt

Evance has a virtual robots.txt file - it's not a physical file. It will adapt automatically to any changes to your preferred domain.

Currently, Evance automates all aspects of the robots.txt file. This means you cannot currently make any changes to this file.

User Agents

We allow all user agents. However, we do have a defence system against aggressive or malicious bots.

Crawl Delay

We currently suggest a crawl delay of 5 seconds because we have found that some bots have been too aggressive in their crawls. However this figure is regularly reviewed and will automatically update. 

Sitemap

Your robots.txt references your XML Sitemap to help bots crawl your website easier.