robots.txt
Evance has a virtual robots.txt file - it's not a physical file. It will adapt automatically to any changes to your preferred domain.
Currently, Evance automates all aspects of the robots.txt file. This means you cannot currently make any changes to this file.
User Agents
We allow all user agents. However, we do have a defence system against aggressive or malicious bots.
Crawl Delay
We currently suggest a crawl delay of 5 seconds because we have found that some bots have been too aggressive in their crawls. However this figure is regularly reviewed and will automatically update.