# Slow down crawlers
User-agent: * 
Crawl-Delay: 30