# This says to apply these settings to ALL search engine spiders/crawlers User-agent: * Crawl-Delay: 30 User-agent: TurnitinBot Disallow: /