User-agent: * Crawl-Delay: 5 User-agent: NerdyBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: bingbot Disallow: /