User-agent: * Disallow: Crawl-delay: 5 User-agent: Mozilla/5.0 (compatible;contxbot/1.0) Disallow: