# To block all User-agent: * Disallow: / Crawl-delay: 20