# Block all web crawlers from all content User-agent: * Disallow: / Crawl-delay: 86400 # Specifically block major search engines User-agent: Googlebot Disallow: / User-agent: Bingbot Disallow: / User-agent: Slurp Disallow: / User-agent: DuckDuckBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: YandexBot Disallow: / # Block archiving bots User-agent: ia_archiver Disallow: / User-agent: Wayback Machine Disallow: / # No sitemap (since we're blocking everything) Sitemap: