# Compliant SEO / scraping crawlers = block User-agent: AhrefsBot User-agent: SemrushBot User-agent: MJ12bot User-agent: DotBot User-agent: BLEXBot User-agent: dataforseobot User-agent: Barkrowler User-agent: serpstatbot User-agent: SEOkicks User-agent: SeobilityBot User-agent: SeekportBot User-agent: Scrapy User-agent: QuillBot User-agent: omgili User-agent: omgilibot Disallow: / # AI training — uncomment this whole group to block training # User-agent: GPTBot # User-agent: ClaudeBot # User-agent: CCBot # User-agent: Google-Extended # User-agent: meta-externalagent # User-agent: Applebot-Extended # Disallow: / # Everyone else — including AI retrieval / citation agents # (OAI-SearchBot, Claude-SearchBot, PerplexityBot, ChatGPT-User, # Applebot, facebookexternalhit) — is allowed by default. User-agent: * Disallow: Sitemap: https://planqc.eu/sitemap.xml