# Content Signals (https://contentsignals.org) # Every page: search engines and AI answers may index and cite it. # No content on this site may be used to train AI models. # # Cloudflare's Managed robots.txt (AI Crawl Control -> Signals) stays off. It is # a single zone-wide switch that writes its own rules ahead of this file, so the # training crawlers are blocked by name below instead. User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / # Crawlers and tokens that collect content for AI training: nothing. # The AI answer crawlers (OAI-SearchBot, ChatGPT-User, Claude-SearchBot, # Claude-User, PerplexityBot, Perplexity-User, Amzn-SearchBot, Meta-WebIndexer # and others) are not named here, so the rules above apply to them. # Google-Extended also covers grounding in the Gemini app; Google Search, # AI Overviews and AI Mode come from Googlebot and are not affected. User-agent: GPTBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot User-agent: Bytespider User-agent: meta-externalagent User-agent: FacebookBot User-agent: Amazonbot User-agent: cohere-training-data-crawler User-agent: AI2Bot User-agent: PanguBot Content-Signal: search=no, ai-input=no, ai-train=no Disallow: / Sitemap: https://phronesislabs.net/sitemap.xml