# robots.txt for https://www.knownwell.co # All crawlers, including AI crawlers named below, may crawl the site # except the paths listed under Disallow. User-agent: * User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-SearchBot User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot User-agent: Meta-ExternalAgent User-agent: Bytespider User-agent: Amazonbot User-agent: cohere-ai User-agent: DuckAssistBot Allow: / Disallow: /cgi-bin/ Disallow: /portfolio/ Disallow: /tag/ Disallow: /category/ Disallow: /categories/ Sitemap: https://www.knownwell.co/sitemap.xml