# robots.txt for https://jaybharti.me # Conforms to RFC 9309 (Robots Exclusion Protocol) User-agent: * Allow: / # OpenAI Crawlers User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / # Anthropic Crawler User-agent: ClaudeBot Allow: / # Perplexity AI Crawler User-agent: PerplexityBot Allow: / # Google Generative AI Crawler User-agent: Google-Extended Allow: / # Apple Intelligence Crawler User-agent: Applebot-Extended Allow: / # Microsoft Bing & Copilot Crawler User-agent: Bingbot Allow: / # Sitemap discovery Sitemap: https://jaybharti.me/sitemap.xml