User-agent: * Allow: / # Disallow private/app routes Disallow: /api/ Disallow: /dashboard/ Disallow: /onboarding/ Disallow: /oauth/ Disallow: /invite Disallow: /confirm-delete Disallow: /upgrade/ Disallow: /design/ Disallow: /keystatic/ Disallow: /roles/ Disallow: /pay/ # Allow AI crawlers explicitly (some respect Allow over Disallow) User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: Amazonbot Allow: / User-agent: Applebot Allow: / User-agent: YouBot Allow: / Sitemap: https://zephmatrix.ai/sitemap.xml