# robots.txt — geoscorecard.webjump.ai # GEO Readiness Scorecard by AI/R Business Apps / Webjump # ── Default: all crawlers allowed ─────────────────────────────── User-agent: * Allow: / # ── OpenAI ─────────────────────────────────────────────────────── User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # ── Anthropic (Claude) ─────────────────────────────────────────── User-agent: anthropic-ai Allow: / User-agent: ClaudeBot Allow: / # ── Perplexity ─────────────────────────────────────────────────── User-agent: PerplexityBot Allow: / # ── Google AI (Gemini / AI Overviews) ─────────────────────────── User-agent: Google-Extended Allow: / # ── Meta AI ────────────────────────────────────────────────────── User-agent: Meta-ExternalAgent Allow: / User-agent: Meta-ExternalFetcher Allow: / # ── You.com ────────────────────────────────────────────────────── User-agent: YouBot Allow: / # ── Amazon (Alexa / Rufus) ─────────────────────────────────────── User-agent: Amazonbot Allow: / # ── Cohere ─────────────────────────────────────────────────────── User-agent: cohere-ai Allow: / # ── Common Crawl (used to train LLMs) ─────────────────────────── User-agent: CCBot Allow: / # ── Sitemap & LLM context files ───────────────────────────────── Sitemap: https://geoscorecard.webjump.ai/sitemap.xml LLMs-txt: https://geoscorecard.webjump.ai/llms.txt