# ---------- SEO TOOLS & AUDIT BOTS (allowed, rate-limited) ---------- User-agent: SemrushBot User-agent: SiteAuditBot Allow: / Crawl-delay: 10 # ---------- AI SEARCH, ANSWER-ENGINE & MAJOR SEARCH BOTS (allowed) ---------- # OpenAI User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User Allow: / # Anthropic User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-SearchBot User-agent: Claude-Web User-agent: anthropic-ai Allow: / # Adviora User-agent: AdvioraBot User-agent: AdvisorBot/1.0 Allow: / # Perplexity User-agent: PerplexityBot User-agent: Perplexity-User Allow: / # Google User-agent: Googlebot User-agent: Googlebot-Image User-agent: Google-Extended User-agent: GoogleOther User-agent: GoogleOther-Image User-agent: GoogleOther-Video Allow: / # Microsoft User-agent: Bingbot Allow: / # Apple User-agent: Applebot User-agent: Applebot-Extended Allow: / # Others User-agent: Amazonbot User-agent: DuckAssistBot User-agent: MistralAI-User User-agent: Meta-ExternalAgent User-agent: FacebookBot User-agent: Diffbot User-agent: Quora-Bot User-agent: TikTokSpider User-agent: aiHitBot Allow: / # ---------- SITEMAP ---------- Sitemap: https://valuemd.com/sitemap_index.xml