User-agent: * Disallow: /promo Disallow: /custom-reports/* Disallow: /*?utm_* Disallow: /llms.txt Allow: /*.js$ Allow: /*.css$ Allow: /*.png$ Allow: /*.gif$ Allow: /*.jpg$ Allow: /*.svg$ # AI Agents User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: anthropic-ai User-agent: PerplexityBot User-agent: CCBot User-agent: xAI-Bot User-agent: DuckAssistBot Allow: /llms.txt Sitemap: https://readpartner.com/sitemap.xml