Our newsletterVendor reportLoonis, 17 Jun 2026
Blocking any of the main AI crawlers eliminates your chance to get cited by AI answer platforms, no matter the quality or schema of your content
Optimisation methods
- Reader Note:
- Covers robots.txt policies for GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot, and Google-Extended.
- Evidence:
- Expert judgment
- Vendor interest:
- High — This comes from a company with a commercial interest in this market, so it is not a neutral source.
- Sample:
- Not disclosed
Reader Note:
Evidence:
Vendor interest:
Sample:Good for
Getting a rough orientation, and deciding what to check yourself.
Not for
- Anything that needs a measurement. Nobody counted or tested this.
- This comes from a company with a commercial interest in this market, so it is not a neutral source.
- The source never says when this data was collected. It could be considerably older than the publication date suggests.
- The source never says how big its sample was or what went into it.
- The source never says how this number was measured.
Related cards
Idea
Go deeper on this topic
Our Substack turns the data behind these cards into full breakdowns: what changed, why, and what to do about it.
Trend