Get Claude AI to Recommend Your Product
Claude (by Anthropic) crawls the web with its own bot — ClaudeBot. Here's what it looks for when deciding whether to mention you.
About ClaudeBot
Anthropic's web crawler is identified as ClaudeBot in server logs. It visits pages to gather information that helps Claude answer user questions with up-to-date, sourced information.
Unlike some crawlers, ClaudeBot respects robots.txt strictly. If your site blocks it, Claude won't have current information about your product and may rely on outdated training data.
What Claude Values Most
llms.txt
Anthropic was one of the first companies to support the llms.txt standard. Having this file significantly improves how well Claude understands your product.
Honest, factual content
Claude is specifically trained to avoid recommending products based on marketing hype. Clear, factual descriptions work better than superlatives.
Structured data
JSON-LD schema markup helps Claude categorize your product correctly rather than guessing from page text.
Recent updates
Claude favors recently-modified content. A page updated last week carries more weight than one from a year ago.
Clear pricing information
When users ask about tools, Claude often mentions pricing. If it can't find pricing on your site, it may skip you.
Quick Check
Verify that your robots.txt doesn't block ClaudeBot:
# In your robots.txt, make sure you DON'T have: User-agent: ClaudeBot Disallow: / # Instead, explicitly allow: User-agent: ClaudeBot Allow: /