Short answer
anthropic-ai is an Anthropic-associated legacy or observed token; current official Anthropic documentation names other bot tokens.
AI crawler guide
anthropic-ai: set robots.txt correctly
anthropic-ai is an Anthropic-associated legacy or observed token; current official Anthropic documentation names other bot tokens.
Crawler facts
Facts about anthropic-ai
User-agent token
anthropic-ai
Operator
Anthropic
KI-Console group
Training
Autonomous crawler: allow access, keep public content readable, and monitor logs.
robots.txt
Not clearly documented
Documentation
No clear official documentation found for this exact token.
What is anthropic-ai?
Anthropic currently documents ClaudeBot, Claude-User, and Claude-SearchBot. anthropic-ai should therefore be treated conservatively as an observed or historical token.
Purpose and SEO meaning
The KI-Console group is training. In practice the token is mainly a log signal unless a clearly documented product channel exists.
Visibility and privacy note
Blocking anthropic-ai can reduce how systems from Anthropic see, index, train on, or retrieve your public content. Allowing it improves technical access, but it never guarantees crawling, ranking, citation, or a positive AI answer.
robots.txt behavior for the exact anthropic-ai token is not clearly documented officially. Add a rule if needed and compare the effect in logs.
robots.txt for anthropic-ai
Use the exact token anthropic-ai in your robots.txt. Keep private paths blocked separately if only part of the site should be available.
Allow :bot
User-agent: anthropic-ai
Allow: /Block :bot
User-agent: anthropic-ai
Disallow: /Straight answers
What skeptical website owners usually ask first
KI-Console does not sell magic visibility. It makes your website more readable for AI systems and shows evidence where it can.
What is anthropic-ai?
anthropic-ai is a crawler or robots.txt control token operated by Anthropic. The facts above show its purpose, robots.txt behavior, and exact allow or block rules.
How do I block anthropic-ai in robots.txt?
Use User-agent: anthropic-ai and Disallow: /. robots.txt is a directive for compliant crawlers, not a technical access barrier.
Does blocking anthropic-ai reduce AI visibility?
It can reduce visibility in systems from Anthropic if those systems can no longer crawl, index, train on, or retrieve your content. The effect depends on the bot type and product.
Check your own website
Find out which AI signals are working right now
Run the free scan first. With an account, you can verify the domain, keep history, generate files, and document crawler visits over time.