Short answer
Claude-User is Anthropic's user agent for user-triggered web fetches in Claude.
AI crawler guide
Claude-User: set robots.txt correctly
Claude-User is Anthropic's user agent for user-triggered web fetches in Claude.
Crawler facts
Facts about Claude-User
User-agent token
Claude-User
Operator
Anthropic
KI-Console group
Live fetches
Usually appears when a user-triggered AI fetch or citation path reaches the page.
robots.txt
Yes, documented
Documentation
Open source documentationWhat is Claude-User?
Claude-User may appear when a Claude user asks a question and Claude needs to fetch a specific web page for the answer. It is separate from ClaudeBot and Claude-SearchBot.
Purpose and SEO meaning
The KI-Console group is live fetch. A visit is more of a demand or retrieval signal than an autonomous training crawl.
Visibility and privacy note
Blocking Claude-User can reduce how systems from Anthropic see, index, train on, or retrieve your public content. Allowing it improves technical access, but it never guarantees crawling, ranking, citation, or a positive AI answer.
Anthropic documents Claude-User as a controllable bot and describes robots.txt rules for Anthropic bots. Still verify logs because user-agent strings can be copied.
robots.txt for Claude-User
Use the exact token Claude-User in your robots.txt. Keep private paths blocked separately if only part of the site should be available.
Allow :bot
User-agent: Claude-User
Allow: /Block :bot
User-agent: Claude-User
Disallow: /Straight answers
What skeptical website owners usually ask first
KI-Console does not sell magic visibility. It makes your website more readable for AI systems and shows evidence where it can.
What is Claude-User?
Claude-User is a crawler or robots.txt control token operated by Anthropic. The facts above show its purpose, robots.txt behavior, and exact allow or block rules.
How do I block Claude-User in robots.txt?
Use User-agent: Claude-User and Disallow: /. robots.txt is a directive for compliant crawlers, not a technical access barrier.
Does blocking Claude-User reduce AI visibility?
It can reduce visibility in systems from Anthropic if those systems can no longer crawl, index, train on, or retrieve your content. The effect depends on the bot type and product.
Check your own website
Find out which AI signals are working right now
Run the free scan first. With an account, you can verify the domain, keep history, generate files, and document crawler visits over time.