Short answer
bedrockbot is the generic robots.txt token for the Amazon Bedrock web crawler for Knowledge Bases.
AI crawler guide
bedrockbot: set robots.txt correctly
bedrockbot is the generic robots.txt token for the Amazon Bedrock web crawler for Knowledge Bases.
Crawler facts
Facts about bedrockbot
User-agent token
bedrockbot
Operator
Amazon Web Services
KI-Console group
Training
Autonomous crawler: allow access, keep public content readable, and monitor logs.
robots.txt
Yes, documented
Documentation
Open source documentationWhat is bedrockbot?
Amazon Bedrock can crawl websites that a customer configures as a data source for a Knowledge Base. AWS describes bedrockbot and bedrockbot-UUID rules.
Purpose and SEO meaning
The KI-Console group is training. More precisely, this is knowledge-base ingestion and retrieval for customer-configured Bedrock applications.
Visibility and privacy note
Blocking bedrockbot can reduce how systems from Amazon Web Services see, index, train on, or retrieve your public content. Allowing it improves technical access, but it never guarantees crawling, ranking, citation, or a positive AI answer.
AWS documents that the Web Crawler respects robots.txt according to RFC 9309 and checks bedrockbot-UUID rules before generic bedrockbot rules.
robots.txt for bedrockbot
Use the exact token bedrockbot in your robots.txt. Keep private paths blocked separately if only part of the site should be available.
Allow :bot
User-agent: bedrockbot
Allow: /Block :bot
User-agent: bedrockbot
Disallow: /Straight answers
What skeptical website owners usually ask first
KI-Console does not sell magic visibility. It makes your website more readable for AI systems and shows evidence where it can.
What is bedrockbot?
bedrockbot is a crawler or robots.txt control token operated by Amazon Web Services. The facts above show its purpose, robots.txt behavior, and exact allow or block rules.
How do I block bedrockbot in robots.txt?
Use User-agent: bedrockbot and Disallow: /. robots.txt is a directive for compliant crawlers, not a technical access barrier.
Does blocking bedrockbot reduce AI visibility?
It can reduce visibility in systems from Amazon Web Services if those systems can no longer crawl, index, train on, or retrieve your content. The effect depends on the bot type and product.
Check your own website
Find out which AI signals are working right now
Run the free scan first. With an account, you can verify the domain, keep history, generate files, and document crawler visits over time.