Short answer
meta-externalagent is a Meta crawler token for direct crawling, listed in bot directories as training and product improvement.
AI crawler guide
meta-externalagent is a Meta crawler token for direct crawling, listed in bot directories as training and product improvement.
Short answer
meta-externalagent is a Meta crawler token for direct crawling, listed in bot directories as training and product improvement.
Crawler facts
User-agent token
meta-externalagent
Operator
KI-Console group
Autonomous crawler: allow access, keep public content readable, and monitor logs.
robots.txt
Documentation
Open source documentationThe token usually appears as meta-externalagent/1.1 and points to Meta crawler documentation. It should be separated from Meta-ExternalFetcher and classic link-preview crawlers.
The KI-Console group is training. A visit means direct automated fetching in a Meta crawler context, not necessarily a user click.
Blocking meta-externalagent can reduce how systems from Meta see, index, train on, or retrieve your public content. Allowing it improves technical access, but it never guarantees crawling, ranking, citation, or a positive AI answer.
Use the exact lowercase meta-externalagent token. Because user agents can be spoofed, verify logs, IPs, and patterns for security-relevant decisions.
Use the exact token meta-externalagent in your robots.txt. Keep private paths blocked separately if only part of the site should be available.
Allow :bot
User-agent: meta-externalagent
Allow: /
Block :bot
User-agent: meta-externalagent
Disallow: /
Straight answers
KI-Console does not sell magic visibility. It makes your website more readable for AI systems and shows evidence where it can.
meta-externalagent is a crawler or robots.txt control token operated by Meta. The facts above show its purpose, robots.txt behavior, and exact allow or block rules.
Use User-agent: meta-externalagent and Disallow: /. robots.txt is a directive for compliant crawlers, not a technical access barrier.
It can reduce visibility in systems from Meta if those systems can no longer crawl, index, train on, or retrieve your content. The effect depends on the bot type and product.
Check your own website
Run the free scan first. With an account, you can verify the domain, keep history, generate files, and document crawler visits over time.