Short answer
Meta-ExternalFetcher is a Meta fetcher for external content in Meta product contexts.
AI crawler guide
Meta-ExternalFetcher: set robots.txt correctly
Meta-ExternalFetcher is a Meta fetcher for external content in Meta product contexts.
Crawler facts
Facts about Meta-ExternalFetcher
User-agent token
Meta-ExternalFetcher
Operator
Meta
KI-Console group
Live fetches
Usually appears when a user-triggered AI fetch or citation path reaches the page.
robots.txt
Limited for user-triggered fetches
Documentation
Open source documentationWhat is Meta-ExternalFetcher?
Meta-ExternalFetcher should be separated from meta-externalagent. It is observed as a fetcher for external URLs, not as a classic SEO crawler.
Purpose and SEO meaning
The KI-Console group is live fetch. A visit may be tied to a concrete product or user action.
Visibility and privacy note
Blocking Meta-ExternalFetcher can reduce how systems from Meta see, index, train on, or retrieve your public content. Allowing it improves technical access, but it never guarantees crawling, ranking, citation, or a positive AI answer.
Meta provides crawler documentation, but user agents can be spoofed and fetcher contexts may behave differently from autonomous crawlers. Validate important decisions with logs and IP patterns.
robots.txt for Meta-ExternalFetcher
Use the exact token Meta-ExternalFetcher in your robots.txt. Keep private paths blocked separately if only part of the site should be available.
Allow :bot
User-agent: Meta-ExternalFetcher
Allow: /Block :bot
User-agent: Meta-ExternalFetcher
Disallow: /Straight answers
What skeptical website owners usually ask first
KI-Console does not sell magic visibility. It makes your website more readable for AI systems and shows evidence where it can.
What is Meta-ExternalFetcher?
Meta-ExternalFetcher is a crawler or robots.txt control token operated by Meta. The facts above show its purpose, robots.txt behavior, and exact allow or block rules.
How do I block Meta-ExternalFetcher in robots.txt?
Use User-agent: Meta-ExternalFetcher and Disallow: /. robots.txt is a directive for compliant crawlers, not a technical access barrier.
Does blocking Meta-ExternalFetcher reduce AI visibility?
It can reduce visibility in systems from Meta if those systems can no longer crawl, index, train on, or retrieve your content. The effect depends on the bot type and product.
Check your own website
Find out which AI signals are working right now
Run the free scan first. With an account, you can verify the domain, keep history, generate files, and document crawler visits over time.