Short answer
Webzio-Extended is Webz.io's additional crawler for AI/ML-related usability tagging of web data.
AI crawler guide
Webzio-Extended: set robots.txt correctly
Webzio-Extended is Webz.io's additional crawler for AI/ML-related usability tagging of web data.
Crawler facts
Facts about Webzio-Extended
User-agent token
Webzio-Extended
Operator
Webz.io
KI-Console group
Training
Autonomous crawler: allow access, keep public content readable, and monitor logs.
robots.txt
Yes, documented
Documentation
Open source documentationWhat is Webzio-Extended?
Webz.io describes Webzio-extended as part of the Webzio Duo: a bot that checks and tags whether collected data is usable for AI/ML purposes.
Purpose and SEO meaning
The KI-Console group is training. A visit may relate to commercial web data collection and AI/ML usability checks.
Visibility and privacy note
Blocking Webzio-Extended can reduce how systems from Webz.io see, index, train on, or retrieve your public content. Allowing it improves technical access, but it never guarantees crawling, ranking, citation, or a positive AI answer.
Webz.io says the Webzio Duo adheres to robots.txt exclusions. robots.txt remains a directive, not technical access protection.
robots.txt for Webzio-Extended
Use the exact token Webzio-Extended in your robots.txt. Keep private paths blocked separately if only part of the site should be available.
Allow :bot
User-agent: Webzio-Extended
Allow: /Block :bot
User-agent: Webzio-Extended
Disallow: /Straight answers
What skeptical website owners usually ask first
KI-Console does not sell magic visibility. It makes your website more readable for AI systems and shows evidence where it can.
What is Webzio-Extended?
Webzio-Extended is a crawler or robots.txt control token operated by Webz.io. The facts above show its purpose, robots.txt behavior, and exact allow or block rules.
How do I block Webzio-Extended in robots.txt?
Use User-agent: Webzio-Extended and Disallow: /. robots.txt is a directive for compliant crawlers, not a technical access barrier.
Does blocking Webzio-Extended reduce AI visibility?
It can reduce visibility in systems from Webz.io if those systems can no longer crawl, index, train on, or retrieve your content. The effect depends on the bot type and product.
Check your own website
Find out which AI signals are working right now
Run the free scan first. With an account, you can verify the domain, keep history, generate files, and document crawler visits over time.