website@ki-console.com

AI crawler guide

PetalBot: set robots.txt correctly

PetalBot is the Huawei/Petal Search crawler for search indexing and related Huawei search features.

Crawler facts

Facts about PetalBot

User-agent token

PetalBot

Operator

Huawei / Petal Search

KI-Console group

Training

Regional crawler with lower priority for CH/DACH unless the target market fits.

robots.txt

Yes, verify in logs

Straight answers

What skeptical website owners usually ask first

KI-Console does not sell magic visibility. It makes your website more readable for AI systems and shows evidence where it can.

What is PetalBot?

PetalBot is a crawler or robots.txt control token operated by Huawei / Petal Search. The facts above show its purpose, robots.txt behavior, and exact allow or block rules.

How do I block PetalBot in robots.txt?

Use User-agent: PetalBot and Disallow: /. robots.txt is a directive for compliant crawlers, not a technical access barrier.

Does blocking PetalBot reduce AI visibility?

It can reduce visibility in systems from Huawei / Petal Search if those systems can no longer crawl, index, train on, or retrieve your content. The effect depends on the bot type and product.

Check your own website

Find out which AI signals are working right now

Run the free scan first. With an account, you can verify the domain, keep history, generate files, and document crawler visits over time.