website@ki-console.com

AI crawler guide

Perplexity-User: set robots.txt correctly

Perplexity-User is Perplexity's user agent for user-triggered fetches of individual pages.

Crawler facts

Facts about Perplexity-User

User-agent token

Perplexity-User

Operator

Perplexity

KI-Console group

Live fetches

Usually appears when a user-triggered AI fetch or citation path reaches the page.

robots.txt

Limited for user-triggered fetches

Straight answers

What skeptical website owners usually ask first

KI-Console does not sell magic visibility. It makes your website more readable for AI systems and shows evidence where it can.

What is Perplexity-User?

Perplexity-User is a crawler or robots.txt control token operated by Perplexity. The facts above show its purpose, robots.txt behavior, and exact allow or block rules.

How do I block Perplexity-User in robots.txt?

Use User-agent: Perplexity-User and Disallow: /. robots.txt is a directive for compliant crawlers, not a technical access barrier.

Does blocking Perplexity-User reduce AI visibility?

It can reduce visibility in systems from Perplexity if those systems can no longer crawl, index, train on, or retrieve your content. The effect depends on the bot type and product.

Check your own website

Find out which AI signals are working right now

Run the free scan first. With an account, you can verify the domain, keep history, generate files, and document crawler visits over time.