Training
GPTBot
Training and web data access
GPTBot is the OpenAI crawler most teams associate with training or broad web data collection. Allowing it is a policy decision, not proof of a live ChatGPT answer.
OpenAI crawlers
There is no single ChatGPT crawler. OpenAI uses different agents for training, user-triggered live access, and search-backed retrieval. Treating them separately makes robots.txt decisions and visit proof much clearer.
OpenAI
A GPTBot visit, a ChatGPT-User visit, and an OAI-SearchBot visit do not mean the same thing. The token tells you which type of access happened.
Training
GPTBot
GPTBot is the OpenAI crawler most teams associate with training or broad web data collection. Allowing it is a policy decision, not proof of a live ChatGPT answer.
Live fetches
ChatGPT-User
ChatGPT-User is the strongest signal that someone asked ChatGPT to access a page or a tool requested the page in the moment.
AI search
OAI-SearchBot
OAI-SearchBot belongs to search and retrieval workflows. It can matter when ChatGPT uses current web information instead of only model memory.
If you want ChatGPT-related systems to reach public content, name the three agents explicitly. You can still block private paths or decide to allow live fetches while limiting broader training access.
OpenAI starter rules
User-agent: GPTBot
Allow: /
User-agent: ChatGPT-User
Allow: /
User-agent: OAI-SearchBot
Allow: /
Sitemap: https://www.example.com/sitemap.xml
First through training: your page was in the data the model learned from. You have no influence over that today, and no way to check it. Second through search: OAI-SearchBot holds the page in an index that ChatGPT draws on when needed. Third through a live fetch: someone asks something and ChatGPT retrieves the page at that moment. Only the last two routes can be influenced — and that is exactly where it is decided whether your company is named as it is today or described from an outdated training snapshot.
A fetch is not a browser visit. No JavaScript runs, no mouse moves, no accordion opens. What is in the source counts; what a script loads afterwards usually is not there. Text inside images is not there either — a price on a graphic simply does not exist for an AI system. You can check this without any tool: open the page, switch JavaScript off in the browser, reload. Whatever is still readable is roughly what arrives.
A Disallow in robots.txt, often left over from an old test phase. A firewall or bot protection that rejects unknown agents wholesale — then the fetch never even arrives. Content only visible after a login or a consent dialog. A page whose actual statement sits inside an image. A very long page where the important details are at the bottom and get cut when it is truncated. And the most common case of all: the question the customer asks is answered nowhere on the site as a question.
Open your robots.txt in the browser and read whether GPTBot, ChatGPT-User and OAI-SearchBot are allowed there. Switch JavaScript off and check whether your core statement is still on the page. On your most important page, look for the three questions customers ask on the phone — are they there as questions, with an answer underneath? Check your server logs for the three agents. And ask ChatGPT itself about your company: what comes back is the most honest baseline you can get.
Access can be measured: which agent fetched which page when, and with what result. What cannot be measured is whether that turned into a mention. OpenAI publishes no statistic on how many answers named your page — nobody can honestly promise that, and anyone selling a number for it has estimated it. What you can do: prove the access, ask ChatGPT about your own company regularly, and compare the answers over months. That is less convenient than a metric, but it is true.
KI-Console recognises GPTBot, ChatGPT-User, and OAI-SearchBot in uploaded logs and through the tracker where installed. The Radar separates the groups so live access does not get hidden inside generic bot traffic.
A crawler visit does not guarantee ranking, inclusion, citation, or a positive answer. It proves technical access at a point in time, which is the foundation you can control.
Straight answers
KI-Console does not sell magic visibility. It makes your website more readable for AI systems and shows evidence where it can.
No. GPTBot is associated with training or data collection. ChatGPT-User is a live fetch tied to a user action or tool request.
Yes, robots.txt can name the agents separately. That lets you support live user reads while making a different choice about training access.
Yes. The detection engine tracks GPTBot, ChatGPT-User, and OAI-SearchBot and shows them with their crawler group.
For a live fetch, immediately — ChatGPT-User retrieves the page at the moment someone asks. For the search index it takes days to weeks, depending on when OAI-SearchBot returns. For training, not at all: what sits in the model only changes with the next model. So if you want to correct a false claim about your company, correct it on the website and make sure the live fetch works — that takes effect fastest.
For today's visibility, barely, because GPTBot concerns future training, not today's answer. But anyone who blocks GPTBot and accidentally blocks ChatGPT-User and OAI-SearchBot along with it — through a blanket rule or a bot protection — cuts themselves off from the live fetch. That is the mistake we see most often: the intent was aimed at training, the damage landed on visibility.
Usually not because the competitor is bigger, but because on their page the answer to the question asked is stated in so many words. A model names what it can quote. Someone who writes "we repair hybrid vehicles of all makes in Bern and the surrounding area" gets named for exactly that question; someone who writes "your competent partner for mobility" does not. Compare your page and theirs against the question you care about — the difference is almost always concreteness, not company size.
Check your own website
Run the free scan first. With an account, you can verify the domain, keep history, generate files, and document crawler visits over time.