Does blocking OAI-SearchBot remove you from ChatGPT search?
Quick answer
OAI-SearchBot is the crawler OpenAI uses to fetch pages for ChatGPT search answers. Disallowing it can keep your URLs out of those answers. GPTBot is separate: blocking GPTBot is a training opt-out and does not, by itself, remove you from ChatGPT search. Check robots.txt, allow the search bots you want, then re-test after changes. OpenAI notes updates can take about 24 hours.
How do OAI-SearchBot and GPTBot differ?
OpenAI’s crawler overview lists OAI-SearchBot for search grounding and GPTBot for training crawls. Treat them as separate switches. Sustainable brands often block training crawlers on principle while keeping search crawlers allowed so buyers can still see proof pages in answers.
What should you put in robots.txt?
List explicit User-agent blocks only when you mean to block. A blanket “block all bots” rule at the CDN can override a careful robots.txt file. After edits, fetch robots.txt in an incognito window and confirm the allow path for product and FAQ URLs.
How do you verify the fix?
Pick one public URL, request it as OAI-SearchBot would (or use your host’s bot simulation if available). Pair with a manual question test from the visibility audit. Log the date; OpenAI documents about 24 hours to apply for bot rule changes.
Frequently asked questions
Does blocking GPTBot remove us from ChatGPT search?
OpenAI documents GPTBot for training crawls, not for the search fetcher. Blocking GPTBot alone does not replace an OAI-SearchBot allow rule.
Should eco brands block all AI crawlers?
That is a values and risk call. Many teams block training bots while allowing search bots so proof pages stay reachable in answers.
How long until robots.txt changes apply?
OpenAI notes about 24 hours for bot rule updates. Re-test after a day before you assume a fix failed.
Need this applied to your brand?
Book a call with fisagency, or continue in Calculators, Prompts, and Skills.