What does "searchable by AI" mean?
Searchable by AI: an AI assistant can reach your pages, read them, work out who you are and what you do, and find enough supporting evidence to name you in an answer.
Searchable is not the same as ranked. Traditional search lists pages. An assistant writes an answer and names a few businesses, so being reachable is the starting line, not the result.
The five layers
| Layer | What it means | How to check it | Free audit | Needs Deep Audit |
|---|---|---|---|---|
| 1. Access | Crawlers are allowed in, not blocked by robots.txt, a firewall or a login | Open yoursite.com/robots.txt and look for rules naming AI bots | Yes: tests 10 retrieval bots and 5 training bots | No |
| 2. Readability | Your key facts are in the page text, not only in images or scripts | View the page source and search for your services and city | Yes: AI parsing score | No |
| 3. Identity | Your name, services, location and contact details are clear and consistent | Compare your site, Google Business Profile and directory listings | Yes: entity score | Partly: consistency across other sources |
| 4. Answers | Pages answer the questions customers actually ask, near the top | Read your service pages as a customer with a question | Structure only: answer-first, FAQ coverage, freshness | Yes: which questions assistants answer and from where |
| 5. Corroboration | Other trusted sources mention and describe you | Search your business name and look at who else describes you | No | Yes: source analysis and competitor gap |
What to do next: fix layers 1 to 3 first. They are fast and within your control, and layers 4 and 5 build on them.
Why can a site be crawlable but still not cited?
Crawlable only means the door is open. Three common reasons an open site still goes uncited:
- Assistants cannot tell who you are. A page that never states your business name, service area and what you sell in plain text gives an assistant little to quote.
- Competitors have more supporting evidence. If other sources describe your competitors and not you, assistants have more to draw on for them.
- Your pages do not answer the question asked. A page about "our story" does not answer "who is the best emergency plumber near me".
These are reasons to investigate, not diagnoses. Which one applies to you is what the Deep Audit tests. See also why AI recommends your competitor and not your business.
Can ChatGPT, Gemini, Perplexity and Claude crawl my website?
Each company runs separate crawlers for different jobs, and you can allow or block them separately in robots.txt. The free audit tests these 15:
| Job | Bots |
|---|---|
| Retrieval (finding sources for answers) | OAI-SearchBot, ChatGPT-User, PerplexityBot, Claude-SearchBot, Claude-User, Googlebot, Bingbot, Applebot, DuckAssistBot, Amzn-SearchBot |
| Training (building models) | GPTBot, ClaudeBot, Google-Extended, Applebot-Extended, CCBot |
Blocking a training bot is a separate choice from blocking a retrieval bot. A site can opt out of training and still be reachable for answers. Perplexity says PerplexityBot is used to surface and link sites, not to train models, and that robots.txt changes can take up to 24 hours to apply. For the Perplexity details, see why Perplexity doesn't cite your website. The free audit does not cover Google AI Overviews.
Check whether AI can reach your website
The free audit tests 15 AI bots and scores readability and identity in about a minute. No credit card.
Run the free audit See Deep Audit pricingHow can you check each layer yourself in 30 minutes?
Work through the layers in order. Each step takes about five to ten minutes.
- Access (5 minutes). Open your robots.txt. Look for "Disallow: /" under User-agent: * or under any AI bot name. Check your host or CDN for bot-blocking settings.
- Readability (5 minutes). Open your key page, choose View Source, and search for your main service and city. If they are missing, assistants may not see them.
- Identity (10 minutes). Write down your business name, address, phone and services as they appear on your site, Google Business Profile and one directory. Fix any that differ.
- Answers (5 minutes). Pick one customer question. Does a page answer it in the first paragraph?
- Corroboration (5 minutes). Search your business name. List the independent sites that describe you.
- Test the assistants. Ask ChatGPT, Gemini, Perplexity and Claude the same customer question three times each, and note who is named. One run varies, so repeat it. Our testing guide has a free scoring sheet.
What does the free audit show, and what does it not?
The free audit checks your website. It does not test any assistant.
It shows: which of 15 AI bots your site allows or blocks, how readable your pages are to AI, how clearly your business is identified, and the main blocker to fix first.
It does not: ask any assistant about you, show who is recommended instead of you, measure third-party mentions, or cover Google AI Overviews. For those, the Deep Audit tests 9 to 20 customer questions across ChatGPT, Gemini, Perplexity and Claude, names the competitors that appear, and maps the sources the assistants use. $347 one time, PDF within 1 day. See how we audit and the sample report.
Frequently asked questions
Is my website searchable by AI?
It is searchable when crawlers can reach it, the pages are readable text, your business is clearly identified, pages answer customer questions and other sources mention you. The free audit checks the first three layers.
Can ChatGPT crawl my website?
OpenAI uses separate bots, including OAI-SearchBot for search and GPTBot for training. Check robots.txt for rules naming them. The free audit tests both.
Is my website visible to ChatGPT?
Reachable is not the same as visible. Visible means ChatGPT names you when a customer asks a relevant question, which only testing the question can show.
How do I make my website searchable by AI?
Allow the retrieval bots, put key facts in readable text, state your business details clearly and consistently, and answer customer questions near the top of your pages. These improve your chances. They do not guarantee a mention.
Do I need an llms.txt file?
It is optional. We cannot promise it changes whether any assistant cites you. The free audit checks for it, and it counts for a quarter of the AI parsing score.
Do I need to install anything?
No. The free audit scans your public website and does not need access to your site or your accounts.
Why is my site crawlable but not cited?
Usually because assistants cannot identify you clearly, competitors have more supporting sources, or your pages do not answer the question asked. The Deep Audit tests which applies.
How long until AI sees my changes?
It varies by assistant and is not guaranteed. Perplexity says robots.txt changes can take up to 24 hours. Repeat your tests after a few weeks.
Does the free audit tell me what ChatGPT says about me?
No. It checks your website only. The Deep Audit tests assistant answers.
Can CoreTxt fix the problems it finds?
No. CoreTxt measures visibility and recommends actions. It does not implement fixes.
Related: Why your business stopped appearing in AI recommendations.
See the free audit or the Deep Audit
See the Deep Audit price and what is included, or check your website first with the free audit. CoreTxt measures visibility and recommends actions. It does not implement fixes, and no audit guarantees mentions, rankings or citations.
Run the free audit See Deep Audit pricing