Here's a failure with no symptoms.

Your help center loads fine. Your traffic is steady. Search works. Customers find articles. And every AI system that tries to read your documentation gets nothing, because the content only appears after JavaScript runs and the crawler gave up before that happened.

You would not know. There's no error, no alert, no drop in any number you look at. The only sign is that when someone asks ChatGPT about your product, the answer comes from a competitor's comparison page and a Reddit thread from 2023.

The four ways it happens

Rendering. The page is built in the browser. A crawler that doesn't execute JavaScript sees an empty shell. This is the most common one and the least visible, because the page looks perfect to you.

Blocking. Your robots.txt excludes crawlers you didn't mean to exclude. Many sites added AI crawler rules in a hurry a year or two ago and never revisited them.

Login walls. Documentation behind authentication is invisible by design. Sometimes that's correct. Often it's inherited from a decision nobody remembers making.

Speed and structure. Slow pages get abandoned mid-crawl, and content buried in tabs or accordions is often never opened.

How to check in about a minute

Open one of your help articles, view source, and search the raw HTML for a distinctive sentence from the middle of the page.

If it's there, you're fine on rendering. If it isn't, then what a crawler sees is not what you see, and everything else you do to your documentation is happening behind a locked door.

Then fetch yoursite.com/robots.txt in a browser and actually read it. It takes thirty seconds and it is regularly the whole problem.

This isn't a writing job

Worth saying plainly: most of these fixes belong to whoever owns the site, not to whoever writes the articles. If that isn't you, the useful move is to check, write down what you found, and hand it over — which is a much easier conversation than "I think something might be wrong".

There's also an upside people miss. Beyond being crawlable, you can hand your content over directly through machine-readable routes, rather than hoping a crawler does a good job of it.

The free health check includes this one, and it is the check we would run first on any help center we had never seen.