01AI crawler access
robots.txt rules for 15 AI search, assistant and training crawlers, meta robots and X-Robots-Tag directives, and a live firewall test as GPTBot, ClaudeBot and PerplexityBot.
02Machine readability
How much of your content is in the raw HTML (most AI crawlers do not run JavaScript), app-shell detection, a main content landmark and the text-to-code ratio.
03Structure & scannability
One clear H1, H2 sections, logical heading order, lists and tables, and paragraph length — the structure AI answers lift passages from.
04Answer readiness
An answer-first opening paragraph, headings phrased as the questions people ask, and FAQPage, QAPage or HowTo structured data.
05Structured data & entity
Valid JSON-LD, an Organization or LocalBusiness entity, sameAs links to your official profiles, page-type schema and Open Graph tags.
06Trust & freshness
HTTPS, published and modified dates, an author or byline, and links to About and Contact pages that confirm who stands behind the content.
07Technical discoverability
Title and meta description, a self-referencing canonical, language, XML sitemap, server response time and the optional llms.txt file.
08Ready-made fixes
For anything missing we generate copy-paste robots.txt rules, FAQPage and Organization JSON-LD and an llms.txt starter built from your own page.