AI crawler access
robots.txt rules for GPTBot, ClaudeBot, PerplexityBot and friends.
Structured data
JSON-LD schema that machines can parse directly.
Content extractability
Whether your main content is actually present in the served HTML.
Indexability
No accidental noindex blocking the page from AI and search alike.
Heading structure
A clean H1–H6 outline machines can use to skim your page.
Semantic HTML5
<article>, <main>, <nav> and friends instead of div soup.