Long-form practical guides on Common Crawl, AI bots, robots.txt, schema, and the strategic decisions that matter.
Common Crawl is the public web archive that trained most large language models. If your site isn't in it, ChatGPT, Claude and Gemini probably don't know you exist.
Read guide →Every major AI company runs a crawler with a known name. Here's what each bot is, what it does with your content, and how to allow or block each one.
Read guide →Optimising your site for ChatGPT is not the same as optimising for Google. Here's where the rules diverge and where they converge.
Read guide →A concrete week-by-week plan to take a site from invisible to AI-cited. Realistic, no fluff.
Read guide →A clear, sourced breakdown of where each major AI's training data comes from, and what that means for getting cited.
Read guide →Which schema.org types matter most for AI visibility, with copy-paste examples for the four you should have on every site.
Read guide →