AI Boost for Joomla 1.1.3

AI search crawlers can read your site from the day you install

AI companies run several crawlers each. One builds a search index, one fetches a page a person asked about, and one collects pages for training. A robots.txt that blocks the wrong one keeps your pages out of AI answers.

The AI Access screen, crawler by crawler
The AI Access screen in AI Boost.

From 1.1.3, installing or updating AI Boost switches on its robots.txt lines and usage signals once, and answers Yes for search indexing and real-time AI answers. AI model training, and every crawler you blocked yourself, stay as you left them. If you switch robots.txt off afterwards, it stays off.

AI Access now names each block that keeps your pages out of an AI answer, and what it costs.

  • A robots.txt rule against Googlebot or Applebot, which costs Google Search and AI Overviews, or Siri and Spotlight answers.
  • A nosnippet or noarchive rule on your home page, in the page or in a response header.
  • Cloudflare, whose bot settings can stop a crawler that robots.txt allows.

AI Crawler Rules now lists 25 AI crawlers. The four that joined in 1.1.2 are each described as their vendor describes them.