This crawler read your site because someone asked it to

Somebody entered your domain into the free Claim Audit at audit.knowledgecompany.ai. It fetched a handful of your public pages, looked for pricing, certification, metric and policy claims, and produced a register of them.

What it does

It reads robots.txt and obeys it. It fetches at most 40 pages, one origin at a time, 6 at a time with a pause between requests. It never signs in, never submits a form, never follows a redirect off your domain, and never requests anything but HTML.

What it keeps

Sentences you already published, the URLs they appear on, and the dates your own pages carry. Nothing else. No page bodies are stored. If someone asked for the register by email, that register is kept for 180 days at a private URL and then deleted.

To stop it

Add this to your robots.txt and it will stop on the next scan:

Or email leanid@knowledgecompany.ai and we will block your domain outright.