ErrandkitAuditBot

ErrandkitAuditBot is the crawler behind our SEO & AI Search Readiness Audit. It fetches pages only when someone runs an audit on them, to report SEO and AI-search issues back to that person.

User agent

Mozilla/5.0 (compatible; ErrandkitAuditBot/0.1; +https://errandkit.com/bot)

The robots.txt token is ErrandkitAuditBot. Requests come from Apify's cloud, so the IP addresses vary.

What it does

• Fetches the pages a user asks to audit and, only if they ask, internal links on the same site and the links on those pages (to find broken links).
• Reads robots.txt, the XML sitemap and /llms.txt once per site per audit.
• Doesn't run JavaScript, log in, submit forms or collect personal data such as emails or phone numbers. It isn't used to train AI models.

How it behaves

• Always obeys robots.txt for ErrandkitAuditBot and *, including Crawl-delay up to 5 seconds.
• If your robots.txt returns a server error, it crawls nothing on your site.
• At most one request every 0.5 seconds per site.

How to block it

Add this to your robots.txt to block it from your whole site:

User-agent: ErrandkitAuditBot
Disallow: /

Or block only part of the site, for example:

User-agent: ErrandkitAuditBot
Disallow: /private/

Blocked pages are reported to the user as ROBOTS_DISALLOWED and aren't fetched.

Contact

Questions or a problem with the crawler: hello@errandkit.com. Please include your domain and the approximate time.