IndexonicBot
If you found IndexonicBot in your logs, here is exactly what it was doing — and how to stop it in one line.
What it does
IndexonicBot fetches a page when someone asks Indexonic to audit that site. It reads the home page, then robots.txt, sitemap.xml, llms.txt and the structured data, to check what an answer engine can actually read on your site. It runs no JavaScript, submits no forms, signs in to nothing and buys nothing.
When it visits
On request, never continuously. One audit is a handful of requests over a few seconds, then nothing until the next audit. There is no scheduled sweep of the web.
How to recognise it
It always identifies itself as:
IndexonicBot/1.0 (+https://indexonic.com/bot)
How to block it
Add this to your robots.txt. We honour it, and an audit run against your domain will then simply report that crawling was refused.
User-agent: IndexonicBot
Disallow: /
Questions or complaints
Write to hello@indexonic.com and we will answer. If our crawler caused you a problem, please tell us — we want to know.