AISearchStackBot
If you've seen AISearchStackBot in your server logs, this page explains what it is, what it looks at and how to opt out.
What it does
AISearchStackBot is the crawler behind AISearchStack Leads. It visits online stores to record public, company-level information: which platform the site runs on, its basic SEO setup, whether AI search crawlers are allowed, and generic business inboxes such as info@.
What it fetches
A handful of public URLs per site, usually: /robots.txt, the homepage, /llms.txt, a contact page, and on Shopify stores the public /meta.json file. It does not log in, submit forms, add to cart or follow links across your whole site.
How it behaves
It identifies itself with the user agent AISearchStackBot/0.1 (+https://aisearchstack.ai/bot), always checks robots.txt first, and visits each site only occasionally to keep the data current.
How to opt out
Add this to your robots.txt and the bot will stop visiting:
User-agent: AISearchStackBot
Disallow: /
To have your store removed from our data entirely, email hello@aisearchstack.com with your domain. We'll remove it within 5 business days.