StackraBot
StackraBot is the web crawler for Stackra, a website audit. If you found it in your logs, this page says what it was doing and how to stop it.
How to recognize it
It sends this user-agent:
StackraBot/1.0 (+https://stackra.app/bot/)
What it does
StackraBot reads public pages and their response headers to measure things a site owner cares about: search setup, speed, site health and the software versions a server reports. We use what it measures for Stackra's site audits, for monitoring sites our users track, and for research, such as how quickly hosting providers roll out security updates.
How it behaves
- It reads robots.txt first and follows it, including Crawl-delay.
- It sends one request per page and spaces its requests out. It does not retry a site that refuses it.
- It only reads. It never submits forms, never tries to log in and never sends attack or exploit traffic.
- It only requests public pages, the same ones any visitor can open.
How to block it
Add this to your robots.txt to keep StackraBot off your whole site:
User-agent: StackraBot Disallow: /
To slow it down instead, add a line such as Crawl-delay: 10 under the same user-agent.
What we keep
- We keep what it measures, such as response headers, the software versions a server reports and speed numbers.
- We do not republish your pages, and nothing StackraBot reads is used to train AI models.
- Research we publish reports group totals, such as counts by hosting provider. We never publish a list of sites running outdated software.
Contact
Questions, or something you want us to stop: email luke@stackra.app.