ToolRancherBot
Last updated: 29 May 2026
Crawler Identity
ToolRancherBot identifies itself with this User-Agent:
ToolRancherBot/1.0 (+https://toolrancher.co.uk/bot)
What It Does
The crawler reads public product, category, sitemap, price, stock, and product detail pages from selected UK tool retailers and brands. The data is used to help ToolRancher users compare products and retailer offers.
Crawl Policy
ToolRancherBot is designed to respect robots.txt rules, crawl-delay directives where provided, and per-retailer rate limits. We prefer sitemaps, product feeds, affiliate feeds, and public APIs over broad page crawling.
Rate Limits
Default crawl settings are intentionally conservative. ToolRancherBot uses domain-level delays, limits concurrent requests, and backs off when a site returns blocking or rate-limit responses.
How To Block Or Contact Us
Website owners can block ToolRancherBot using robots.txt rules for the ToolRancherBot user agent. For questions, crawl concerns, allow-listing, data correction, or feed/API access, email contact@toolrancher.com.