ToolRancherBot

Last updated: 29 May 2026

ToolRancherBot is the crawler used by ToolRancher to refresh selected public product, price, availability, and retailer listing information for tool comparison pages.

Crawler Identity

ToolRancherBot identifies itself with this User-Agent:

ToolRancherBot/1.0 (+https://toolrancher.co.uk/bot)

What It Does

The crawler reads public product, category, sitemap, price, stock, and product detail pages from selected UK tool retailers and brands. The data is used to help ToolRancher users compare products and retailer offers.

Crawl Policy

ToolRancherBot is designed to respect robots.txt rules, crawl-delay directives where provided, and per-retailer rate limits. We prefer sitemaps, product feeds, affiliate feeds, and public APIs over broad page crawling.

Rate Limits

Default crawl settings are intentionally conservative. ToolRancherBot uses domain-level delays, limits concurrent requests, and backs off when a site returns blocking or rate-limit responses.

How To Block Or Contact Us

Website owners can block ToolRancherBot using robots.txt rules for the ToolRancherBot user agent. For questions, crawl concerns, allow-listing, data correction, or feed/API access, email contact@toolrancher.com.