About ScalixSearchBot

ScalixSearchBot is the web crawler for Scalix Search, the retrieval layer of Scalix Cloud. It fetches publicly available pages to build a search index used by the platform and its agents. This page explains how to identify it, what it respects, and how to control or block it.

Identifying ScalixSearchBot

Requests from ScalixSearchBot carry this User-Agent:

ScalixSearchBot currently crawls from the IP address 136.243.153.152. Traffic claiming this User-Agent from any other address is not ours. This list will be kept current as our infrastructure grows.

What it respects

• robots.txt allow and disallow rules. A group addressed to ScalixSearchBot takes precedence; otherwise the * group applies. Rules are re-checked regularly.
• Crawl-delay. We honour the robots.txt Crawl-delay directive, and we never fetch more than one page at a time per host regardless of it.
• Redirect and size limits. Bounded redirects, bounded response sizes, no cookies, no JavaScript execution.

Blocking or limiting the crawler

To stop ScalixSearchBot from crawling your site, add this to your robots.txt:

To slow it down instead:

Directives we do not support yet

Page-level meta robots and X-Robots-Tag directives (such as noindex and nosnippet) are on our roadmap but not honoured today. Until they are, robots.txt is the reliable way to control ScalixSearchBot, and we say so here rather than imply otherwise.

Contact

Questions, complaints, or unexpected traffic from our crawler: hello@scalix.world with the subject line “ScalixSearchBot”. Include the affected host and a timestamp and we will investigate promptly.