About our crawler: GTMIntelBot

Last updated August 22, 2026

This page is an honest, accurate description of what this system actually does, written by the team that built it. It is not legal advice, and it has not yet been reviewed by a lawyer — treat it as the correct starting draft for that review, not as a substitute for it.

1. What this is

This page exists because our crawler’s own User-Agent string points here. If a request to your server carried the User-Agent below, it was made by our automated technographic-detection crawler, not a person browsing your site.

GTMIntelBot/0.1 (+https://app.floxify.ai/bot; technographic enrichment; public pages only)

2. What it does

GTMIntelBot fetches the public homepage of a company’s website — one page, not a site-wide crawl — and inspects the page it receives (HTML, response headers, and script tags) to detect which technologies the company appears to use: analytics tools, payment providers, CMS platforms, and similar. That detection is the entire purpose of the request.

It only ever requests pages that are public and unauthenticated.
It never logs into anything, and never requests any page behind a login wall, paywall, or CAPTCHA.
It does not follow links beyond the redirect chain of the single URL it was given.
It does not collect personal data about your site’s visitors or employees.

3. How it behaves

It is built to be identifiable and easy to rate-limit or block, deliberately:

Honours robots.txt. Before requesting a page, it fetches and applies your robots.txt — both the User-agent: * group and any group naming GTMIntelBot specifically. A disallowed path is never requested.
Identifies itself honestly. The User-Agent above is sent on every request; it never spoofs a browser.
Rate-limits itself per host. It enforces a minimum gap between requests to the same domain, independent of how many other domains it is crawling at the same time.
Backs off on throttling. A 429 or 503 response triggers a backoff and retry, honouring a Retry-After header when one is sent.
Times out and caps response size. A slow or oversized response is abandoned rather than held open or buffered without limit.

4. How to block it

Any of the following will stop GTMIntelBot from requesting your site:

Add to your robots.txt:
```
User-agent: GTMIntelBot
Disallow: /
```
Block the User-Agent string above at your edge/CDN or web server.
Email support@floxify.ai and ask us to exclude your domain — we will honour the request regardless of the mechanism above.

5. Contact

Questions, abuse reports, or exclusion requests: support@floxify.ai.