AI crawler
Cohere Training Crawler
Crawlers that read pages to train or ground AI models.
Last updated
At a glance
| Category | AI crawler |
|---|---|
| User agent match | contains "cohere-training-data-crawler" |
| Executes JavaScript | No |
| Respects robots.txt | Generally yes |
| Identity verifiable | No, the name is only a claim |
| IVT class | GIVT (general invalid traffic: declared automation) |
What Cohere Training Crawler is
Cohere Training Crawler is an AI crawler: it reads pages so that an AI model can be trained on them or answer questions from them. It does not execute JavaScript, so a browser-based tracker never sees it; its visits exist only in server logs and in server-side collection.
Can the name be trusted?
There is no published way to verify Cohere Training Crawler: the operator provides no IP ranges and no reverse DNS scheme, so the name in the user agent is only a claim. Any script can send it. TrueVisit still names the traffic, and weighs the claim against behavioral signals instead of trusting it.
Should you block it?
Blocking Cohere Training Crawler is a trade, not hygiene. Crawlers like this one are how AI assistants read and then cite your site, so walling it off removes you from those answers while saving you its bandwidth. Measure it first, then decide: if the model behind it sends you cited readers, it is earning its keep; if it only takes, block it with a clear conscience.
For enforcement rather than a polite request, the Cloudflare blocking guide generates copy-paste WAF rules from this same signature list, with guardrails that keep verified search engines safe.
How TrueVisit reports it
Visits from Cohere Training Crawler appear in your bot report under this exact name, never as an anonymous percentage, and every verdict stores the reason it was reached. Because this client never executes JavaScript, a browser-only tracker cannot see it at all; it is visible through server-side collection, which is how the visits reach your report.