| crawler | operator | pages | rate | amount |
|---|---|---|---|---|
| ClaudeBot | Anthropic model training |
18,674 | $0.01 | $186.74 |
| Googlebot | Google search indexing |
1,033 | $0.01 | $10.33 |
| Meta-ExternalAgent | Meta model training |
960 | $0.01 | $9.60 |
| Amazonbot | Amazon model training |
869 | $0.01 | $8.69 |
| Bingbot | Microsoft search indexing |
476 | $0.01 | $4.76 |
| GPTBot | OpenAI model training |
265 | $0.01 | $2.65 |
| Bytespider | ByteDance model training |
200 | $0.01 | $2.00 |
| Applebot | Apple search indexing |
180 | $0.01 | $1.80 |
| OAI-SearchBot | OpenAI AI answers (live retrieval) |
100 | $0.01 | $1.00 |
| PerplexityBot | Perplexity AI answers (live retrieval) |
95 | $0.01 | $0.95 |
| ChatGPT-User | OpenAI AI answers (live retrieval) |
61 | $0.01 | $0.61 |
| CCBot | Common Crawl model training |
40 | $0.01 | $0.40 |
| Claude-User | Anthropic AI answers (live retrieval) |
22 | $0.01 | $0.22 |
| DuckDuckBot | DuckDuckGo search indexing |
6 | $0.01 | $0.06 |
| Perplexity-User | Perplexity AI answers (live retrieval) |
1 | $0.01 | $0.01 |