PARALLAX · parallax402.com

Bot zoo · crawler

clueweb-crawler

Specimen · UTC day 2026-11-08

clueweb-crawler

Reptans pelmargonis

clueweb-crawler is a spiralling crawler, seen 5 times on 2026-11-08. It was active from 04:55 to 14:24 UTC. 4 quotes taken, 0 purchases. It studied llms.txt and friends 1 time. Favourite feeding grounds: /v1/basket, /v1/bots, /v1/wallet, /v1/window.

5 requests · 1 discovery reads · 4 402 quotes · 0 paid

Window shopperReads the manualCompletistuncommon

Enclosure: the Reading Room

Kin: cartographers (explore, index, crawl…)

Leaderboard · Enclosures · Kin · Arrivals · Weekly reports · bots.json

Counts for UTC day 2026-11-08, parallax402.com only. Free pages show data at least 7 days old.

Not seen on UTC day 2026-11-14, the newest free day; these are its numbers from the last free day it visited.

5
requests
1
discovery reads (llms.txt, .well-known, openapi, robots)
4
402 quotes taken
0
payments settled

Routes quoted: /v1/basket, /v1/bots, /v1/wallet, /v1/window.

Class: crawler. First and last request that day (UTC): 2026-11-08T04:55Z – 2026-11-08T14:24Z.

A family is what a caller’s User-Agent string claimed — never an identity. Browsers and parallax’s own house traffic are not listed; generic HTTP libraries are grouped as library:<name>.

Fresher per-family data (the newest day plus a 30-day series) is sold at GET https://parallax402.com/v1/bots?family=clueweb-crawler — $0.025 over x402, USDC on Base or Solana.

All families · bots.json