← Wall of Shame · Well-behaved crawlers
Tor onion service
anonymous
Every disallowed request from Tor onion service, by identity status. Clients with no known crawler user agent are listed as anonymous.
Totals by window
| Window | Hours held | Pages | Max depth | Bytes | Sessions | Read the rules | First seen | Last seen |
|---|---|---|---|---|---|---|---|---|
| 24h | 0.00 | 0 | 0 | 0 B | 0 | 0 | - | - |
| 7d | 0.08 | 5 | 0 | 12.2 kB | 5 | 0 | 2026-10-31 07:08Z | 2026-10-31 07:09Z |
| 30d | 0.17 | 10 | 0 | 25.1 kB | 10 | 0 | 2026-10-23 10:28Z | 2026-10-31 07:09Z |
| all | 0.17 | 10 | 0 | 25.1 kB | 10 | 0 | 2026-10-23 10:28Z | 2026-10-31 07:09Z |
"Read the rules" counts sessions that fetched robots.txt before their first disallowed page.
By identity
| Name | Status | Hours all | Pages | Max depth | Sessions | Last seen |
|---|---|---|---|---|---|---|
| (no known crawler UA) | anonymous | 0.17 | 10 | 0 | 10 | 2026-10-31 07:09Z |
Observed traits
What these clients sent and how they walked the maze, from the raw logs we keep (the last 90 days). Each line is an observation, not a verdict on who or what a client is (how they are measured). A client is one address with one user agent; 10 clients here.
None of the traits we look for.
Fastest pace: 1 disallowed page within one minute from one client.
Daily
Pages per day, last 90 days (peak 5).
| Day (UTC) | Pages | Hours held | Bytes | Sessions |
|---|---|---|---|---|
| 2026-10-31 | 5 | 0.08 | 12.2 kB | 5 |
| 2026-10-23 | 5 | 0.08 | 12.9 kB | 5 |
Top user agents
| User agent | Pages |
|---|---|
Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:128.0) Gecko/20100101 Firefox/128.0 | 10 |
Networks
Shown as /24 (IPv4) or /48 (IPv6) networks. Individual addresses are only ever published for verified crawlers.
Sample paths
Recent disallowed URLs fetched, most recent first.
/lawn/aaj6bre6islbuajzqq/lawn/acgz23do5mwrtdpm4i/lawn/aayv7tvrbjffvi5ff4/lawn/abgsgjlgbqnstoqjki/lawn/adcj2mgtn5c5uyujce
Generated 2026-11-02 10:03 UTC.