← Wall of Shame · Well-behaved crawlers
AS51167 CONTABO
anonymous
Every disallowed request from AS51167 CONTABO, by identity status. Clients with no known crawler user agent are listed as anonymous.
Totals by window
| Window | Hours held | Pages | Max depth | Bytes | Sessions | Read the rules | First seen | Last seen |
|---|---|---|---|---|---|---|---|---|
| 24h | 0.00 | 0 | 0 | 0 B | 0 | 0 | - | - |
| 7d | 0.00 | 0 | 0 | 0 B | 0 | 0 | - | - |
| 30d | 0.01 | 4 | 6 | 7.6 kB | 4 | 0 | 2026-10-08 21:46Z | 2026-10-23 08:45Z |
| all | 0.01 | 4 | 6 | 7.6 kB | 4 | 0 | 2026-10-08 21:46Z | 2026-10-23 08:45Z |
"Read the rules" counts sessions that fetched robots.txt before their first disallowed page.
By identity
| Name | Status | Hours all | Pages | Max depth | Sessions | Last seen |
|---|---|---|---|---|---|---|
| (no known crawler UA) | anonymous | 0.01 | 4 | 6 | 4 | 2026-10-23 08:45Z |
Observed traits
What these clients sent and how they walked the maze, from the raw logs we keep (the last 90 days). Each line is an observation, not a verdict on who or what a client is (how they are measured). A client is one address with one user agent; 4 clients here.
| Observed | Clients |
|---|---|
| Claimed a browser version that sends Sec-Fetch-* headers to HTTPS sites, but never sent them. | 1 |
| Claimed a browser user agent, but its TLS handshake had the same JA4 fingerprint as clients identifying as curl. | 1 |
| Claimed a browser user agent, but its TLS handshake had the same JA4 fingerprint as clients identifying as go-http-client. | 1 |
| Came from a network that X4BNet's public list classifies as datacenter or hosting. | 4 |
Fastest pace: 1 disallowed page within one minute from one client.
TLS fingerprints (JA4), most used first: t13d1516h2_8daaf6152771_02713d6af862 (3), t13d1312h2_f57a46bbacb6_ab7e3b40a677 (1).
Daily
Pages per day, last 90 days (peak 1).
| Day (UTC) | Pages | Hours held | Bytes | Sessions |
|---|---|---|---|---|
| 2026-10-23 | 1 | 0.00 | 2.2 kB | 1 |
| 2026-10-21 | 1 | 0.00 | 1.5 kB | 1 |
| 2026-10-20 | 1 | 0.00 | 2.1 kB | 1 |
| 2026-10-08 | 1 | 0.00 | 1.9 kB | 1 |
Top user agents
| User agent | Pages |
|---|---|
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/144.0.0.0 Safari/537.36 | 2 |
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/145.0.0.0 Safari/537.36 | 1 |
Mozilla/5.0 (Macintosh; Intel Mac OS X 13_6_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/129.0.0.0 Safari/537.36 | 1 |
Networks
Shown as /24 (IPv4) or /48 (IPv6) networks. Individual addresses are only ever published for verified crawlers.
169.58.34.0/24 207.180.233.0/24 2a02:c207:2346::/48
Sample paths
Recent disallowed URLs fetched, most recent first.
/lawn/azurv76g5q6tsmpi3btcljat/lawn/a32we4irngr6fkltgkzhnody/lawn/auvkqezrp4b7h5iogti3rt4x/lawn/adcj2mgtn5c5uyujce
Generated 2026-11-02 10:03 UTC.