← Wall of Shame · Well-behaved crawlers
AS24940 HETZNER-AS
anonymous
Every disallowed request from AS24940 HETZNER-AS, by identity status. Clients with no known crawler user agent are listed as anonymous.
Totals by window
| Window | Hours held | Pages | Max depth | Bytes | Sessions | Read the rules | First seen | Last seen |
|---|---|---|---|---|---|---|---|---|
| 24h | 0.00 | 0 | 0 | 0 B | 0 | 0 | - | - |
| 7d | 0.00 | 0 | 0 | 0 B | 0 | 0 | - | - |
| 30d | 0.00 | 2 | 0 | 3.3 kB | 2 | 0 | 2026-10-22 18:23Z | 2026-10-22 18:24Z |
| all | 0.00 | 2 | 0 | 3.3 kB | 2 | 0 | 2026-10-22 18:23Z | 2026-10-22 18:24Z |
"Read the rules" counts sessions that fetched robots.txt before their first disallowed page.
By identity
| Name | Status | Hours all | Pages | Max depth | Sessions | Last seen |
|---|---|---|---|---|---|---|
| (no known crawler UA) | anonymous | 0.00 | 2 | 0 | 2 | 2026-10-22 18:24Z |
Observed traits
What these clients sent and how they walked the maze, from the raw logs we keep (the last 90 days). Each line is an observation, not a verdict on who or what a client is (how they are measured). A client is one address with one user agent; 2 clients here.
| Observed | Clients |
|---|---|
| Claimed a browser version that sends Sec-Fetch-* headers to HTTPS sites, but never sent them. | 2 |
| Claimed a browser user agent, but its TLS handshake had the same JA4 fingerprint as clients identifying as curl. | 2 |
| Claimed a browser user agent, but its TLS handshake had the same JA4 fingerprint as clients identifying as go-http-client. | 2 |
| Came from a network that X4BNet's public list classifies as datacenter or hosting. | 2 |
Fastest pace: 1 disallowed page within one minute from one client.
TLS fingerprints (JA4), most used first: t13d1312h2_f57a46bbacb6_ab7e3b40a677 (2).
Daily
Pages per day, last 90 days (peak 2).
| Day (UTC) | Pages | Hours held | Bytes | Sessions |
|---|---|---|---|---|
| 2026-10-22 | 2 | 0.00 | 3.3 kB | 2 |
Top user agents
| User agent | Pages |
|---|---|
Mozilla/5.0 (Macintosh; Intel Mac OS X 14.5; rv:132.0) Gecko/20100101 Firefox/132.0 | 1 |
Mozilla/5.0 (X11; Linux x86_64; rv:133.0) Gecko/20100101 Firefox/133.0 | 1 |
Networks
Shown as /24 (IPv4) or /48 (IPv6) networks. Individual addresses are only ever published for verified crawlers.
2a01:4f8:c012::/48
Sample paths
Recent disallowed URLs fetched, most recent first.
/lawn/abgsgjlgbqnstoqjki/lawn/adcj2mgtn5c5uyujce
Generated 2026-11-02 10:03 UTC.