← Wall of Shame · Well-behaved crawlers
AS16509 AMAZON-02
anonymous
Every disallowed request from AS16509 AMAZON-02, by identity status. Clients with no known crawler user agent are listed as anonymous.
Totals by window
| Window | Hours held | Pages | Max depth | Bytes | Sessions | Read the rules | First seen | Last seen |
|---|---|---|---|---|---|---|---|---|
| 24h | 0.00 | 0 | 0 | 0 B | 0 | 0 | - | - |
| 7d | 0.00 | 0 | 0 | 0 B | 0 | 0 | - | - |
| 30d | 0.00 | 3 | 6 | 5.7 kB | 3 | 0 | 2026-10-21 11:55Z | 2026-10-23 13:06Z |
| all | 0.00 | 3 | 6 | 5.7 kB | 3 | 0 | 2026-10-21 11:55Z | 2026-10-23 13:06Z |
"Read the rules" counts sessions that fetched robots.txt before their first disallowed page.
By identity
| Name | Status | Hours all | Pages | Max depth | Sessions | Last seen |
|---|---|---|---|---|---|---|
| (no known crawler UA) | anonymous | 0.00 | 3 | 6 | 3 | 2026-10-23 13:06Z |
Observed traits
What these clients sent and how they walked the maze, from the raw logs we keep (the last 90 days). Each line is an observation, not a verdict on who or what a client is (how they are measured). A client is one address with one user agent; 3 clients here.
| Observed | Clients |
|---|---|
| Came from a network that X4BNet's public list classifies as datacenter or hosting. | 3 |
Fastest pace: 1 disallowed page within one minute from one client.
TLS fingerprints (JA4), most used first: t13d1516h2_8daaf6152771_02713d6af862 (2), t13d1517h2_8daaf6152771_b1ff8ab2d16f (1).
Daily
Pages per day, last 90 days (peak 2).
| Day (UTC) | Pages | Hours held | Bytes | Sessions |
|---|---|---|---|---|
| 2026-10-23 | 2 | 0.00 | 3.4 kB | 2 |
| 2026-10-21 | 1 | 0.00 | 2.3 kB | 1 |
Top user agents
| User agent | Pages |
|---|---|
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/142.0.0.0 Safari/537.36 | 1 |
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/145.0.0.0 Safari/537.36 | 1 |
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/145.0.0.0 Safari/537.36 Edg/145.0.0.0 | 1 |
Networks
Shown as /24 (IPv4) or /48 (IPv6) networks. Individual addresses are only ever published for verified crawlers.
15.220.152.0/24 18.194.169.0/24 63.184.130.0/24
Sample paths
Recent disallowed URLs fetched, most recent first.
/lawn/azjb7e7yzy3ehmg7assqccio/lawn/a3j5at7xoqva5yxdy55id65r/lawn/1986/15/12/axxjeobuwm7mhci2deg2chch
Generated 2026-11-02 10:03 UTC.