← Wall of Shame · Well-behaved crawlers
AS396982 GOOGLE-CLOUD-PLATFORM
verifiedanonymous
Every disallowed request from AS396982 GOOGLE-CLOUD-PLATFORM, by identity status. Clients with no known crawler user agent are listed as anonymous.
Totals by window
| Window | Hours held | Pages | Max depth | Bytes | Sessions | Read the rules | First seen | Last seen |
|---|---|---|---|---|---|---|---|---|
| 24h | 0.00 | 0 | 0 | 0 B | 0 | 0 | - | - |
| 7d | 0.02 | 12 | 0 | 19.7 kB | 2 | 0 | 2026-10-30 03:35Z | 2026-11-01 04:43Z |
| 30d | 0.17 | 116 | 0 | 245.3 kB | 20 | 6 | 2026-10-04 05:02Z | 2026-11-01 04:43Z |
| all | 152.84 | 10950 | 7 | 24.2 MB | 351 | 6 | 2026-09-28 00:45Z | 2026-11-01 04:43Z |
"Read the rules" counts sessions that fetched robots.txt before their first disallowed page.
By identity
| Name | Status | Hours all | Pages | Max depth | Sessions | Last seen |
|---|---|---|---|---|---|---|
| Parallel Web Systems | verified | 152.66 | 10822 | 7 | 329 | 2026-10-02 21:43Z |
| (no known crawler UA) | anonymous | 0.18 | 128 | 0 | 22 | 2026-11-01 04:43Z |
Observed traits
What these clients sent and how they walked the maze, from the raw logs we keep (the last 90 days). Each line is an observation, not a verdict on who or what a client is (how they are measured). A client is one address with one user agent; 26 clients here.
| Observed | Clients |
|---|---|
| Claimed a browser user agent, but its TLS handshake did not offer HTTP/2. Mainstream browsers always offer it. | 14 |
| Claimed a browser user agent, but used HTTP/1.1 over HTTPS although HTTP/2 was offered. | 15 |
| Sent no Accept-Language header. Mainstream browsers always send one. | 5 |
| Came from a network that X4BNet's public list classifies as datacenter or hosting. | 26 |
| Claimed a browser user agent and fetched 10 or more pages over HTTPS without ever requesting /favicon.ico. | 1 |
| Most of its requests got error responses. | 1 |
Fastest pace: 12 disallowed pages within one minute from one client.
TLS fingerprints (JA4), most used first: t13d181100_85036bcba153_d41ae481755e (14), t13d1711h2_5b57614c22b0_5894756fee65 (6), t13d1516h2_8daaf6152771_d8a2da3f94cd (1).
Daily
Pages per day, last 90 days (peak 6412).
| Day (UTC) | Pages | Hours held | Bytes | Sessions |
|---|---|---|---|---|
| 2026-11-01 | 6 | 0.01 | 9.8 kB | 1 |
| 2026-10-30 | 6 | 0.01 | 9.9 kB | 1 |
| 2026-10-26 | 6 | 0.00 | 9.7 kB | 1 |
| 2026-10-25 | 12 | 0.01 | 33.3 kB | 2 |
| 2026-10-24 | 30 | 0.06 | 90.6 kB | 5 |
| 2026-10-23 | 6 | 0.02 | 10.4 kB | 1 |
| 2026-10-22 | 6 | 0.01 | 10.0 kB | 1 |
| 2026-10-20 | 2 | 0.00 | 2.7 kB | 1 |
| 2026-10-18 | 6 | 0.00 | 9.7 kB | 1 |
| 2026-10-14 | 6 | 0.01 | 9.9 kB | 1 |
| 2026-10-12 | 6 | 0.01 | 9.9 kB | 1 |
| 2026-10-10 | 6 | 0.01 | 9.9 kB | 1 |
| 2026-10-08 | 6 | 0.00 | 9.7 kB | 1 |
| 2026-10-06 | 6 | 0.01 | 9.9 kB | 1 |
| 2026-10-04 | 6 | 0.01 | 9.8 kB | 1 |
| 2026-10-02 | 34 | 0.39 | 72.3 kB | 7 |
| 2026-09-30 | 6412 | 90.58 | 14.1 MB | 220 |
| 2026-09-29 | 4382 | 61.70 | 9.8 MB | 103 |
| 2026-09-28 | 6 | 0.01 | 9.1 kB | 1 |
Top user agents
| User agent | Pages |
|---|---|
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0 | 10822 |
Mozilla/5.0 (Linux; Android 12; Pixel 6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Mobile Safari/537.36 | 86 |
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/153.0.0.0 Safari/537.36 Edg/153.0.0.0 | 42 |
Networks
Verified crawler addresses are shown individually; everything else as /24 (IPv4) or /48 (IPv6) networks.
8.231.187.0/24 23.251.146.115/32 34.9.172.22/32 34.31.203.120/32 34.44.142.114/32 34.44.196.215/32 34.45.55.180/32 34.46.138.166/32 34.68.39.29/32 34.70.129.79/32 34.83.94.0/24 34.122.173.216/32 34.146.33.0/24 35.185.241.0/24 35.185.243.0/24 35.227.147.0/24 136.67.68.0/24 136.67.111.0/24 136.67.227.0/24 136.69.249.0/24 136.86.176.0/24 136.87.20.0/24 136.117.221.0/24 136.118.81.0/24 136.118.86.0/24 136.118.177.0/24
Sample paths
Recent disallowed URLs fetched, most recent first.
/lawn/aaj6bre6islbuajzqq/lawn/aayv7tvrbjffvi5ff4/lawn/acgz23do5mwrtdpm4i/lawn/adcj2mgtn5c5uyujce/lawn/abgsgjlgbqnstoqjki
Generated 2026-11-02 10:03 UTC.