← Wall of Shame · Well-behaved crawlers

AS396982 GOOGLE-CLOUD-PLATFORM

verifiedanonymous

Every disallowed request from AS396982 GOOGLE-CLOUD-PLATFORM, by identity status. Clients with no known crawler user agent are listed as anonymous.

Totals by window

WindowHours heldPagesMax depthBytesSessionsRead the rulesFirst seenLast seen
24h0.00000 B00--
7d0.0212019.7 kB202026-10-30 03:35Z2026-11-01 04:43Z
30d0.171160245.3 kB2062026-10-04 05:02Z2026-11-01 04:43Z
all152.8410950724.2 MB35162026-09-28 00:45Z2026-11-01 04:43Z

"Read the rules" counts sessions that fetched robots.txt before their first disallowed page.

By identity

NameStatusHours allPagesMax depthSessionsLast seen
Parallel Web Systemsverified152.661082273292026-10-02 21:43Z
(no known crawler UA)anonymous0.181280222026-11-01 04:43Z

Observed traits

What these clients sent and how they walked the maze, from the raw logs we keep (the last 90 days). Each line is an observation, not a verdict on who or what a client is (how they are measured). A client is one address with one user agent; 26 clients here.

ObservedClients
Claimed a browser user agent, but its TLS handshake did not offer HTTP/2. Mainstream browsers always offer it.14
Claimed a browser user agent, but used HTTP/1.1 over HTTPS although HTTP/2 was offered.15
Sent no Accept-Language header. Mainstream browsers always send one.5
Came from a network that X4BNet's public list classifies as datacenter or hosting.26
Claimed a browser user agent and fetched 10 or more pages over HTTPS without ever requesting /favicon.ico.1
Most of its requests got error responses.1

Fastest pace: 12 disallowed pages within one minute from one client.

TLS fingerprints (JA4), most used first: t13d181100_85036bcba153_d41ae481755e (14), t13d1711h2_5b57614c22b0_5894756fee65 (6), t13d1516h2_8daaf6152771_d8a2da3f94cd (1).

Daily

Pages per day, last 90 days (peak 6412).

Day (UTC)PagesHours heldBytesSessions
2026-11-0160.019.8 kB1
2026-10-3060.019.9 kB1
2026-10-2660.009.7 kB1
2026-10-25120.0133.3 kB2
2026-10-24300.0690.6 kB5
2026-10-2360.0210.4 kB1
2026-10-2260.0110.0 kB1
2026-10-2020.002.7 kB1
2026-10-1860.009.7 kB1
2026-10-1460.019.9 kB1
2026-10-1260.019.9 kB1
2026-10-1060.019.9 kB1
2026-10-0860.009.7 kB1
2026-10-0660.019.9 kB1
2026-10-0460.019.8 kB1
2026-10-02340.3972.3 kB7
2026-09-30641290.5814.1 MB220
2026-09-29438261.709.8 MB103
2026-09-2860.019.1 kB1

Top user agents

User agentPages
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.010822
Mozilla/5.0 (Linux; Android 12; Pixel 6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Mobile Safari/537.3686
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/153.0.0.0 Safari/537.36 Edg/153.0.0.042

Networks

Verified crawler addresses are shown individually; everything else as /24 (IPv4) or /48 (IPv6) networks.

8.231.187.0/24 23.251.146.115/32 34.9.172.22/32 34.31.203.120/32 34.44.142.114/32 34.44.196.215/32 34.45.55.180/32 34.46.138.166/32 34.68.39.29/32 34.70.129.79/32 34.83.94.0/24 34.122.173.216/32 34.146.33.0/24 35.185.241.0/24 35.185.243.0/24 35.227.147.0/24 136.67.68.0/24 136.67.111.0/24 136.67.227.0/24 136.69.249.0/24 136.86.176.0/24 136.87.20.0/24 136.117.221.0/24 136.118.81.0/24 136.118.86.0/24 136.118.177.0/24

Sample paths

Recent disallowed URLs fetched, most recent first.

Generated 2026-11-02 10:03 UTC.