Wall of Shame

Our robots.txt has one rule: stay out of /lawn/. Everyone below walked straight onto the grass anyway, so we kept them busy in an endless maze served a few bytes a second. The tables list only what our logs show: which client (as far as it can be verified), how many disallowed pages it fetched, and how long we held it.

Generated 2026-09-27 04:50 UTC. Rebuilt every few minutes. Also available as feed.json and blocklist.txt.

WindowBot-hoursPagesSessionsBytesMax depth
24h0.0161736 B0
7d0.0161736 B0
30d0.0161736 B0
all0.0161736 B0

1. Verified offenders

Real crawlers from named companies, verified by the vendor's own published method, that fetched paths robots.txt told them not to.

Nobody here yet.

2. Hall of Liars

User agents claiming to be a well-known crawler whose source addresses failed that crawler's published verification. Grouped by the name claimed and the network the requests actually came from.

Nobody here yet.

Claimed, unverifiable

User agents naming a crawler whose vendor publishes no way to check it. We can't confirm who these are, so nothing here is presented as confirmed. See the network each came from on its page.

Nobody here yet.

3. Top ASNs

Every violator, all statuses, added up by the network (ASN) the requests came from.

NetworkStatusHours 24hHours 7dHours 30dHours allPagesMax depthBytesSessionsFirst seenLast seen
AS16276 OVHanonymous0.010.010.010.0160736 B12026-09-27 04:33Z2026-09-27 04:33Z

4. Read the rules, ignored them

They fetched robots.txt, then fetched what it disallows in the same session.

NameStatusSessions: robots.txt then /lawn/SessionsPagesHours allLast seen
AS16276 OVHanonymous1160.012026-09-27 04:33Z

What the labels mean

verified
User agent matched a known crawler and the source address passed that vendor's published verification (reverse DNS or published IP ranges). Only these rows show individual IPs.
spoofed UA
User agent claimed a known crawler, but the source address failed that vendor's published verification. Grouped by the claimed name and the network the requests actually came from.
claimed, unverifiable
User agent claims a known crawler whose vendor publishes no verification method we could find. Not confirmed; attributed by network.
anonymous
No known crawler user agent. Attributed only to the network (ASN) the requests came from.

Networks other than verified crawlers are shown as a /24 (IPv4) or /48 (IPv6) at most. Hours held = total time our server spent serving disallowed pages to them. Pages = disallowed fetches. Sessions = runs of requests with gaps under 10m0s.