The Crawler Zoo

See which bots are visiting a website right now, from GPTBot to Googlebot, and learn how to block them. Free.

web toolsnetwork toolsvisualizationseducationsecurity
Platforms
Web
Pricing Free

The Crawler Zoo is a live dashboard of the web crawlers and bots visiting its own site, laid out as a zoo. A gate count shows how many automated visitors came in today, sorted by how they treat robots.txt: those that respect it, those that read it and broke it, and those that broke it unread. A feed shows new arrivals as they come in.

Bots are grouped into enclosures such as the Search Engine Savanna, the AI Aviary, the SEO Swamp and the Link-Preview Petting Zoo, each listing species like Googlebot, GPTBot and ClaudeBot. There is a leaderboard and a Trap Room that logs bots caught on a disallowed path. You can also follow a bot through an endless labyrinth. The Tools section has a robots.txt generator and a page for blocking AI crawlers, with a guide to the visitors.

It is free to visit and needs no account. The page is in English and run by anonymous keepers.