Pixilab
Home › Companies › Show HN launch › CrawlerCheck v1.5 – Operators Directory and 25 new AI crawlers

CrawlerCheck v1.5 – Operators Directory and 25 new AI crawlers

Show HN: CrawlerCheck v1.5 – Operators Directory and 25 new AI crawlers

Based, CrawlerCheck v1.5 – Operators Directory and 25 new AI crawlers works in show hn launch.

Profile

Since the last Show HN 7 months ago, I've shipped some major updates:• Operators Directory – browse 160+ crawlers by company (Google, OpenAI, Anthropic, etc.). See all their bots, safety stats, and official docs in one place.• Enhanced crawler profiles with "Blocking Impact" analysis and common use cases• Added 25+ new AI crawlers including latest models and scrapers• Bulk robots.txt generator – generate allow/block rules for all filtered bots in one click• RFC 9309 strict compliance – mimics Googlebot's exact "Longest Match" logicThe tool now helps answer "who owns CCBot?" or "show me all OpenAI crawlers" which came up a lot in the original thread.Still built with Go + Svelte, still free, n

As a business in show hn launch, CrawlerCheck v1.5 – Operators Directory and 25 new AI crawlers is listed here with the public details available about it.

Its current recorded stage is Show HN launch.

SectorShow HN launch
StageShow HN launch

Website: crawlercheck.com

Browse related

Full contact details are available to registered Pixilab members.
Create a free account