Trawl – LLM-powered web scraper that calls the AI once

Show HN: Trawl – LLM-powered web scraper that calls the AI once - runs pure Go

Based, Trawl – LLM-powered web scraper that calls the AI once works in show hn launch.

Profile

Every scraper I've written has the same failure mode: it works for three months, a site redesigns, and my CSS selectors silently return empty strings. The data is still right there on the page — a human can find it instantly — but the scraper is blind.Trawl fixes this by splitting the problem. You describe what you want: trawl "https://books.toscrape.com" --fields "title, price, rating, in_stock" The LLM (Claude) looks at one sample item and derives a full extraction strategy — CSS selectors, attribute mappings, type coercion, fallback selectors. That strategy gets cached. Every subsequent page with the same structure is extracted with pure Go + goquery. No API calls, no token cost, full con

Trawl – LLM-powered web scraper that calls the AI once is positioned in show hn launch, a segment that rewards a clear, focused offering.

It is recorded at the Show HN launch stage.

Website: books.toscrape.com