Index-free full-text search that's fast enough for practical use
Show HN: Index-free full-text search that's fast enough for practical use
Based, Index-free full-text search that's fast enough for practical use works in show hn launch.
Profile
After 30 years of development, I've finally cracked the index-free search performance problem.The usual tradeoff: - Indexed search (Lucene, dtSearch) = fast queries, slow setup, storage overhead - Direct search = no setup, too slow for >10GBMy approach: Multi-threaded direct search with intelligent caching. Result: 50GB searched in ~20s on a mid-range Ryzen 5 (5600, 16GB, SSD).Technical details: - Format-agnostic byte-by-byte text extraction (finds text regardless of file format) - Producer-consumer pattern for directory traversal - PDF/OCR cache (0.2% overhead vs. 2-5% for full indexes) - Recursive archive handling (ZIP in ZIP in email) - Scales linearly with CPU coresBenchmark vs. commerci
The company sits in the show hn launch segment, where it competes on its core product or service.
Directory data places it at the Show HN launch stage.
| Sector | Show HN launch |
|---|---|
| Stage | Show HN launch |
Website: www.dateisuche.de/en
Browse related
Create a free account