Help improve language coverage in Common Crawl
Show HN: Help improve language coverage in Common Crawl
Help improve language coverage in Common Crawl operates in show hn launch.
Profile
Hey HN, the Common Crawl Foundation is trying to expand the coverage of our crawl to more languages, regions and cultures, and if you speak a language other than English (LOTE) you can help!By validating Language Identification data (LangID or LID): https://dynabench.org/tasks/text-language-identificationBy contributing urls for our seed crawl: https://github.com/commoncrawl/web-languagesWe're also organizing a Workshop on Multilingual Data Quality Signals (WMDQS) with MLCommons and EleutherAI where we have a call for papers open (https://wmdqs.org/cfp/) and a upcoming shared task on language identification (https://wmdqs.org/shared-task/)
Within the show hn launch space, the company focuses on its core offering rather than a broad product line.
Directory data places it at the Show HN launch stage.
| Sector | Show HN launch |
|---|---|
| Stage | Show HN launch |
Website: dynabench.org/tasks/text-language-identificationBy
Browse related
Create a free account