Pixilab
Home › Companies › Show HN launch › Help improve language coverage in Common Crawl

Help improve language coverage in Common Crawl

Show HN: Help improve language coverage in Common Crawl

Help improve language coverage in Common Crawl operates in show hn launch.

Profile

Hey HN, the Common Crawl Foundation is trying to expand the coverage of our crawl to more languages, regions and cultures, and if you speak a language other than English (LOTE) you can help!By validating Language Identification data (LangID or LID): https://dynabench.org/tasks/text-language-identificationBy contributing urls for our seed crawl: https://github.com/commoncrawl/web-languagesWe're also organizing a Workshop on Multilingual Data Quality Signals (WMDQS) with MLCommons and EleutherAI where we have a call for papers open (https://wmdqs.org/cfp/) and a upcoming shared task on language identification (https://wmdqs.org/shared-task/)

Within the show hn launch space, the company focuses on its core offering rather than a broad product line.

Directory data places it at the Show HN launch stage.

SectorShow HN launch
StageShow HN launch

Website: dynabench.org/tasks/text-language-identificationBy

Browse related

Contact details and direct channels are available to signed-in members.
Create a free account