XetData

Show HN: We scaled Git to support 1 TB repos

XetData is active in the show hn launch space based in Seattle, WA.

Profile

I’ve been in the MLOps space for ~10 years, and data is still the hardest unsolved open problem. Code is versioned using Git, data is stored somewhere else, and context often lives in a 3rd location like Slack or GDocs. This is why we built XetHub, a platform that enables teams to treat data like code, using Git.Unlike Git LFS, we don’t just store the files. We use content-defined chunking and Merkle Trees to dedupe against everything in history. This allows small changes in large files to be stored compactly. Read more here: https://xethub.com/assets/docs/how-xet-deduplication-worksToday, XetHub works for 1 TB repositories, and we plan to scale to 100 TB in the next year. Our implementation

Within the show hn launch space, the company focuses on its core offering rather than a broad product line.

Seattle, WA is where the company is located.

It is recorded at the HackerNoon Startups of the Year stage.

Website: xethub.com