4x faster Deep Learning training – we replaced the DataLoader with Rust

Show HN: 4x faster Deep Learning training – we replaced the DataLoader with Rust

4x faster Deep Learning training – we replaced the DataLoader with Rust is a company in show hn launch.

Profile

Hi HN, We built a drop-in replacement for torch.utils.data.DataLoader in Rust.The Problem: Python's multiprocessing isolates workers, meaning every batch incurs IPC and pickling overhead. Even on a T4, the CPU bottlenecks and the GPU sits idle.The Solution: We bypass Python's data plane entirely. Rust Backend: Uses native threads (no GIL, no heavy process forking). Zero-Copy: Memory-mapped custom format (.kt) creates views into tensors without deserialization.Benchmarks (ResNet-18 / ImageWoof, Tesla T4, batch=64): Loader Throughput Speedup (Time taken per epoch/Total number of images) PyTorch ImageFolder 116 img/s 1.0x MosaicML Streaming 179 img/s 1.5x NVIDIA DALI 246 img/s 2.1x Kuattree (Ou

4x faster Deep Learning training – we replaced the DataLoader with Rust is positioned in show hn launch, a segment that rewards a clear, focused offering.

Directory data places it at the Show HN launch stage.

Website: www.kuatlabs.comHappy