TurboLoader Benchmark Dashboard

High-Performance ML Data Loading - Real-Time Performance Analytics

10,146
Peak Throughput (img/s)
12x
vs PyTorch Optimized
52+
Gbps Local I/O
19
SIMD Transforms

Benchmark Configuration

Framework Throughput Comparison
Throughput vs Number of Workers
Throughput vs Batch Size
Memory Usage Comparison
CPU Utilization

Key Features

SIMD Acceleration
19 data augmentation transforms with AVX2/NEON SIMD acceleration for maximum throughput. Includes AutoAugment policies for ImageNet, CIFAR10, and SVHN.
Lock-Free Architecture
Custom SPSC (Single Producer Single Consumer) queues with zero-copy design. No mutex contention for maximum parallelism.
Multi-Format Support
Images (JPEG, PNG, WebP), video (H.264, HEVC), tabular data (CSV, Parquet). WebDataset TAR format with remote storage (HTTP, S3, GCS).
GPU Integration
Direct PyTorch/TensorFlow/JAX tensor conversion. Optional GPU-accelerated JPEG decoding with nvJPEG for ultra-low latency.