Popular GitHub Repositories for Dataloader

The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAX

PyTorch implementation of the CVPR 2019 paper “Pyramid Feature Attention Network for Saliency Detection”

A natively parallel dataloader for Python, written in Rust. Serving data at GB/s speeds, while covering aspect ratio bucketing, crop and resize for image ML workloads.

Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)

Load & manage evolving datasets efficiently

A utility for wrapping the Free Spoken Digit Dataset into PyTorch-ready data set splits.

A ready-to-use pytorch dataloader for audio classification, speech classification, speaker recognition, etc. with in-GPU augmentations

[BETA] Easy-to-use pytorch model trainer, dataloader creators, and utilities + my own implementations of select models

A Python Project that aims to create a custom Data Loader for the Tight Learned Intertial Odometry (TLIO) model with MOCAP and IMU inputs

Audio data loading and augmentations in JAX

bash script and pytorch implementation for Word2vec models

A memory-efficient streaming data loader designed for LLM pretraining under limited CPU and GPU memory constraints

Text Summarization using Pre-Trained T5 on News Dataset

Optimizing PyTorch Model Training by Wrapping Memory Mapped Tensors on Nvidia GPUs with TensorDict.

This model was designed around Pycoco's dataset, the CNN model constructed outputs training loss graphs and a confusion matrix for the network of interest