GPU-accelerated toolkit for building repeatable pipelines that filter, deduplicate and transform large text, image, video and audio datasets for AI training.
1.8K351PythonApache-2.0Updated 7 hours ago
#data-curation
Curated GitHub repositories related to data-curation, with AI summaries and key stats.
GPU-accelerated toolkit for building repeatable pipelines that filter, deduplicate and transform large text, image, video and audio datasets for AI training.