Open-Source Toolkit for Efficient Unstructured Data Processing with Pre-built Modules and Local to Cluster Scalability.
Cross-referenced across 55 tracked directories
#2820
Popularity Rank
1 / 55
Listed In
Emerging
Adoption Stage
4/8/2024
Created
913
GitHub Stars
247
Forks
224
Open Issues
3/13/2026
Last Commit
Recently added to the ecosystem
Score: 100/100
0 dependency vulnerabilities found
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
...moreA powerful tool for creating high-quality training datasets for Large Language Models