LLM Data
3AI tools in the LLM Data category
IBM data-prep-kit
A
Open-Source Toolkit for Efficient Unstructured Data Processing with Pre-built Modules and Local to Cluster Scalability.
AgentLLM Data
9131 dir
Datatrove
A
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
...moreAgentLLM Data
3K1 dir
FastDatasets
A
A powerful tool for creating high-quality training datasets for Large Language Models
AgentLLM Data
1851 dir