Search

LLM application: InternLM2-1.8|7|20B

LLM application: InternLM-Math-7B|20B

LLM application: InternLM-XComposer2-1.8|7B

LLM application: InternVL-2|6|14|26

LLM application: Moonlight-A3B

LLM application: Kimi-VL-A3B

Open-Source Toolkit for Efficient Unstructured Data Processing with Pre-built Modules and Local to Cluster Scalability.

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

A powerful tool for creating high-quality training datasets for Large Language Models

a lightweight LLM evaluation suite that Hugging Face has been using internally.

Eval tools by OpenAI.

a repository for evaluating open language models.

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

a lean, efficient, and easy-to-hack codebase to research LLMs.

Minimalistic large language model 3D-parallelism training.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Ongoing research training transformer models at scale.

A native PyTorch Library for large model training.

DeepSpeed version of NVIDIA's Megatron-LM that adds additional support for several features such as MoE model training, Curriculum Learning, 3D Parallelism, and others.

A Native-PyTorch Library for LLM Fine-tuning.