Megatron-LM

Train transformer language models with reinforcement learning.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

veRL is a flexible and efficient RL framework for LLMs.

A simple, performant and scalable Jax LLM!