In development · Early access 2027

Reinforcement-learning post-training
for language models

PolicyGrad makes it straightforward to run SFT, DPO and GRPO on open-weight models: define a reward, train a policy, evaluate it, and ship it to inference without stitching together a dozen research repos.

The problem

RL post-training works. Running it is still hard.

Teams that want a model tuned to their task end up hand-wiring trainers, reward functions, rollout servers and eval harnesses. Runs are expensive, unstable and hard to compare, and the gap between a research recipe and a production model is wide.

What we're building

One pipeline from base model to deployed policy

1

Managed training runs

Supervised fine-tuning, preference optimization (DPO) and online RL (GRPO) behind one API, with sensible defaults and reproducible configs.

2

Rewards & evaluation

Plug in verifiable rewards, model-graded rubrics or custom Python reward functions, and track every checkpoint against held-out evals.

3

Fast rollouts & inference

High-throughput generation built on vLLM for rollouts during training, and export to the same serving stack once a policy is ready.

How it works

Five steps

Bring a model

Start from an open-weight base or instruct model.

Add data

Prompts, demonstrations or preference pairs.

Define the reward

Checkers, rubrics or your own scoring code.

Train & evaluate

Run SFT → DPO → GRPO and compare checkpoints.

Ship

Export weights or serve the policy directly.

Early access

Working on RL for your models?

We're onboarding a small group of early users in 2027. Tell us what you're training and we'll reach out.