Anthropic2
Try Distillery

Research

We study when smaller models are genuinely better deployment choices—and build the systems needed to find out.

01

Compact models

We study when one smaller model can preserve useful behavior across multiple tasks without hiding specialists behind a router.

02

Distillation systems

We make method selection, provenance, manifests, and portable artifacts explicit enough to inspect and reproduce.

03

Model evaluation

We combine quality, uncertainty, out-of-distribution behavior, systems measurements, and deployment economics in one release decision.

04

Synthetic environments

We generate latent finance worlds before rendering prompts so accounting invariants and held-out regimes remain machine-checkable.

Featured work

TinyRamp

Model 001 · July 2026

Can a 0.5B model handle two finance tasks with one set of weights—and justify the cost of making it?

Explore TinyRamp
Amazon Nova Pro teacherNova
TinyRamp · Qwen2.5-0.5B student0.5B

Our default result can be: do not distill.

A completed training job is not evidence that a model should ship. Our experiments preserve losing arms, record the first failed gate, and keep quality claims bounded to frozen data and declared assumptions.

Read the experiment