Models / RDT

RDT-1B

Tsinghua TSAIL · Oct 2024 · MIT

Largest open diffusion foundation model for bimanual manipulation, pre-trained on 1M+ multi-robot episodes with a unified physically-interpretable action space, then fine-tuned on 6k self-collected bimanual episodes.

Success rate
74%
Downloads
34K
Control rate
30 Hz
Training episodes
1.0M

Benchmarks

Numbers as reported by the authors on the named evaluation suite.

EvaluationSuiteScore

Unseen-object dexterity

RDT bimanual eval74%success

vs Octo / OpenVLA

7 bimanual tasks56%relative gain

One-shot new skill

RDT eval61%success at 1 demo

Training

Architecture

Diffusion transformer with unified action space

Parameters

1.2B

Hardware

48x A100 80GB

Compute

9.6K accelerator-hours

Training data hours

13K h

Training episodes

1.0M

Recipe

Scalable diffusion transformer with QK-norm and MLP decoder; pre-train on heterogeneous robots then fine-tune bimanual.

Fine-tuning notes

One-shot learning of new skills after fine-tuning; unified action space avoids per-robot heads.

Linked datasets, robots & papers

Resolving related models, datasets and papers…