Models / RT-1

RT-1

Google Robotics · Dec 2022 · Apache-2.0 (code)

The original Robotics Transformer: 35M parameters, 3 Hz closed-loop control, trained on 130k teleoperated episodes across 700+ kitchen tasks.

Success rate
97%
Downloads
29K
Control rate
3 Hz
Training episodes
130K

Benchmarks

Numbers as reported by the authors on the named evaluation suite.

EvaluationSuiteScore

Seen tasks

RT-1 eval (700 tasks)97%success

Unseen tasks

RT-1 eval76%success

Distractor robustness

RT-1 eval83%success

Long-horizon SayCan

Kitchen SayCan67%success

Training

Architecture

EfficientNet-B3 + TokenLearner + Transformer

Parameters

35M

Hardware

64x TPU v3

Compute

5.1K accelerator-hours

Training data hours

2.9K h

Training episodes

130K

Recipe

Behaviour cloning with token-level cross-entropy over 256 action bins; TokenLearner compresses to 8 tokens/frame for 3 Hz inference.

Fine-tuning notes

Adding Kuka bin-picking and sim data raised unseen-task success without hurting seen tasks.

Linked datasets, robots & papers

Resolving related models, datasets and papers…