Papers / CoRL 2023

RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control

Brohan et al. · Google DeepMind · arXiv:2307.15818

1,900 citations Read paper

Co-fine-tunes internet-scale vision-language models on robot trajectories, emitting actions as text tokens and inheriting semantic reasoning about unseen objects and instructions.

What this paper connects

Resolving related models, datasets and papers…