Papers / NeurIPS 2024

Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers

Wang, Xu, Zhu et al. · MIT CSAIL · arXiv:2409.20537

220 citations Read paper Code

Aligns proprioception and vision from 52 heterogeneous datasets into a shared latent token space and shows scaling behaviour for a transferable policy trunk.

What this paper connects

Resolving related models, datasets and papers…