Models / HPT

HPT-XLarge

MIT CSAIL / Meta · Sep 2024 · MIT

Learns a shared policy trunk across 52 heterogeneous datasets by tokenizing each robot proprioception and vision stream into a common latent, then attaching lightweight task heads.

Success rate
72%
Downloads
19K
Control rate
10 Hz
Training episodes
200K

Benchmarks

Numbers as reported by the authors on the named evaluation suite.

EvaluationSuiteScore

Transfer to unseen embodiment

HPT eval20pt gain vs from-scratch

Simulation average

HPT sim suite72%success

Real-world Franka tasks

HPT real66%success

Training

Architecture

Heterogeneous pre-trained transformer trunk

Parameters

1.1B

Hardware

32x V100/A100

Compute

6.5K accelerator-hours

Training data hours

4.2K h

Training episodes

200K

Recipe

Scaling study: trunk pre-training with embodiment-specific stems, then frozen-trunk transfer to new robots.

Fine-tuning notes

Frozen trunk + 20-demo head training beats full from-scratch training in low-data regimes.

Linked datasets, robots & papers

Resolving related models, datasets and papers…