What actually improved your success rate the most last quarter?
Trying to settle an argument in our group.
More real episodes48%
Better teleop operators21%
Bigger model13%
Improved reward/labels18%
2,950 votes · poll open
@a-kowalski · Research Engineer · Kraków, PL
Reproducing published success rates on real hardware. Results vary.
Trying to settle an argument in our group.
2,950 votes · poll open
Six papers, real hardware, same tasks. Median gap is 14 points. The two that matched both published their failure episodes.