Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On · Paper · Project page · Code
The input videos are preprocessed in advance (hand reconstruction, retargeting to each robot hand, arm masks) due to the time limits of this Space. To run RoboTryOn on your own videos, see the code.