video-learning tagged posts

Robots learn new skills from a single video—in just 29 seconds

Framework could teach robots new skills from a single video
Robots acquire manipulation skills in seconds from a single human video. (A) Current methods teach a robot new skills through a cumbersome training-time loop that is costly and slow, and erodes previously mastered skills. HOST instead acquires skills at inference time, each from a single human video, averaging 29 seconds, while retaining its previously mastered skills. (B) Skill acquisition from a single human video confronts a structural mismatch between video demonstration and execution. Temporal asynchrony between the two decouples the prediction target from the video demonstration, while state discrepancies hinder the translation of the observed behavior into action...
Read More