Diyi Yang

Stanford turns raw screen recordings into task models that lift agent accuracy 30%

Stanford and CMU researchers' Task Model Induction (TMI) turns raw screen recordings into explicit task models, reconstructing 74.9% of execution steps versus 30.3% for the best baseline and lifting held-out agent-skill accuracy from 14.29% to 18.57%.