Understanding procedural actions is important, as it can be used to automatically analyze the execution of a procedure and provide assistance to users by warning for potential mistakes or forgotten steps. However, current approaches require a rigid, step-by-step execution order, laborious and impractical datasets. Furthermore, they are unreliable to variations in viewpoint, or measure the performance of actions rather than the actual completion of actions. To address these limitations and stimulate research in this field, this work proposes the novel task of procedure state recognition (PSR) together with a set of evaluation metrics.
@inproceedings{schoonbeek2023beyond,
title={Beyond Action Recognition: Extracting Meaningful Information from Procedure Recordings},
author={Schoonbeek, Tim J and Onvlee, Hans and Frisco, Pierluigi and De With, Peter HN and Van der Sommen, Fons},
booktitle={2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)},
pages={881--882},
year={2023},
organization={IEEE}
}