Metrics for Robot Proficiency Self-assessment and Communication of Proficiency in Human-robot Teams
Citations Over TimeTop 10% of 2022 papers
Abstract
As development of robots with the ability to self-assess their proficiency for accomplishing tasks continues to grow, metrics are needed to evaluate the characteristics and performance of these robot systems and their interactions with humans. This proficiency-based human-robot interaction (HRI) use case can occur before, during, or after the performance of a task. This article presents a set of metrics for this use case, driven by a four-stage cyclical interaction flow: (1) robot self-assessment of proficiency (RSA), (2) robot communication of proficiency to the human (RCP), (3) human understanding of proficiency (HUP), and (4) robot perception of the human’s intentions, values, and assessments (RPH). This effort leverages work from related fields including explainability, transparency, and introspection, by repurposing metrics under the context of proficiency self-assessment. Considerations for temporal level (a priori, in situ, and post hoc) on the metrics are reviewed, as are the connections between metrics within or across stages in the proficiency-based interaction flow. This article provides a common framework and language for metrics to enhance the development and measurement of HRI in the field of proficiency self-assessment.
Related Papers
- → ARROCH: Augmented Reality for Robots Collaborating with a Human(2021)33 cited
- → “Should I Follow the Human, or Follow the Robot?” — Robots in Power Can Have More Influence Than Humans on Decision-Making(2023)18 cited
- → Modelling User Experience in Human-Robot Interactions(2015)10 cited
- → Human-Robot Interaction and Collaborative Manipulation with Multimodal Perception Interface for Human(2019)6 cited
- → Investigation of a Human’s Opinion Affected by Social Influence of a Group Norm in a Human-Robot Group After a Human-Robot Scenario(2020)