Technical Metrics Used to Evaluate Health Care Chatbots: Scoping Review
Journal of Medical Internet Research2020Vol. 22(6), pp. e18301–e18301
Citations Over TimeTop 10% of 2020 papers
Abstract
The technical metrics of health chatbot studies were diverse, with survey designs and global usability metrics dominating. The lack of standardization and paucity of objective measures make it difficult to compare the performance of health chatbots and could inhibit advancement of the field. We suggest that researchers more frequently include metrics computed from conversation logs. In addition, we recommend the development of a framework of technical metrics with recommendations for specific circumstances for their inclusion in chatbot studies.
Related Papers
- → Examination of Ethical Principles for LLM-Based Recommendations in Conversational AI(2023)19 cited
- → Smart Multi-linguistic Health Awareness System using RASA Model(2023)7 cited
- → College Agent: The Machine Learning Chatbot for College Tasks(2022)6 cited
- The Road of China' s IT Terminology Standardization Evolvement(2002)
- On the Issue of Understanding the Work of Terminology Standardization(2007)