Recommended Practice for The Evaluation of Artificial Intelligence (AI) Dialogue System Capabilities

Abstract

This recommended practice establishes an evaluation framework for the capabilities of artificial intelligence dialogue systems such as chatbots, consulting terminals, or operation interfaces. The recommended practice defines and classifies the types and levels of the intelligence capabilities according to a checklist of criteria. The checklist tables describe the criteria used to determine the level that a dialogue system achieves based on the analysis of behavior and performance.

General Information

ICT rolling plan topic: Citiverse

SDO: IEEE

Latest publishied version: https://standards.ieee.org/ieee/3128/10746/