Advanced Linguistic Explanations of Classifier Decisions for Operators' Annotation Support

We propose several new concepts for providing enhanced explanations of classifier decisions in linguistic (human readable) form. These are intended to help operators to better understand the decision process and support them during sample annotation to improve their certainty and consistency in successive labeling cycles. This is expected to lead to better, more consistent data sets (streams) for use in training and updating classifiers. The enhanced explanations are composed of 1) grounded reasons for classification decisions, represented as linguistically readable fuzzy rules, 2) a classifier’s level of uncertainty in relation to its decisions and possible alternative suggestions, 3) the degree of novelty of current samples and 4) the levels of impact of the input features on the current classification response. The last of these are also used to reduce the lengths of the rules to a maximum of 3 to 4 antecedent parts to ensure readability for operators and users. The proposed techniques were embedded within an annotation GUI and applied to a realworld application scenario from the field of visual inspection. The usefulness of the proposed linguistic explanations was evaluated based on experiments conducted with six operators. The results indicate that there is approximately an 80% chance that operator/ user labeling behavior improves significantly when enhanced linguistic explanations are provided, whereas this chance drops to 10% when only the classifier responses are shown.