Assessing the Impact of Expert Labelling of Training Data on the Quality of Automatic Classification of Lithological Groups Using Artificial Neural Networks

2020
Yan Kuchin, Ravil Mukhamediev, Kirill Yakunin, Jānis Grundspeņķis, Adilkhan Symagulov

Machine learning (ML) methods are nowadays widely used to automate geophysical study. Some of ML algorithms are used to solve lithological classification problems during uranium mining process. One of the key aspects of using classical ML methods is causing data features and estimating their influence on the classification. This paper presents a quantitative assessment of the impact of expert opinions on the classification process. In other words, we have prepared the data, identified the experts and performed a series of experiments with and without taking into account the fact that the expert identifier is supplied to the input of the automatic classifier during training and testing. Feedforward artificial neural network (ANN) has been used as a classifier. The results of the experiments show that the “knowledge” of the ANN of which expert interpreted the data improves the quality of the automatic classification in terms of accuracy (by 5 %) and recall (by 20 %). However, due to the fact that the input parameters of the model may depend on each other, the SHapley Additive exPlanations (SHAP) method has been used to further assess the impact of expert identifier. SHAP has allowed assessing the degree of parameter influence. It has revealed that the expert ID is at least two times more influential than any of the other input parameters of the neural network. This circumstance imposes significant restrictions on the application of ANNs to solve the task of lithological classification at the uranium deposits.

Keywords
Assessment of expert influence, lithology, machine learning, SHAP, uranium mining
DOI
10.2478/acss-2020-0016

Kuchin, Y., Mukhamediev, R., Yakunin, K., Grundspeņķis, J., Symagulov, A. Assessing the Impact of Expert Labelling of Training Data on the Quality of Automatic Classification of Lithological Groups Using Artificial Neural Networks. Applied Computer Systems, 2020, Vol. 25, No. 2, pp. 145-152. ISSN 2255-8683. e-ISSN 2255-8691. Available from: doi:10.2478/acss-2020-0016

Publication language
English (en)