Сэтгэл ханамжийн түвшинг Random Forest машин сургалтын загвараар ангилж, гүйцэтгэлийг үнэлэх нь, Classifying Satisfaction Levels with Random Forest Machine Learning Model and Evaluating Performance

<jats:p>Satisfaction ratings are widely used to measure service and organizational performance, but because they rely on subjective data with Likert scales, they are difficult to fully interpret using traditional statistical methods. The purpose of this study is to classify High and Medium levels of satisfaction based on satisfaction questions V1–V4 using a Random Forest machine learning model and to comprehensively evaluate the performance of the model. The study used data consisting of 42 observations and optimized the Random Forest model using 10-fold cross-validation 20 times. Model performance was evaluated using accuracy, Cohen’s Kappa, confusion matrix, ROC curve, AUC, feature importance, and permutation test. The results of the study showed that the Random Forest model showed 97.75% accuracy and Cohen's Kappa of 0.93, indicating high classification agreement. ROC analysis yielded AUC = 0.9998, indicating almost perfect discrimination between High and Medium satisfaction levels. According to the feature importance analysis, V2 questions had the greatest impact on classification performance, while the impact of V1 questions was relatively small. The results of the 100-fold permutation test also confirmed that the performance of the actual model was statistically significantly higher (p &lt; 0.01) than random.The Random Forest model is shown to be a reliable, stable, and interpretable method for classifying satisfaction levels, demonstrating the practical value of applying machine learning methods to satisfaction rating data.</jats:p>