COMPARING FEATURE SELECTION METHODS AND EXPLAINABLE AI TECHNIQUES FOR INTERPRETABLE MEDICAL CLASSIFICATION

Authors

  • G.Kh. Tashmatov Author

Keywords:

feature selection, explainable artificial intelligence, SHAP, permutation

Abstract

Feature selection and explainable artificial intelligence (XAI) are often used together in medical machine learning, but they answer different questions. Feature selection identifies variables to retain before training, whereas XAI explains which variables influenced a trained model. This study compares six feature selection methods - ANOVA F-test, mutual information, recursive feature elimination, L1 logistic regression, random forest importance, and extra trees importance - with SHAP values, permutation importance, and model-based importance. Experiments were conducted on three public medical classification datasets: Breast Cancer Wisconsin Diagnostic, Pima Indians Diabetes, and Heart Disease Cleveland. Logistic regression, random forest, SVM, and gradient boosting were evaluated using accuracy, precision, recall, F1-score, and ROC-AUC. Agreement between selected and explained features was measured by Jaccard similarity and overlap percentage. The best full-feature

References

[1] Sadeghi, Z., Alizadehsani, R., Cifci, M. A., Kausar, S., Rehman, R., Mahanta, P., et

al. (2024). A review of Explainable Artificial Intelligence in healthcare. Computers

and Electrical Engineering, 118, 109370.

https://doi.org/10.1016/j.compeleceng.2024.109370

[2] Zhang, K., et al. (2026). A comprehensive review of explainable artificial

intelligence in healthcare: methods, evaluation, and clinical integration. iScience.

VOLUME 3, ISSUE 1

214

https://doi.org/10.1016/j.isci.2026.115026

[3] Pudjihartono, N., Fadason, T., Kempa-Liehr, A. W., & O'Sullivan, J. M. (2022). A

Review of Feature Selection Methods for Machine Learning-Based Disease Risk

Prediction. Frontiers in Bioinformatics, 2, 927312.

https://doi.org/10.3389/fbinf.2022.927312

[4] Dunn, J., Mingardi, L., & Zhuo, Y. D. (2021). Comparing interpretability and

explainability for feature selection. arXiv:2105.05328.

[5] Zacharias, J., et al. (2022). Designing a feature selection method based on

explainable artificial intelligence. Electronic Markets. https://doi.org/10.1007/s12525-

022-00608-1

Published

2026-07-05