COMPARING FEATURE SELECTION METHODS AND EXPLAINABLE AI TECHNIQUES FOR INTERPRETABLE MEDICAL CLASSIFICATION
Keywords:
feature selection, explainable artificial intelligence, SHAP, permutationAbstract
Feature selection and explainable artificial intelligence (XAI) are often used together in medical machine learning, but they answer different questions. Feature selection identifies variables to retain before training, whereas XAI explains which variables influenced a trained model. This study compares six feature selection methods - ANOVA F-test, mutual information, recursive feature elimination, L1 logistic regression, random forest importance, and extra trees importance - with SHAP values, permutation importance, and model-based importance. Experiments were conducted on three public medical classification datasets: Breast Cancer Wisconsin Diagnostic, Pima Indians Diabetes, and Heart Disease Cleveland. Logistic regression, random forest, SVM, and gradient boosting were evaluated using accuracy, precision, recall, F1-score, and ROC-AUC. Agreement between selected and explained features was measured by Jaccard similarity and overlap percentage. The best full-featureReferences
[1] Sadeghi, Z., Alizadehsani, R., Cifci, M. A., Kausar, S., Rehman, R., Mahanta, P., et
al. (2024). A review of Explainable Artificial Intelligence in healthcare. Computers
and Electrical Engineering, 118, 109370.
https://doi.org/10.1016/j.compeleceng.2024.109370
[2] Zhang, K., et al. (2026). A comprehensive review of explainable artificial
intelligence in healthcare: methods, evaluation, and clinical integration. iScience.
VOLUME 3, ISSUE 1
214
https://doi.org/10.1016/j.isci.2026.115026
[3] Pudjihartono, N., Fadason, T., Kempa-Liehr, A. W., & O'Sullivan, J. M. (2022). A
Review of Feature Selection Methods for Machine Learning-Based Disease Risk
Prediction. Frontiers in Bioinformatics, 2, 927312.
https://doi.org/10.3389/fbinf.2022.927312
[4] Dunn, J., Mingardi, L., & Zhuo, Y. D. (2021). Comparing interpretability and
explainability for feature selection. arXiv:2105.05328.
[5] Zacharias, J., et al. (2022). Designing a feature selection method based on
explainable artificial intelligence. Electronic Markets. https://doi.org/10.1007/s12525-
022-00608-1