Beyond Positive and Negative: A Directional SHAP Framework for Sequential Multi-Class Classification
Abstract
In this study, we address the interpretative limitations of the standard Shapley Additive Explanations (SHAP) method in sequential multi-class classification problems within the scope of Explainable Artificial Intelligence (XAI). Stemming from the observation that classical SHAP is restricted to revealing only positive and negative contributions for a single class, we propose a novel directional framework that categorizes feature effects as 'Lower' (driving towards a lower class), 'Upper' (driving towards a higher class), and 'Ambiguous' (representing inconsistent effects). To validate this approach, a Random Forest model predicting obesity levels across seven hierarchical classes was trained on an open-source dataset, achieving a classification accuracy of 95.5%. Furthermore, a stability analysis comprising 10,000 sampling iterations demonstrated the robustness of the proposed framework, with dominant features retaining their directional categorizations consistently in over 99.9% of the trials. The findings indicate that unlike standard SHAP, our method successfully isolates the specific variables that prevent an instance from ascending to a higher class or descending to a lower one, particularly clarifying the role of ambiguous boundary features. In conclusion, this modification significantly enhances model transparency for complex hierarchical scenarios, and the framework has been released as an open-source Python library to provide researchers with a practical tool for automated directional feature analysis.
Keywords
Full Text:
PDFReferences
E. Papagiannidis, P. Mikalef, and K. Conboy, "Responsible artificial intelligence governance: A review and research framework," J Strategic Inf Syst, vol. 34, pp. 101885, 2025. [Online]. Available: https://doi.org/10.1016/j.jsis.2024.101885
A. Das and P. Rad, "Opportunities and challenges in explainable artificial intelligence (XAI): A survey," arXiv:2006.11371, 2020. [Online]. Available: https://arxiv.org/abs/2006.11371
C. Meske, B. Abedin, M. Klier, et al., "Explainable and responsible artificial intelligence," Electron Markets, vol. 32, pp. 2103-2106, 2022. [Online]. Available: https://doi.org/10.1007/s12525-022-00607-2
R. Guidotti, A. Monreale, S. Ruggieri, et al., "A survey of methods for explaining black box models," ACM Comput Surv, vol. 51, pp. 1-42, 2018. [Online]. Available: https://doi.org/10.1145/3236009
S. Goellner, M. Tropmann-Frick, and B. Brumen, "Responsible artificial intelligence: A structured literature review," arXiv:2403.06910, 2024. [Online]. Available: https://arxiv.org/abs/2403.06910
Y. Wang, M. Xiong, and H. Olya, "Toward an understanding of responsible artificial intelligence practices," in Proc 53rd Hawaii Int Conf Syst Sci (HICSS), Maui, HI, USA, pp. 4962-4971, Jan. 2020. [Online]. Available: https://doi.org/10.24251/HICSS.2020.610
P. P. Angelov, E. A. Soares, R. Jiang, et al., "Explainable artificial intelligence: An analytical review," Wiley Interdiscip Rev Data Mining Knowl Discov, vol. 11, pp. e1424, 2021. [Online]. Available: https://doi.org/10.1002/widm.1424
A. B. Arrieta, N. Díaz-Rodríguez, J. Del Ser, et al., "Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI," Inf Fusion, vol. 58, pp. 82-115, 2020. [Online]. Available: https://doi.org/10.1016/j.inffus.2019.12.012
E. Tjoa and C. Guan, "A survey on explainable artificial intelligence (XAI): Toward medical XAI," IEEE Trans Neural Netw Learn Syst, vol. 32, pp. 4793-4813, 2021. [Online]. Available: https://doi.org/10.1109/TNNLS.2020.3027314
H. W. Loh, C. P. Ooi, S. Sevi, et al., "Application of explainable artificial intelligence for healthcare: A systematic review of the last decade (2011–2022)," Comput Methods Programs Biomed, vol. 226, pp. 107161, 2022. [Online]. Available: https://doi.org/10.1016/j.cmpb.2022.107161
R. K. Mothilal, A. Sharma, and C. Tan, "Explaining machine learning classifiers through diverse counterfactual explanations," in Proc Conf Fairness, Accountability, and Transparency (FAT), pp. 607-617, 2020. [Online]. Available: https://doi.org/10.1145/3351095.3372850
M. T. Ribeiro, S. Singh, and C. Guestrin, "'Why should I trust you?' Explaining the predictions of any classifier," in Proc 22nd ACM SIGKDD Int Conf Knowl Discovery Data Mining (KDD), San Francisco, CA, USA, pp. 1135-1144, Aug. 2016. [Online]. Available: https://doi.org/10.1145/2939672.2939778
M. T. Ribeiro, S. Singh, and C. Guestrin, "Anchors: High-
precision model-agnostic explanations," in Proc AAAI Conf Artif Intell, vol. 32, no. 1, New Orleans, LA, USA, Apr. 2018. [Online]. Available: https://doi.org/10.1609/aaai.v32i1.11491
R. R. Selvaraju, M. Cogswell, A. Das, et al., "Grad-CAM: Visual explanations from deep networks via gradient-based localization," in Proc IEEE Int Conf Comput Vis (ICCV), pp. 618-626, 2017. [Online]. Available: https://doi.org/10.48550/arXiv.1610.02391
S. M. Lundberg and S. I. Lee, "A unified approach to interpreting model predictions," in Adv Neural Inf Process Syst, vol. 30, Long Beach, CA, USA, pp. 4765-4774, 2017. [Online]. Available: https://doi.org/10.48550/arXiv.1705.07874
C. Molnar, Interpretable Machine Learning. Lulu.com, 2020. [Online]. Available: https://christophm.github.io/interpretable-ml-book/
E. Štrumbelj and I. Kononenko, "Explaining prediction models and individual predictions with feature contributions," Knowl Inf Syst, vol. 41, pp. 647-665, 2014. [Online]. Available: https://doi.org/10.1007/s10115-013-0679-x
S. J. Silva and C. A. Keller, "Limitations of XAI methods for process-level understanding in the atmospheric sciences," Artif Intell Earth Syst, vol. 3, pp. e230045, 2024. [Online]. Available: https://doi.org/10.1175/AIES-D-23-0045.1
I. E. Kumar, S. Venkatasubramanian, C. Scheidegger, et al., "Problems with Shapley-value-based explanations as feature importance measures," in Proc Int Conf Mach Learn (ICML), pp. 5491-5500, 2020. [Online]. Available: https://proceedings.mlr.press/v119/kumar20e.html
L. Merrick and A. Taly, "The explanation game: Explaining machine learning models using Shapley values," in Machine Learning and Knowledge Extraction, Cham, Switzerland: Springer, pp. 17-38, 2020. [Online]. Available: https://doi.org/10.1007/978-3-030-57321-8_2
Y. Takefuji, "Limitations of SHAP-based interpretations in environmental and membrane filtration applications," Water Res, 2025. [Online]. Available: https://doi.org/10.1175/AIES-D-23-0045.1
F. M. Palechor and A. de la Hoz Manotas, "Dataset for estimation of obesity levels based on eating habits and physical condition in individuals from Colombia, Peru and Mexico," Data Brief, vol. 25, pp. 104344, 2019. [Online]. Available: https://doi.org/10.1016/j.dib.2019.104344
DOI: https://doi.org/10.47738/jads.v7i3.1375
Refbacks
- There are currently no refbacks.

Journal of Applied Data Sciences
| ISSN | : | 2723-6471 (Online) |
| Publisher | : | Bright Publisher |
| Website | : | http://bright-journal.org/JADS |
| : | taqwa@amikompurwokerto.ac.id (principal contact) | |
| support@bright-journal.org (technical issues) |
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0




.png)