How Effective are Different Machine Learning Algorithms in Predicting Legal Outcomes in South Africa?

Abstract

This study examines the effectiveness of different machine learning algorithms in predicting legal outcomes in South Africa's Judiciary system. Considering the advancement of artificial intelligence in the legal sector, this research aims to assess the effectiveness of various machine learning algorithms within the legal domain. Text classification is done using machine learning algorithms, including Logistic Regression, Random Forest, and K-Nearest Neighbours, with datasets obtained from a state legal firm in South Africa. The datasets undergo diligent data cleansing and pre-processing methods, encompassing tokenization and lemmatization techniques. This study evaluates these models' applications through accuracy metrics. The findings demonstrate that the Logistic Regression model attained an accuracy rate of 75.05%, whereas the Random Forest algorithm achieved an accuracy rate of 75.08%. On the other hand, the K-Nearest Neighbours algorithm exhibited no optimal performance, as evidenced by its accuracy rate of 62.76%. This study provides valuable insights for legal professionals by addressing a specific research question about the successful application of machine learning in South Africa's legal sector. The results indicate the possibility of using machine learning to predict the outcomes of criminal legal cases. Additionally, this study highlights the significance of responsibly and ethically implementing machine learning within the legal field. The results of this study enhance our comprehension of the prediction of legal outcomes, establishing a foundation for future investigations in this dynamic area of study. A limitation of this study is that the data was obtained from a single law firm in South Africa.