Predicting On-Time Graduation in Indonesian Private Higher Education: A Machine Learning Comparison for Institutional Decision Support

Achmad Zakki Falani; Syaad Patmanthara; Didik Dwi Prasetya

doi:10.61100/tacit.v4i2.386

Authors

Achmad Zakki Falani Universitas Negeri Malang
Syaad Patmanthara Universitas Negeri Malang
Didik Dwi Prasetya Universitas Negeri Malang

DOI:

https://doi.org/10.61100/tacit.v4i2.386

Keywords:

Graduation Prediction, Educational Data Mining, Algorithmic Accountability, Random Forest, Higher Education Governance

Abstract

Timely graduation shapes accreditation and resource decisions in Indonesia's pri-vate higher education, so how predictive models are built and used is a social as much as a technical question. Prior machine learning comparisons in this setting rely on overall accuracy, run under differing conditions, and rarely test how well models detect late-graduating students or inform institutional action. This study compares Random Forest (RF) and K-Nearest Neighbor (KNN) for on-time gradua-tion prediction on 656 student records (2018–2022) under identical conditions, using accuracy, precision, recall, F1-score, 10-fold cross-validation, feature im-portance (MDI), and the Wilcoxon Signed-Rank Test with a rank-biserial effect size. RF reached higher accuracy (80.30% versus 70.45%), but both models detected the minority late-graduating class poorly (recall 0.40 and 0.26), and the difference was not statistically significant (p = 0.3477; r ≈ 0.49). Academic attributes accounted for 72.38% of feature importance. These results position such models as accountable decision support rather than a validated early-warning intervention, which would require evaluation in real academic governance.

References

Ahmed, H. A., Muhammad Ali, P. J., Faeq, A. K., & Abdullah, S. M. (2022). An Investigation on Disparity Re-sponds of Machine Learning Algorithms to Data Normalization Method. ARO-THE SCIENTIFIC JOUR-NAL OF KOYA UNIVERSITY, 10(2 SE-Review Articles), 29–37. https://doi.org/10.14500/aro.10970

Albreiki, B., Zaki, N., & Alashwal, H. (2021). A Systematic Literature Review of Students’ Performance Predic-tion Using Machine Learning Techniques. Education Sciences, 11(9), 552. https://doi.org/10.3390/educsci11090552

Alyahyan, E., & Düştegör, D. (2020). Predicting academic success in higher education: Literature review and best practices. International Journal of Educational Technology in Higher Education, 17, Article 3. https://doi.org/10.1186/s41239-020-0177-7

Breiman, L. (2001). Random Forests. Machine Learning, 45(1), 5–32. https://doi.org/10.1023/A:1010933404324

Cruz, M. M., & Lumauag, R. (2025). Comparative Analysis of Machine Learning Algorithms for Predicting Student Academic Performance in Higher Education. https://doi.org/10.1109/ICUIS64676.2024.10866086

Dawar, I., Negi, S., Lamba, S., & Kumar, A. (2024). Enhancing Student Academic Performance Forecasting: A Comparative Analysis of Machine Learning Algorithms. SN Computer Science, 5(6), 758. https://doi.org/10.1007/s42979-024-03118-3

Delen, D. (2010). A comparative analysis of machine learning techniques for student retention management. Decision Support Systems, 49(4), 498–506. https://doi.org/10.1016/j.dss.2010.06.003

Holicza, B., & Kiss, A. (2023). Predicting and Comparing Students’ Online and Offline Academic Performance Using Machine Learning Algorithms. Behavioral Sciences, 13(4), 289. https://doi.org/10.3390/bs13040289

Inyang, U. G., Ijebu, F. F., Osang, F. B., & Afolorunso, A. A. (2023). A Dataset-Driven Parameter Tuning Ap-proach for Enhanced K-Nearest Neighbour Algorithm Performance. International Journal on Advanced Sci-ence Engineering Information Technology, 13(1), 380–391. https://doi.org/10.18517/ijaseit.13.1.16706

Kabathova, J., & Drlik, M. (2021). Towards Predicting Student’s Dropout in University Courses Using Differ-ent Machine Learning Techniques. Applied Sciences, 11(7), 3130. https://doi.org/10.3390/app11073130

Kementerian Pendidikan Tinggi Sains dan Teknologi. (2025). Peraturan Menteri Pendidikan Tinggi, Sains, dan Teknologi Nomor 39 Tahun 2025 tentang Penjaminan Mutu Pendidikan Tinggi.

Kim, S., Choi, E., Jun, Y.-K., & Lee, S. (2023). Student Dropout Prediction for University with High Precision and Recall. Applied Sciences, 13(10), 6275. https://doi.org/10.3390/app13106275

Kroll, J. A., Huey, J., Barocas, S., Felten, E. W., Reidenberg, J. R., Robinson, D. G., & Yu, H. (2017). Accountable algorithms. University of Pennsylvania Law Review, 165(3), 633–705.

Nachouki, M., Mohamed, E. A., Mehdi, R., & Abou Naaj, M. (2023). Student course grade prediction using the random forest algorithm: Analysis of predictors’ importance. Trends in Neuroscience and Education, 33, 100214. https://doi.org/10.1016/j.tine.2023.100214

Nayak, P., Vaheed, Sk., Gupta, S., & Mohan, N. (2023). Predicting students’ academic performance by mining the educational data through machine learning-based classification model. Education and Information Technologies, 28(11), 14611–14637. https://doi.org/10.1007/s10639-023-11706-8

Pelima, L. R., Sukmana, Y., & Rosmansyah, Y. (2024). Predicting University Student Graduation Using Aca-demic Performance and Machine Learning: A Systematic Literature Review. IEEE Access, 12, 23451–23465. https://doi.org/10.1109/ACCESS.2024.3361479

Psyridou, M., Prezja, F., Torppa, M., Lerkkanen, M.-K., Poikkeus, A.-M., & Vasalampi, K. (2024). Machine learning predicts upper secondary education dropout as early as the end of primary school. Scientific Reports, 14(1), 12956. https://doi.org/10.1038/s41598-024-63629-0

Rainio, O., Teuho, J., & Klén, R. (2024). Evaluation metrics and statistical tests for machine learning. Scientific Reports, 14(1), 6086. https://doi.org/10.1038/s41598-024-56706-x

Santoso, A., Retnawati, H., Kartianom, K., Apino, E., Rafi, I., & Rosyada, M. (2024). Predicting Time to Gradua-tion of Open University Students: An Educational Data Mining Study. Open Education Studies, 6(1). https://doi.org/10.1515/edu-2022-0220

Shafiq, D. A., Marjani, M., Habeeb, R. A. A., & Asirvatham, D. (2022). Student Retention Using Educational Data Mining and Predictive Analytics: A Systematic Literature Review. IEEE Access, 10, 72480–72503. https://doi.org/10.1109/ACCESS.2022.3188767

Slade, S., & Prinsloo, P. (2013). Learning analytics: Ethical issues and dilemmas. American Behavioral Scientist, 57(10), 1510–1529. https://doi.org/10.1177/0002764213479366

Thabtah, F., Hammoud, S., Kamalov, F., & Gonsalves, A. (2020). Data imbalance in classification: Experi-mental evaluation. Information Sciences, 513, 429–441. https://doi.org/10.1016/j.ins.2019.11.004

Villar, A., & de Andrade, C. R. V. (2024). Supervised machine learning algorithms for predicting student dropout and academic success: a comparative study. Discover Artificial Intelligence, 4(1), 2. https://doi.org/10.1007/s44163-023-00079-z

Wati, E. F., Perangin-angin, E. S., & Sari, A. P. (2023). Prediction of Student Graduation using the K-Nearest Neighbors Method. International Journal of Information System and Technology, 7(3), 211–216. https://doi.org/10.30645/ijistech.v7i3

Yağcı, M. (2022). Educational data mining: prediction of students’ academic performance using machine learning algorithms. Smart Learning Environments, 9(1), 11. https://doi.org/10.1186/s40561-022-00192-z

Zanellati, A., Zingaro, S. P., & Gabbrielli, M. (2024). Balancing Performance and Explainability in Academic Dropout Prediction. IEEE Transactions on Learning Technologies, 17, 2086–2099. https://doi.org/10.1109/TLT.2024.3425959