A new framework in improving prediction of class imbalance for student performance in Oman educational dataset using clustering based sampling techniques

According to the Oman Education Portal (OEP), data set imbalances are common in student performance. Most of the students are performing welI, while only small cases of students are underperformed. Classification techniques for the imbalanced dataset can yield deceivingly high prediction accuracy. T...

وصف كامل

التفاصيل البيبلوغرافية
المؤلف الرئيسي: Sultan Alalawi, Sultan Juma
التنسيق: أطروحة
اللغة:الإنجليزية
منشور في: 2021
الموضوعات:
الوصول للمادة أونلاين:https://etd.uum.edu.my/10170/1/s902668_01.pdf
https://etd.uum.edu.my/10170/
Abstract Abstract here
_version_ 1855574906048086016
author Sultan Alalawi, Sultan Juma
author_facet Sultan Alalawi, Sultan Juma
author_sort Sultan Alalawi, Sultan Juma
description According to the Oman Education Portal (OEP), data set imbalances are common in student performance. Most of the students are performing welI, while only small cases of students are underperformed. Classification techniques for the imbalanced dataset can yield deceivingly high prediction accuracy. The majority class usually drives the overall predictive accuracy at the expense of having abysmal performance on the minority class. The main objective of this study was to predict students' performance which consisted of imbalanced class distribution, by exploiting different sampling techniques and several data mining classifier models. Three main sampling techniques - synthetic minority over-sampling technique (SMOTE), random under-sampling (RUS), and clustering-based sampling were compared to improve the predictive accuracy in the minority class while maintaining satisfactory overall classification performance. Five different data-mining classifiers - J48, Random Forest, K-Nearest Neighbour, Naïve Bayes, and Logistic Regression were used to predict the student performance. 10-fold cross-validation was utilized to minimize the sampling bias. The classifiers' performance was evaluated using four metrics: accuracy, False Positive (FP), Matthews correlation coefficient (MCC), and Receiver Operating Characteristic (ROC). The OEP datasets between 2018 and 2019 were extracted to assess the efficacy of both sampling techniques and classification methods. The results indicated that the K-Nearest Neighbors combined with the clustering-based sampling technique produced the best classification performance with an MCC value of 98.4% on the 10-fold crossvalidation. The clustering-based sampling techniques improved the overall prediction performance for the minority class. In addition, the most important variables to accurately predict student performance were identified by utilizing the Random Forest model. OEP contains a large amount of data and analyses based on this large and complex data can be useful for OEP stakeholders in improving student performance and identifying students who require additional attention.
format Thesis
id oai:etd.uum.edu.my:10170
institution Universiti Utara Malaysia
language English
publishDate 2021
record_format EPrints
record_pdf Restricted
spelling oai:etd.uum.edu.my:101702025-08-27T07:38:44Z https://etd.uum.edu.my/10170/ A new framework in improving prediction of class imbalance for student performance in Oman educational dataset using clustering based sampling techniques Sultan Alalawi, Sultan Juma L Education (General) QA273-280 Probabilities. Mathematical statistics According to the Oman Education Portal (OEP), data set imbalances are common in student performance. Most of the students are performing welI, while only small cases of students are underperformed. Classification techniques for the imbalanced dataset can yield deceivingly high prediction accuracy. The majority class usually drives the overall predictive accuracy at the expense of having abysmal performance on the minority class. The main objective of this study was to predict students' performance which consisted of imbalanced class distribution, by exploiting different sampling techniques and several data mining classifier models. Three main sampling techniques - synthetic minority over-sampling technique (SMOTE), random under-sampling (RUS), and clustering-based sampling were compared to improve the predictive accuracy in the minority class while maintaining satisfactory overall classification performance. Five different data-mining classifiers - J48, Random Forest, K-Nearest Neighbour, Naïve Bayes, and Logistic Regression were used to predict the student performance. 10-fold cross-validation was utilized to minimize the sampling bias. The classifiers' performance was evaluated using four metrics: accuracy, False Positive (FP), Matthews correlation coefficient (MCC), and Receiver Operating Characteristic (ROC). The OEP datasets between 2018 and 2019 were extracted to assess the efficacy of both sampling techniques and classification methods. The results indicated that the K-Nearest Neighbors combined with the clustering-based sampling technique produced the best classification performance with an MCC value of 98.4% on the 10-fold crossvalidation. The clustering-based sampling techniques improved the overall prediction performance for the minority class. In addition, the most important variables to accurately predict student performance were identified by utilizing the Random Forest model. OEP contains a large amount of data and analyses based on this large and complex data can be useful for OEP stakeholders in improving student performance and identifying students who require additional attention. 2021 Thesis NonPeerReviewed text en https://etd.uum.edu.my/10170/1/s902668_01.pdf Sultan Alalawi, Sultan Juma (2021) A new framework in improving prediction of class imbalance for student performance in Oman educational dataset using clustering based sampling techniques. Doctoral thesis, Universiti Utara Malaysia.
spellingShingle L Education (General)
QA273-280 Probabilities. Mathematical statistics
Sultan Alalawi, Sultan Juma
A new framework in improving prediction of class imbalance for student performance in Oman educational dataset using clustering based sampling techniques
thesis_level PhD
title A new framework in improving prediction of class imbalance for student performance in Oman educational dataset using clustering based sampling techniques
title_full A new framework in improving prediction of class imbalance for student performance in Oman educational dataset using clustering based sampling techniques
title_fullStr A new framework in improving prediction of class imbalance for student performance in Oman educational dataset using clustering based sampling techniques
title_full_unstemmed A new framework in improving prediction of class imbalance for student performance in Oman educational dataset using clustering based sampling techniques
title_short A new framework in improving prediction of class imbalance for student performance in Oman educational dataset using clustering based sampling techniques
title_sort new framework in improving prediction of class imbalance for student performance in oman educational dataset using clustering based sampling techniques
topic L Education (General)
QA273-280 Probabilities. Mathematical statistics
url https://etd.uum.edu.my/10170/1/s902668_01.pdf
https://etd.uum.edu.my/10170/
work_keys_str_mv AT sultanalalawisultanjuma anewframeworkinimprovingpredictionofclassimbalanceforstudentperformanceinomaneducationaldatasetusingclusteringbasedsamplingtechniques
AT sultanalalawisultanjuma newframeworkinimprovingpredictionofclassimbalanceforstudentperformanceinomaneducationaldatasetusingclusteringbasedsamplingtechniques