Article navigation
Purpose

Matriculation requirements ensure students possess the minimum competency required to pursue a program. However, academic departments struggle to continuously evaluate and adjust these requirements in a dynamic environment where student contexts change due to curriculum updates and e-learning access. This paper presents a framework to quantify and compare the impact of individual requirements on academic performance, assisting educators in deciding which matriculation requirements should be updated.

Design/methodology/approach

The framework exploits a recent novel regression algorithm to quantify the level of personalization each requirement has on grade prediction. This algorithm counters the challenges of standardized exam scores by using information from all data points for each inference. The methodology was demonstrated by investigating the effect of secondary school subject passes on predicting final course grades and GPAs within a computing department.

Findings

Applying the framework allows educators to systematically evaluate the utility of each matriculation requirement. Regular analysis using personalization scores enables institutions to proactively detect and adapt to new developments within the core matriculating demographic. In our demonstration, we investigated how passes in various secondary school subjects impact the prediction of final course grades and GPAs within a computing department, highlighting the framework's practical value.

Research limitations/implications

The demonstration of the framework was specifically applied to a computing department and focused on secondary school subject passes. While it addresses the challenges of standardized exam scores, the study implies that regular analysis is necessary to continuously adjust to developments among the core matriculating demographic.

Practical implications

Regularly performing this analysis empowers institutions to proactively detect and adjust to developments among the core matriculating demographic. This approach maximizes student and faculty readiness and overall success by allowing educators to use personalization scores to evaluate and update the utility of specific requirements.

Social implications

The proposed approach enables institutions to adjust to changing educational contexts, such as shifts in curriculum and access to e-learning technologies. By ensuring requirements accurately reflect necessary competencies, the framework supports student success within an evolving demographic and dynamic education environment.

Originality/value

This approach offers a proactive and data-driven method for academic departments to assess and revise matriculation requirements. By quantifying the personalized impact of each requirement, our framework maximizes student and faculty readiness and overall success, providing a novel mechanism for maintaining alignment between entry requirements and the evolving educational landscape.

Predicting academic performance is a critical concern for educators, policymakers and institutions worldwide. With the increasing demand for higher education and the diversification of student populations, accurately forecasting student success has become more complex yet essential. Effective prediction models can enhance educational outcomes by enabling timely interventions, tailored support and informed admission decisions.

Historically, researchers have explored various factors influencing academic performance in higher education, such as language proficiency, socio-demographic variables and prior academic achievements. For instance, Stephen, Welman, and Jordaan (2004) investigated the impact of English language proficiency on the academic success of first-year students, identifying multiple inhibiting factors such as cultural influences and language skills. Similarly, Osmanbegovic and Suljic (2012) applied data mining techniques to predict academic success, emphasizing the importance of socio-demographic factors and high school achievements in developing predictive models. These studies highlight the multifaceted nature of academic performance and the need for comprehensive models that consider a wide range of variables.

Further research has delved into the role of entry qualifications and their correlation with university-level performance. Amasuomo (2014) compared the academic achievements of students with different entry certificates in Nigeria, revealing significant disparities based on entry qualifications. Thiele et al. (2016) expanded this investigation by examining the influence of socio-economic status and school type on academic outcomes, advocating for the inclusion of contextual data in university admissions. These findings underscore the limitations of traditional admission criteria and the potential benefits of incorporating additional contextual factors to ensure fair access and support for students.

The debate over standardized admission tests and their predictive validity has also been a focal point in recent studies. Sulphey, Al-Kahtani, and Syed (2018) analyzed the relationship between admission grades and academic success among business students in Saudi Arabia, confirming a strong correlation between high school grade point average (GPA), standardized test scores and future academic achievement. Similarly, Alamoudi et al. (2021) examined the correlation between admission exam scores and academic performance in health science programs, highlighting the need for tailored preparatory tracks to enhance student outcomes. These studies illustrate the ongoing need to refine admission criteria and consider alternative metrics to better predict and support student success.

Similar to the regions above, a complex mix of individual and demographic factors influences academic performance in the Caribbean. Gender consistently stands out, with females generally outperforming males in primary assessments and most subjects (Bailey, 2004; Kutnick et al., 1997; Kutnick & Jules, 1988). Interestingly, males who remain in the system tend to excel in science and technology (Bailey, 2004). Another key factor is socio-economic status. Students from higher socio-economic backgrounds tend to have an advantage in participation and performance (Bailey, 2004). In fact, socio-economic status, poverty and social class are frequently more strongly linked to educational outcomes than gender, with privileged boys sometimes outperforming less privileged girls (Cobbett & Younger, 2012; Kutnick et al., 1997).

Apart from personal traits, in the Caribbean, there are various institutional and environmental factors that also influence academic achievement. Specifically, school type is a dominating factor. Generally, single-sex, private or church-run institutions generally yield better results than coeducational or state-run schools (Cobbett & Younger, 2012; Kutnick et al., 1997; Kutnick & Jules, 1988). School locality also impacts performance, as urban areas often see better outcomes than rural ones (Cobbett & Younger, 2012; De Lisle, 2006; Kutnick & Jules, 1988). External factors such as home socialization practices, financial constraints and community or school violence also contribute to male “under-performance” (Bailey, 2004).

Based on these challenges, this paper seeks to investigate the following questions: (1) What impact does individual matriculation requirements have on student placement and academic success? (2) How can removing traditional matriculation requirements maximize enrollment and reduce mismatch issues in student admissions? Specifically, it proposes a personalized recommender system to optimize student placement and improve academic outcomes. It also discusses how departments can remove traditional matriculation requirements by leveraging a novel regression algorithm. The proposed approach aims to match applicants with suitable disciplines based on their entry grades, thereby maximizing enrollment and reducing mismatch issues. This personalized approach not only enhances the accuracy of predictions but also ensures a fair and transparent admission process, ultimately contributing to a more supportive and effective educational environment.

This paper is organized as follows: Section 2 reviews related work on predicting academic performance, highlighting key studies and their findings. Section 3 presents the proposed recommender system, detailing its methodology and potential benefits. Subsequent sections discuss the implementation, evaluation and implications of the proposed system. This paper seeks to advance the understanding of academic performance prediction and contribute to the development of more effective educational strategies and systems.

This section gives a summary of studies conducted on predicting academic performance globally. These summaries aim to highlight the impact that different contextual variables have on predicting academic performance across various regions, cultures and educational settings. Stephen et al. (2004) investigated the impact of English language proficiency on the academic success of first-year Black and Indian students in human resources management at a tertiary institution. Rural environment, school teacher English proficiency, cultural influences, learning and memorizing strategies, problems regarding verbal comprehension, problems regarding transferability of language skills, problems regarding reading proficiency and problems related to written English were the factors that impacted English language proficiency.

The work done by Osmanbegovic and Suljic (2012) explored the application of data mining techniques to predict academic success among first-year students at the University of Tuzla’s Faculty of Economics. The study compares various methods of data mining to develop a predictive model for students' success, using data collected from surveys during the summer session of the academic year 2010–2011, alongside enrollment data. Factors such as socio-demographic variables, high school achievements, entrance examination scores and attitudes towards studying were investigated. Three supervised data mining algorithms were employed to predict course success, with the Naïve Bayes classifier outperforming decision tree and neural network methods. The study emphasizes the importance of developing accurate and comprehensible models for professors. Although conducted in traditional classroom settings, the methodology holds promise for improving student performance and reducing failure rates through timely interventions. Key questions for future research include the user-friendliness of predictive models for non-expert users and the integration of university data collection systems with data mining tools. Future work could expand the experiment with more attributes for enhanced accuracy and explore additional data mining algorithms for broader insights. The review highlights the potential for using diverse software and factors to refine predictive models and improve student learning outcomes.

Amasuomo (2014) studied the academic performance levels of two distinct groups of students enrolled in the Nigeria Certificate in Education (NCE) Technical Program, differing in their entry certificates. The research focused on 70 first-year technical students at the Federal College of Education (Technical), Omoku, during the 2011–2012 academic year. Raw scores from five courses were collected and analyzed using arithmetic means and a t-test, with the reliability of the t-test results confirmed through an f-test of group variances. The findings of the study revealed a significant disparity in academic performance between students with secondary school certificates and those with City and Guilds certificates. Moreover, notable differences were observed in various facets of academic achievement between the two groups. This underscores the potential influence of entry certificate type on academic outcomes within the NCE technical program.

Following this, Thiele, Singleton, Pope, and Stanistreet (2016) investigated the relationship between various background characteristics and academic achievement at a British university. It explores how school qualifications, socio-economic status, school type and demographic factors influence students' academic performance. Findings indicate that while school grades are important predictors of academic potential, contextual factors such as socio-economic deprivation and school type also play significant roles. The study advocates for the inclusion of contextual data alongside traditional school grades in the admissions process to ensure fair access to higher education and improve student outcomes. The study underscores the importance of considering contextual factors in university admissions to address limitations associated with relying solely on examination marks. By identifying students whose academic potential may not be fully reflected in their school qualifications, universities can better support them to succeed in higher education. Moreover, integrating contextual data into admissions processes can enhance fairness and inclusivity, ultimately improving the overall student experience and academic attainment levels. Further research is needed to inform evidence-based policies that promote equitable access to higher education and support students in realizing their full potential.

Sulphey et al. (2018) noted that the use of standardized admission tests in college admissions has long been a topic of debate. Supporters cite predictive validity, and critics highlight concerns about fairness and the impact on educational systems. While such tests are widely used globally, including in the USA, where they face criticism for perceived biases and inequities, their efficacy remains under scrutiny. This study examines the relationship between admission grades and academic achievement among business students in Saudi Arabia, filling a gap in the literature. Findings indicate a strong correlation between high school GPA, standardized test scores and future academic success. The study underscores the importance of considering both academic performance and standardized test scores in college admissions. Furthermore, it suggests the need for ongoing research to refine admission criteria and address dropout rates, with potential areas of study including re-enrollment strategies and the implementation of e-learning platforms to enhance educational outcomes.

Alamoudi et al. (2021) explored the correlation between admission exam scores and preparatory year GPA with academic performance in basic science subjects in health science colleges at King Abdulaziz University. The research encompassed four cohort studies from nursing and clinical nutrition programs. Results reveal weak correlations between admission exam scores and academic achievement in clinical biochemistry and clinical pharmacology. However, a significant positive correlation was found between the two subjects. The findings suggest a need to reevaluate admission criteria and consider tailored preparatory year tracks for health science students. The study emphasizes the importance of continuously assessing and developing admission criteria for health science colleges, particularly amidst increasing applicant numbers and evolving teaching methodologies. The weak correlations between admission examination scores and academic performance underscore the need for reevaluation. Tailored preparatory year tracks could better equip students with the specific skills and knowledge necessary for success in health science programs. Further research is warranted to refine admission criteria and ensure optimal student outcomes in health science education at King Abdulaziz University.

In 2021, Aciro et al. (2021) investigated the relationship between pre-university academic achievements and university-level performance, drawing on a systematic review of 53 relevant articles primarily from America and Europe, with limited representation from Asia, Latin America and Africa. Findings reveal varying correlations between entry grades and academic outcomes, with some studies indicating positive, negative or mixed associations, while others suggest gender differences. The review underscores the lack of consensus regarding the predictive value of pre-university academic performance on university success, highlighting the need for further research to inform admission criteria and policies at the undergraduate and graduate levels globally. This literature review examines the relationship between entry grades and university academic performance, highlighting positive, negative and mixed correlations identified in existing research. Additionally, it underscores significant gaps and weaknesses in current university admission criteria, emphasizing the need for attention from stakeholders, educational planners and policymakers. The review also addresses contradictory findings regarding gender's impact on academic performance, emphasizing the necessity for evidence-based studies to inform admission policies for undergraduate and graduate programs worldwide. Recommendations from such research have the potential to enhance admission practices and improve student outcomes globally.

Barroso, Cainday, Sedon, and Tilanduca (2022) concluded that in order to predict academic success, college admission tests and high school GPA are essential requirements for admission to both board and non-board programs. But not for the board course; the high school strand may have an impact on an individual's academic achievement in the non-board course. Based on a quantitative analysis of 286 respondents – 153 from the board course program and 133 from the non-board course program – this conclusion was drawn. Furthermore, results indicated a moderate correlation between students' high school GPA and their college academic achievement in the non-board course Bachelor of Science in Information Technology (BSIT). A similar association was found between the variables on the college admission test and GPA. In the meantime, Bachelor of Science in Electrical Engineering (BSEE), admission exams and high school GPA were indicators of future academic success for the board course.

In the context of the Caribbean, Anderson, Devonish, Bailey, and Daley (2014) analyzed undergraduate admissions to the University of the West Indies (Mona) between 1983 and 2010. They examined the relationship between student characteristics and their impact on academic performance. Their study highlighted that uneven academic performance was something associated with variables such as age, gender, urban-rural residence, registration status (part-time or full-time), previous schooling and faculty. Specifically, Anderson et al. (2014) found that social class and geographic location significantly influenced access to tertiary education, with notable disparities observed in enrollment rates across different income levels and regions. Another issue observed was a significant change in the age structure towards a younger student population. Thus, they concluded that there is a need for enhanced support services to foster broader academic success among a diverse student body.

Browne and Shen (2017) studied the challenges associated with low output and the availability of higher education institutions in the Eastern Caribbean. They found that factors affecting higher education in this region include accessibility, location, quality of education, institutional costs and graduate unemployment. Although access to higher education has increased significantly due to technological advancements, globalization and reduced travel costs, several challenges persist. Specifically, these include insufficient funding, low government revenues and increased privatization. These issues, coupled with high tuition fees, brain drain and a mismatch between educational output and labor market needs, contribute to low student performance and high dropout rates. Additionally, they proposed that a lack of a strong research culture and limited highly qualified human resources further hinder academic performance and overall educational development in the region.

In the Caribbean, most higher education institutions rely heavily on the Caribbean Examinations Council (CXC) grades for matriculation. Griffith (2017) discussed how these institutions can enhance quality assurance by adopting an outcomes-based model that prioritizes the student experience, drawing lessons from the CXC. Based on the CXC's practices, the key variables affecting academic performance are clearly defined educational standards and learning outcomes in syllabi, effective teaching enabled by pedagogical guidance, teacher training and accessible resources and rigorous assessment procedures featuring standardized marking and detailed feedback to students and teachers. Collectively, these elements contribute to improved student preparation and achievement of expected outcomes. Although Griffith (2017) doesn't explicitly state a direct statistical correlation between specific CXC grades and university GPA, his report emphasizes that CXC's quality assurance mechanisms in its examinations prepare students for higher education, which implies that students with good CXC performance should have a smoother academic progression at the university level.

In summary, the literature shows that many researchers are interested in investigating the factors that influence academic performance. It also highlights that both globally and within the Caribbean, in all educational settings, there are many variables (academic and non-academic), which can influence academic performance. Which subset of these variables is best suited for algorithms predicting academic performance is a complex and vital area of study. Generally, departments in higher education within the Caribbean base their matriculation requirements on academic variables they believe are the best indicator of a candidate's readiness to pursue a degree. However, such requirements introduce two challenges. Firstly, they limit the size of a department cohort, which impacts the potential to earn revenue from paying students. Secondly, a department may unintentionally mismatch applicants with degree options if they do not monitor the influence of matriculation requirements on graduating GPAs closely. Both scenarios result in frustrated students and staff and reduce the department's average graduating GPA and throughput. Therefore, there is a need for a continuous monitoring framework that can quantify the impact that entry requirements have on academic performance over time. This quantification enables personalized recommendations that are likely to be mutually beneficial to both faculty and students.

This section proposes a personalized recommender system in response to the challenges identified in Section 2. Using this system, a department can counteract the reduced cohort size and unintentional student-degree mismatch issues. To illustrate the key ideas, let us consider the fictional case of an idealistic Faculty of Innovation and Digital Transformation (FIDT).

Let’s suppose that the FIDT removes all its matriculation requirements from all departments and matches applicants to departments with help from a recommender system instead. This approach allows departments to consider enrollment from all applicants, maximizing their respective cohorts and revenues. The challenge for FIDT now shifts to accurately matching its applicants to a suitable department using the recommender system. For each applicant, the system must rank all departments by the expected graduating GPA based on the applicant's entry grades. These personalized rankings will solve any mismatch issues.

For transparency, the system must quantify the influence that any entry grade will likely have on an applicant's graduating GPA for any department. With this level of detail, the FIDT's staff can meaningfully advise applicants on making their final choice of department, ensuring a fair and transparent process. This process maximizes the FIDT's fairness to departments and applicants by enrolling students into departments where they are likely to excel, thereby enhancing the overall academic environment.

Another advantage of this quantification is monitoring influence. As more applicants with a specific entry subject enroll, the FIDT can detect whether the subject's influence on graduating GPAs changes. These alerts allow the FIDT to react proactively when factors outside of its control affect students' success.

A key challenge for this recommender system is data quality. The previously used matriculation requirements would have skewed the entry grades and graduating GPAs dataset available to the system. If a department receives a traditional applicant (who matches the traditional matriculation requirements), the recommender system has enough historical data to make a robust and personalized prediction. However, if it is a new type of applicant (who does not match the traditional departmental requirements), the recommender system must estimate a personalized GPA based on how similar applicants performed. This notation of similarity is essential for this recommender system. Otherwise, the best prediction would be the simple average of that department's graduating GPAs. This data quality issue will become less significant as the department's dataset diversifies. This diversification may take a few years since the number of applicants enrolling is typically higher than the number of students graduating annually. Hence, even with a personalized ranking, the FIDT would still need to provide some advising sessions to applicants before they make their final choice. Figure 1 summarizes the FIDT's new workflow.

Figure 1
A flowchart of the proposed framework for enrolling applicants into departments.The flowchart illustrates the proposed framework for enrolling applicants into departments. It begins with new applicants who have entry grades entering a recommender system. This system uses historical data to provide personalized departmental matching. The matched applicants then go through an advising process. After advising, the applicants enroll in a department and read for a degree. Upon graduation, the data is updated in the historical data repository, completing the cycle.

Summary of the proposed framework for enrolling applicants into departments

Figure 1
A flowchart of the proposed framework for enrolling applicants into departments.The flowchart illustrates the proposed framework for enrolling applicants into departments. It begins with new applicants who have entry grades entering a recommender system. This system uses historical data to provide personalized departmental matching. The matched applicants then go through an advising process. After advising, the applicants enroll in a department and read for a degree. Upon graduation, the data is updated in the historical data repository, completing the cycle.

Summary of the proposed framework for enrolling applicants into departments

Close Figure 1

In this study, we utilized a recent novel regression algorithm proposed by Hosein (2023) to quantify the level of personalization each entry subject has on graduating GPA prediction. This algorithm can quantify the robustness vs personalization tradeoff and works well with small datasets. Also, other studies by Gooljar, Manohar, and Hosein (2023), Manohar, Manohar, and Hosein (2023), Moore, Baboolal, and Hosein (2023), Harrykissoon, Persaud, Manohar, and Hosein (2023) and Manohar and Hosein (2023) demonstrated that this algorithm performs well with various datasets and improves the performance of popular clustering, classification and regression algorithms.

The key idea of Hosein's algorithm is to express every prediction as a weighted average using non-linear weights. Every prediction is robust because it utilizes information from every training sample. Every prediction is personalized because the non-linear weights can effectively capture the similarity between every sample. The hyperparameter κ determines the level of personalization.

To better explain the value of κ, suppose that we have an input sample x. When κ = 0, every sample is considered identical to x, all the non-linear weights are 1, and the prediction becomes the simple average over all samples, which is robust but not personalized. When κ = ∞, only samples that match x's input features have a weight of 1. The algorithm assigns a weight of 0 to all other samples, and the prediction becomes the simple average of only those samples that are identical to x, which is personalized but not necessarily robust. When κ is some value other than these extremes, the algorithm's weighted average computation exploits samples in the neighborhood of x. The nearer the sample, the closer the non-linear weight is to one. This computation helps in cases where a class has a few samples, but there are samples in its neighborhood, which can help improve the prediction's robustness at a small cost to personalization. The higher the κ, the better the personalization. Features with some influence will have a κ value that reduces the prediction error compared to when κ = 0.

We selected this algorithm because it simplifies the measurement of an entry subject's value in predicting graduating GPAs. Specifically, we compared the product of the normalized prediction error and normalized κ values. Products closer to 1 maximize the probability that the entry subject improves prediction accuracy and personalization. For example, if two subjects offer similar reductions in GPAs, the subject with a higher κ value is better. Similarly, if both subjects match in personalization, the subject with the lower prediction error adds more value. Notably, a product of 0 does not necessarily mean the entry subject is unimportant. It just means that this algorithm could not extract any value from the subject's grade.

An even distribution across all samples is ideal for any entry subject. When 50% of the samples have the subject and 50% do not, the mean graduating GPAs are robust, and their absolute difference, Δμ, quantifies the subject's impact on graduating GPA. Thus, for every entry subject, we have four concerns – the graduating GPA prediction error, the level of personalization κ, Δμ the absolute difference in the means of graduating GPAs with and without the entry subject and how robust these means are.

We combined these objectives into a single score by generating four scores for each concern and taking their product. Each score measures an entry's subject similarity to the ideal case, with a value between 0 and 1. The prediction error score divides the mean absolute error (MAE) for a specific κ by the MAE when κ = 0 (MAEκ = 0). The personalization score divides the κ value by κmax = 30 (the largest κ used in our experiments). The Δμ score divides Δμ by 4.3 (the maximum difference in GPA). The sample size score compares the entry subject's distribution to a 50–50 split. The score is 1 when exactly half the samples have a grade for the subject and 0 when all or none do. Otherwise, it scales linearly based on how many more or fewer samples have a grade for the entry subject. Intuitively, a product of 1 implies that all four objectives are fully satisfied, while a product of 0 implies that at least one objective is not satisfied.

The dataset used in this study contains 1,114 samples of applicants' entry grades and graduating GPAs from 5 departments in a Caribbean university. Table 1 shows the distribution across departments A through E. These applicants' entry subjects and grades are further distributed across 31 Caribbean Advanced Proficiency Examination (CAPE) subjects, each with 2 units for 62 possible entry grades. A typical applicant from the dataset has grades for both units of four to six CAPE subjects. Each department's entry grade distribution was highly skewed to its matriculation requirements. Table 2 illustrates this by listing the eight most popular entry subjects by department.

Table 1

The distribution of samples across Departments A to E

DepartmentSamples
A263
B462
C162
D150
E77
Total1,114
Table 2

The eight most popular entry subjects by department

#
Department A
Comm Studies Unit 1191
Caribbean Studies Unit 1185
Pure Mathematics Unit 1114
Pure Mathematics Unit 2105
Physics Unit 192
Physics Unit 292
Information Tech Unit 173
Information Tech Unit 270
Department B
Comm Studies Unit 1334
Caribbean Studies Unit 1333
Biology Unit 1309
Biology Unit 2303
Chemistry Unit 1258
Chemistry Unit 2255
Environ Science Unit 1182
Environ Science Unit 2182
Department C
Comm Studies Unit 1120
Caribbean Studies Unit 1117
Physics Unit 193
Physics Unit 292
Pure Mathematics Unit 185
Pure Mathematics Unit 284
Chemistry Unit 182
Chemistry Unit 280
Department D
Comm Studies Unit 1114
Pure Mathematics Unit 1114
Pure Mathematics Unit 2113
Caribbean Studies Unit 1112
Applied Maths Unit 162
Applied Maths Unit 262
Physics Unit 160
Physics Unit 259
Department E
Chemistry Unit 158
Chemistry Unit 258
Caribbean Studies Unit 156
Comm Studies Unit 156
Biology Unit 134
Biology Unit 233
Physics Unit 130
Physics Unit 229

In our first set of experiments, we investigated the impact individual entry subject grades have on academic performance. These experiments used a randomized 80–20 train-test split and computed the optimal κopt ∈ [0, 30]. Table 3 lists the top 10 entry subjects for all departments according to our score. The experimental data presented in Table 3 and Figure 2 suggest that our score was an effective mechanism to balance the four concerns identified in Section 3.

Table 3

The top 10 entry subjects for Departments A through E sorted by the proposed score

Entry subjectScore×10−6κoptNMAESample sizeΔμ
Department A (210 training samples)
Pure Mathematics Unit 21617.0210.8951050.094
Pure Mathematics Unit 11238.7240.8791140.060
Chemistry Unit 1488.4300.889420.048
Chemistry Unit 2394.3300.931400.065
Applied Maths Unit 1376.5300.974380.174
Physics Unit 2341.6300.922920.022
Caribbean Studies Unit 1117.7240.8971850.025
Information Tech Unit 1106.3300.983730.038
Applied Maths Unit 286.9300.994380.174
Comm Studies Unit 177.5120.8931910.044
Department B (369 training samples)
Biology Unit 1629.5300.8513090.056
Biology Unit 2484.0300.8963030.056
Pure Mathematics Unit 2473.9300.961830.118
Pure Mathematics Unit 1336.7300.970900.098
Chemistry Unit 1187.8300.8962580.012
Environ Science Unit 2132.1300.9331820.007
Chemistry Unit 298.9240.9002550.009
Comm Studies Unit 140.5150.9293340.027
Mgmt of Business Unit 123.7300.99270.334
Environ Science Unit 115.8300.9841820.004
Department C (129 training samples)
Caribbean Studies Unit 13431.0300.5991170.197
Chemistry Unit 22699.5300.852800.104
Comm Studies Unit 12337.9240.7061200.307
Biology Unit 21096.4150.962610.263
Applied Maths Unit 1830.0300.915100.271
Pure Mathematics Unit 2612.5150.649840.022
Physics Unit 1568.7210.792930.030
Chemistry Unit 1431.790.906820.090
Applied Maths Unit 2302.4240.97390.428
Pure Mathematics Unit 1284.8270.768850.008
Department D (120 training samples)
Chemistry Unit 15659.5300.861470.222
Applied Maths Unit 25039.0300.807620.116
Pure Mathematics Unit 24879.4300.5991130.448
Physics Unit 23096.5300.775590.062
Chemistry Unit 22973.6180.888450.255
Comm Studies Unit 12849.6300.7921140.589
Applied Maths Unit 11540.4300.941620.116
Physics Unit 11068.0300.911600.050
Pure Mathematics Unit 1596.6150.9031140.529
Environ Science Unit 267.2300.99150.389
Department E (61 training samples)
Pure Mathematics Unit 13322.2300.923280.203
Biology Unit 2431.8120.958330.120
Caribbean Studies Unit 1155.160.957560.474
Biology Unit 1148.7120.979340.087
Pure Mathematics Unit 237.2300.999270.179
Mgmt of Business Unit 121.9300.99310.410
Mgmt of Business Unit 221.9300.99310.410
Comm Studies Unit 119.830.989560.474
Computer Science Unit 117.8300.99520.231
Computer Science Unit 217.8300.99520.231
All Departments (896 training samples)
Pure Mathematics Unit 22161.2300.8594290.067
Pure Mathematics Unit 11123.1300.9134450.057
Biology Unit 1908.2300.9304470.054
Biology Unit 2851.8300.9334380.058
Comm Studies Unit 1447.0300.8738170.084
Physics Unit 2331.0300.9133410.021
Physics Unit 1268.1300.9303430.022
Chemistry Unit 2193.7120.9674850.067
Chemistry Unit 1182.2120.9644910.060
Caribbean Studies Unit 1163.7180.9138080.067
Figure 2
Six line graphs depicting the average NMAE of students graduating GPAs using different features.The image contains six line graphs, each depicting the average Normalized Mean Absolute Error (NMAE) of students' graduating Grade Point Averages (GPAs) using different features. The x-axis represents the value of kappa (κ) ranging from 0 to 30, while the y-axis represents the average NMAE. Each graph shows how the average NMAE changes as the value of kappa increases. The graphs are labeled (a) through (f), each corresponding to different features and student departments. Graph (a) shows the average NMAE for students from Department A only and feature Pure Mathematics Unit 2. Graph (b) shows the average NMAE for students from Department A only and feature Pure Mathematics Unit 1. Graph (c) shows the average NMAE for students from Department A only and feature Chemistry Unit 1. Graph (d) shows the average NMAE for students from Department A only and feature Applied Mathematics Unit 2. Graph (e) shows the average NMAE for students from Department A only and feature Biology Unit 2.

The average NMAE of students graduating GPAs using κ = 0, 5, …, 30 with various datasets and features. (a) The average NMAE of students graduating GPAs using κ = 0, 5, …, 30, students from Department A only and feature Pure Mathematics Unit 2. (b) The average NMAE of students graduating GPAs using κ = 0, 5, …, 30, students from Department A only and feature Pure Mathematics Unit 1. (c) The average NMAE of students graduating GPAs using κ = 0, 5, …, 30, students from Department A only and feature Chemistry Unit 1. (d) The average NMAE of students graduating GPAs using κ = 0, 5, …, 30, students from Department A only and feature Applied Mathematics Unit 2. (e) The average NMAE of students graduating GPAs using κ = 0, 5, …, 30, students from Department A only and feature Biology Unit 2. (f) The average NMAE of students graduating GPAs using κ = 0, 5, …, 30, students from every department and features Biology Unit 2 and Department

Figure 2
Six line graphs depicting the average NMAE of students graduating GPAs using different features.The image contains six line graphs, each depicting the average Normalized Mean Absolute Error (NMAE) of students' graduating Grade Point Averages (GPAs) using different features. The x-axis represents the value of kappa (κ) ranging from 0 to 30, while the y-axis represents the average NMAE. Each graph shows how the average NMAE changes as the value of kappa increases. The graphs are labeled (a) through (f), each corresponding to different features and student departments. Graph (a) shows the average NMAE for students from Department A only and feature Pure Mathematics Unit 2. Graph (b) shows the average NMAE for students from Department A only and feature Pure Mathematics Unit 1. Graph (c) shows the average NMAE for students from Department A only and feature Chemistry Unit 1. Graph (d) shows the average NMAE for students from Department A only and feature Applied Mathematics Unit 2. Graph (e) shows the average NMAE for students from Department A only and feature Biology Unit 2.

The average NMAE of students graduating GPAs using κ = 0, 5, …, 30 with various datasets and features. (a) The average NMAE of students graduating GPAs using κ = 0, 5, …, 30, students from Department A only and feature Pure Mathematics Unit 2. (b) The average NMAE of students graduating GPAs using κ = 0, 5, …, 30, students from Department A only and feature Pure Mathematics Unit 1. (c) The average NMAE of students graduating GPAs using κ = 0, 5, …, 30, students from Department A only and feature Chemistry Unit 1. (d) The average NMAE of students graduating GPAs using κ = 0, 5, …, 30, students from Department A only and feature Applied Mathematics Unit 2. (e) The average NMAE of students graduating GPAs using κ = 0, 5, …, 30, students from Department A only and feature Biology Unit 2. (f) The average NMAE of students graduating GPAs using κ = 0, 5, …, 30, students from every department and features Biology Unit 2 and Department

Close Figure 2

For example, consider the top two entry subjects for department A, Pure Mathematics Units 1 and 2, with scores of 1617 × 10−6 and 1238.653 × 10−6, respectively. Unit 1 achieved better κopt and NMAE values, while Unit 2 achieved an ideal 50–50 distribution and a better Δμ value. These values show that Unit 1 is more useful for prediction accuracy, while Unit 2 is better for quantifying academic performance between groups with and without the subjects. In this case, our score ranked Unit 2 as better because the gain in quantifying academic performance outweighed the gain in predicting it.

Another interesting observation for Department A is the scores for Chemistry Unit 1 and Applied Mathematics Unit 2. The NMAE for applied mathematics is close to one, which says that we could not extract any useful information from this subject to help with prediction accuracy. However, the Δμ values suggest that the GPAs of graduating students, with and without either subject, are significantly better for applied mathematics. Since the dataset only has 38 and 42 grades for the applied mathematics and chemistry subjects, respectively, we do not know how reliable these Δμ′s are because both subjects’ distributions are far from the ideal 50–50 distribution. Based on the current dataset, chemistry is the better choice for Department A because it has four more samples, and its information is more useful for reducing prediction errors. Curious cases like this, which require more samples, can be monitored over time as the dataset grows and entry subject scores begin to shift.

Table 3 shows that for each department, the most impactful entry subjects are different. For example, Biology Unit 2 is in the top ten entry subjects for Departments B, C and E but not others. Results like these demonstrate that the algorithm can extract the most relevant entry-level subjects for departments that have different areas of focus and expertise. The data in Table 3 indicate that pure mathematics is universally important, regardless of the departmental focus. This observation is interesting because not every department has mathematics as a key area of focus or listed in their matriculation requirements. Table 3 suggests that applicants weak in or missing pure mathematics would be mismatched to Departments A through E, if they do not also have one or more of the other impactful subjects.

Another benefit of scoring entry subjects is monitoring for changes over time. For example, currently, Biology Unit 2 is the most important entry subject for Department B but is not in the top 10 entry subjects for Departments A and D. Table 3 shows that biology is the second most influential subject across all graduates from all faculties. Therefore, over time, if more students with grades in Biology Unit 2 do well in Departments A and D, their scores will be updated and move Biology Unit 2 up in the rankings.

The value of a specific entry subject to both department and applicant can be estimated from the experimental results. Consider the example of Biology Unit 2. Based on the current dataset, it is difficult for Department A to decide if an applicant with Biology Unit 2 is a good match. According to Table 4, on average, graduates with biology from Department A performed better than those without it. However, this observation is not robust because only 21 graduates had Biology Unit 2 grades. However, if the department considers the academic performance of all 438 graduates with biology across all departments, it can obtain a robust prediction for the Δμ on average. This value indicates that on average, a person's graduating GPA with biology is expected to be higher than someone without it by 0.058. Table 5 estimates the graduating GPA of applicants from Department A, who enter with a specific grade in CAPE Biology. Together, these results quantify the expected value of biology to the department and student better than the simple average of 21 samples. Specifically, on average, an applicant with biology is expected to graduate with a GPA of 3.368 from any department. Therefore, Department A would need to carefully consider applicants with biology grades of 2 or lower since they are predicted to perform on average closer to an applicant without biology from any department. Careful consideration is required because enrolling such students into Department A may potentially be unfair to both faculty and students.

Table 4

Analysis for entry subject CAPE biology unit 2

DepartmentScore×10−6κoptNMAESample sizeΔμμwith Bioμwithout BioTotal students
A4.8300.999210.1043.4503.346210
D0.001.000210.0343.3823.349120
All851.8300.9334380.0583.3683.310896
C1096.4150.962610.2633.4353.172129
B484.0300.8963030.0563.3483.292369
E431.8120.958330.1203.4323.31161
Table 5

Estimated performance of an applicant with CAPE biology unit 2 by entry grade in department A

Entry gradeEstimated GPA
13.519
23.306
33.279
43.254
53.283

A typical graduate would usually have grades that reflect three areas of focus. In our next experiment, we demonstrate how departments can quantify the potential impact of various entry subject combinations on graduating GPA. Table 6 compares the impact of popular combinations like mathematics, physics and chemistry and mathematics, physics and applied mathematics, with less popular mathematics, biology and applied mathematics and mathematics, physics and biology. These results indicate the more mathematics an applicant has on entry, the better for their graduating GPA, regardless of department. This observation is consistent with the impact of single-entry subjects in Table 3, where pure mathematics and applied mathematics were in the top 10 subjects for every department and 3 of 5 departments, respectively. Another interesting result is the pairing of biology with other subjects. On average, applicants who have biology are expected to perform better if they do more mathematics. However, at the departmental level, this may not be the case. For example, for Departments A and B, it is better if biology is paired with physics instead of applied mathematics, whereas for Departments C and D, more mathematics with biology is better. The associated score with the combinations also gives faculty a level of confidence in the recommendations. For example, in Department A, we are more confident about pairing biology with physics instead of applied mathematics since the scores are 91.7 × 10−6 and 22.0 × 10−6, respectively, than in Department B, where both combinations are predicted to have the same impact with scores of 350.9 × 10−6 and 344.0 × 10−6, respectively.

Table 6

Comparison of the experimental results for various entry student combination across Departments A to E

DepartmentCombinationScore×10−6κoptNMAESample sizeΔμTotal students
AllMath Phys App.Math688.9300.833740.109896
AllMath Phys Chem452.2240.8671120.073896
AllMath Bio App.Math356.4300.784100.323896
AllMath Phys Bio234.5300.781230.092896
EMath Phys App.Math31.7300.98710.31961
EMath Phys Chem0.001.000130.02761
EMath Bio App.Math0.0300.97603.37761
EMath Phys Bio0.001.00020.47461
AMath Phys App.Math500.6180.863220.126210
AMath Phys Bio91.7150.86620.310210
AMath Phys Chem47.9180.860200.014210
AMath Bio App.Math22.0270.85720.039210
BMath Phys Bio350.9300.82950.325369
BMath Bio App.Math344.0300.82830.537369
BMath Phys Chem117.8270.86950.161369
BMath Phys App.Math0.0300.95103.338369
DMath Phys Chem3198.790.641270.283120
DMath Bio App.Math3116.9270.51930.621120
DMath Phys App.Math1320.5120.607360.062120
DMath Phys Bio95.090.65350.049120
CMath Phys App.Math4256.0240.62090.428129
CMath Phys Chem1513.090.742350.155129
CMath Phys Bio936.5240.674110.091129
CMath Bio App.Math35.9300.61420.012129

Most departmental matriculation requirements specify entry subjects and a minimum grade. For example, consider that Department A specified all applicants must have a grade of one in at least one CAPE science subject. The mean graduating GPA of students who did not satisfy this exact rule is 3.34 across all departments. Table 7 illustrates how this criterion may not be fair to every applicant. Consider the results for κ = 15. Department A can expect an applicant, Alice, who achieved grade ones in all subjects, to graduate with a GPA higher than 3.34. These predictions indicate that her entry grades were beneficial to her in the context of that department. In contrast, the department would expect an applicant, Bob, who achieved grade ones in all subjects except for his grade three in the Pure Mathematics Unit 2, to perform close to average. Bob's entry grades do not seem to benefit him in this department, because on average, Bob is likely to graduate with the same GPA as someone who does not have this combination. In this example, both applicants satisfied the matriculation requirement, but Bob would be better advised to enroll in a department where he is expected to perform above average with his current entry grades. It is possible that Bob's entry grades do not distinguish him in any department. In this case, if he does enroll in Department A, there should be some type of intervention by the department to bridge the predicted 0.19 GPA gap between Bob and Alice. Suppose Bob had achieved his grade of three in Pure Mathematics Unit 1 instead of Unit 2. Department A can expect Bob to perform better than average. This scenario illustrates that a higher grade in Unit 2 is more beneficial to applicants. Performing a similar type of analysis with more entry subjects and grade combinations, departments can better understand the impact their matriculation requirements have on a student's graduating GPAs.

Table 7

Comparison of Department A's predicted graduating GPAs with κ = 0, 15 and 30 for the combination physics, mathematics and biology (units 1 & 2)

Physics unit 1Physics unit 2Pure mathematics unit 1Pure mathematics unit 2Biology unit 1Biology unit 2κ = 0κ = 15κ = 30
1111113.343.583.91
1112113.343.413.51
1121113.343.473.77
1113113.343.393.45
1131113.343.463.72

In the above scenario, we reemphasize that it is ultimately Bob's decision whether to choose Department A or not. The benefit here is that now both Bob and Department A can utilize the recommendation system to make informed decisions based on the predicted GPAs. Since removing the traditional matriculation requirements gives both Bob and Department A more access to programs and students, respectively, both parties must carefully weigh these predictions against other predictors of academic performance, which the model does not currently capture, e.g. applicant interest, full-time versus part-time students, educational background, etc.

Failure to consider other predictors of academic performance could lead to a stratification system. In this extreme scenario, departments would only accept applicants who score above a certain threshold. This policy would reduce access instead of increasing it, as departments will now deny applicants whom they would traditionally accept because they scored below the threshold. Naturally, a question of fairness arises. For example, suppose a science, technology, engineering and mathematics (STEM) department sets a very high threshold. Although it increases the likelihood that all accepted applicants will graduate with above-average GPAs, it denies those who did not perform well in STEM classes the opportunity to advance further in the STEM field. Is it fair for a department to accept students, knowing it cannot adequately support them based on its allocated resources? Also, is it fair to deny a highly motivated STEM student an opportunity to grow? These are complex issues that require future study.

A more balanced approach involves both applicants and the departments utilizing the system's scores to take proactive actions. Departments can utilize an aggregate version of Table 7 to quantify the impact of lowering thresholds and understand the amount and type of supporting resources that need to be acquired and deployed to ensure student success. Similarly, students can also understand how much more effort is required and in what subject areas to fill in the gaps.

In this paper, we presented a framework that uses a recommender system for enrollment. Specifically, this system must be able to quantify the level of personalization and impact each entry subject grade and combinations has on an applicant's success in specific departments. The prediction error, personalization score, difference in means with and without the entry subject and subject distribution are all factors that affect the confidence of a recommendation. We proposed a scoring metric to combine these concerns into a score between 0 and 1, where one represents the ideal case. Our score allows the algorithm to rank eligible departments in a way that is fair.

We demonstrated the effectiveness of our approach with a dataset of 1,114 samples from a Caribbean university across 5 departments. The experimental results scored the influence individual CAPE subjects and popular subject combinations have on the graduating GPA of students. We demonstrated how the system can compare an applicant's estimated graduating GPA for a department to the average graduating GPA of applicants who do not match its entry subjects. This comparison allowed us to score departments by likelihood of success based on an individual applicant's entry grades. Thus, instead of allowing applicants who meet matriculation requirements to enroll in a department where they are likely to perform just as well as someone without their entry grades, we can recommend placement in departments where they are likely to excel instead. This type of personalized placement is the key to a university maximizing departmental revenue and its students' academic performance.

In the future, we would like to extend our experiments to more departments and faculties. Other areas of interesting work are refining the score to reflect individual departmental preferences and formalizing the matching problem as an optimization problem to maximize student preferences, departmental enrollment and the likelihood of students' academic success. Also expanding the feature set to capture student motivation would enhance the quality of our scores.

Aciro
,
R.
,
Onen
,
D.
,
Malinga
,
G. M.
,
Ezati
,
B. A.
, &
Openjuru
,
G. L.
(
2021
).
Entry grades and the academic performance of university students: A review of literature
.
Education Quarterly Reviews
,
4
(
1
),
141
150
. doi:.
Alamoudi
,
A. A.
,
Fallatah
,
H. I.
,
Eldakhakhny
,
B. M.
,
Kamel
,
F. O.
,
AlShawwa
,
L. A.
, &
Elsamanoudy
,
A. Z.
(
2021
).
Relationship between admission criteria and academic performance in basic science courses in health science colleges in KAU
.
BMC Medical Education
,
21
, 94. doi: .
Amasuomo
,
J. O. M.
(
2014
).
Academic performance of students admitted with different entry certificate in Nigeria certificate in education programme in federal college of education (technical), Omoku
.
Journal of Technology and Science Education
,
4
(
1
). doi: .
Anderson
,
P.
,
Devonish
,
J.
,
Bailey
,
A.
, &
Daley
,
C.
(
2014
).
Differences in student access and performance at the university of the West Indies between 1983 and 2010
.
The UWI Quality Education Forum
,
20
(
1
),
Available from:
 Link to the website
Bailey
,
B.
(
2004
).
Gender and education in Jamaica: Who is achieving and by whose standard?
.
Prospects
,
34
(
1
),
53
69
. doi: .
Barroso
,
C. J. V.
,
Cainday
,
C. J. B.
,
Sedon
,
M. R. C.
, &
Tilanduca
,
D. G.
(
2022
).
Admission requirements and academic performance of learners in Higher Education Institution
.
Asia Pacific Journal of Social and Behavioral Sciences
,
20
,
119
138
. doi: .
Browne
,
R.
, &
Shen
,
H.
(
2017
).
Challenges and solutions of higher education in the Eastern Caribbean states
.
International Journal of Higher Education
,
6
(
1
),
169
. doi: .
Cobbett
,
M.
, &
Younger
,
M.
(
2012
).
Boys educational ‘underachievement’ in the Caribbean: Interpreting the problem
.
Gender Education
,
24
(
6
),
611
625
. doi: .
De Lisle
,
J.
(
2006
).
Dragging eleven-plus measurement practice into the fourthquadrant: The Trinidad and Tobago SEA as a gendered sieve
.
Caribbean Curriculum
,
13
,
91
129
.
Gooljar
,
S.
,
Manohar
,
K.
, &
Hosein
,
P.
(
2023
).
Performance evaluation and comparison of a new regression algorithm
. In
12th International Conference on Data Science, Technology and Applications (DATA 2023)
,
Rome, Italy
,
11-13 July 2023
.
Griffith
,
S. A.
(
2017
).
Lessons from CXC for Caribbean higher education institutions
.
Quality Assurance in Education
,
25
(
2
),
224
236
. doi: .
Harrykissoon
,
K.
,
Persaud
,
S.
,
Manohar
,
K.
, &
Hosein
,
P.
(
2023
).
On the prediction of Kidney Stone Formers
. In
IEEE International Conference on Technology Management, Operations and Decisions (ICTMOD)
,
Rabat, Morocco
,
2023
(pp. 
1
5
). doi: .
Hosein
,
P.
(
2023
).
A data science approach to risk assessment for automobile insurance policies
.
International Journal of Data Science and Analytics
,
17
(
1
),
127
138
. doi: .
Kutnick
,
P.
, &
Jules
,
V.
(
1988
).
Antecedents affecting science, achievement scores in classrooms in Trinidad and Tobago
.
International Journal of Educational Development
,
8
(
4
),
305
314
, doi: .
Kutnick
,
P.
,
Jules
,
V.
, &
Layne
,
A.
(
1997
).
Gender and school achievement in the Caribbean – education research paper No. 21, 1997
,
126
.
Available from:
 Link to the website [
Accessed
 21 November 2012].
Manohar
,
K.
, &
Hosein
,
P.
(
2023
).
Improving academic advising by predicting a student’s GPA given their chosen courses
. In
2023 IEEE International Conference on Technology Management, Operations and Decisions (ICTMOD)
,
Rabat, Morocco
,
2023
(pp. 
1
6
). doi: .
Manohar
,
K.
,
Manohar
,
K.
, &
Hosein
,
P.
(
2023
).
A novel data transformation approach for improved cluster performance
. In
IEEE International Conference on Technology Management, Operations and Decisions (ICTMOD)
,
Rabat, Morocco
,
2023
(pp. 
1
8
). doi: .
Moore
,
M. D. G.
,
Baboolal
,
K.
, &
Hosein
,
P.
(
2023
).
On the prediction of polycystic ovarian syndrome
. In
IEEE International Conference on Technology Management, Operations and Decisions (ICTMOD)
,
Rabat, Morocco
,
2023
. doi: .
Osmanbegovic
,
E.
, &
Suljic
,
M.
(
2012
).
Data mining approach for predicting student performance
.
Economic Review: Journal of Economics and Business
,
10
(
1
),
3
12
.
[PubMed]
,
University of Tuzla, Faculty of Economics, Tuzla
.
Stephen
,
D.
,
Welman
,
J.
, &
Jordaan
,
W.
(
2004
).
English language proficiency as an indicator of academic performance at A tertiary institution
.
South African Journal of Human Resource Management
,
2
(
3
). doi: .
Sulphey
,
M. M.
,
Al-Kahtani
,
N. S.
, &
Syed
,
A. M.
(
2018
).
Relationship between admission grades and academic achievement
.
Entrepreneurship and Sustainability Issues
,
5
(
3
),
648
658
. doi: .
Thiele
,
T.
,
Singleton
,
A.
,
Pope
,
D.
, &
Stanistreet
,
D.
(
2016
).
Predicting students' academic performance based on school and socio-demographic characteristics
.
Studies in Higher Education
,
41
(
8
),
1424
1446
. doi: .
Licensed re-use rights only

or Create an Account

Close subscription notice
Close access options