Little research compares hybrid to online and face-to-face (F2F) teaching. Nearly all this research assumes no difference in the students’ demographics entering F2F, hybrid, or online sections of a course. This study used all the data from 5 years of undergraduate courses at Kennesaw State University. The data set, which includes individual student section outcomes, included entire student demographics. Students in hybrid sections earned higher final course grades than those in online or F2F sections for all demographics. Differences in demographics affected how advantageous the hybrid method is over the online and F2F methods.

Researchers (e.g., Amparo et al., 2018; Stern, 2004) have studied the outcomes of pure online teaching compared to all-in-person (face-to-face, F2F) teaching, often called face to face in research. The literature review for this study yielded few research studies that compared hybrid teaching to online and F2F teaching (e.g., Lovern, 2010; Reasons et al., 2005). The term hybrid in this article refers to the traditional hybrid or flipped class where some of the class is in person and the rest online asynchronously. For example, a three- credit course meets for 11/2 hour a week for discussions and covers everything else online, including lectures and assignments. One can view hybrid education as a compromise between F2F and online teaching or alternately as taking the best parts of both. Another problem is that much previous research, such as McFarlin (2008), has considered only a single course or instructor. Some research, such as Blau and Drennan (2017), has considered student satisfaction with different methods and academic outcomes.

A possible gap in the research is that nearly all this research assumes that there is no difference in the characteristics or demographics of the students entering F2F, hybrid, or online sections of a course. The research gap identified is that there may be a difference in demographics between students who opt for one method over the others and that certain student demographic groups may do better proportionally in specific teaching formats. This research uses the entering characteristics of students, a large sample of many instructors, and the final mean course grade achieved to see if the benefits (including negative benefits) of hybrid and online over F2F methods depend on the characteristics of the entering student. Xu and Jaggers (2014) and Cavenaugh and Jacuemin (2013) hinted that student demographics could be different for the different methods.

This study used data across a whole university to investigate the demographic effect on student outcomes. No data after 2019 were used to avoid tainting because of COVID. This study is not an analysis of an experiment but an analysis of an existing data set, which existed before the study began. This study builds on a previous study that only used data from business school courses (Moodie, 2021).

The research questions examined were:

  1. Are there any differences (both with demographics and previous academic achievement) in the students using the different teaching methods across a university?

  2. Do students from different demographics and in different parts of the university have different student final grade outcomes in different methods?

Little previous research examined the differences in the type of students taking different methods, and the research assumed that students taking different were the same on average. We first report the conclusions of the larger research output that does not include hybrid courses. The minor research includes hybrid courses, such as Rivera (2016), who pointed out that the hybrid allows the hands-on lab experience that online cannot give for science courses.

Many studies, with sample sizes ranging from very small to very large, have compared the outcomes of online versus F2F courses. The following is a selection of some of the latest studies.

No Examination of Student Demographics

Stern (2004) examined online and F2F instruction for one course and concluded that the online method works as well as F2F if online instructors have enough time to do a thorough job. Sapp and Simon (2005) compared grades for online and F2F writing courses. They showed that more students thrived (A or A-) in F2F courses than in online courses (32% to 52%). Summers et al. (2005) examined grades for online versus F2F for a statistics course. They found no significant difference between methods of teaching. Kelly (2009) reported that she could find no significant difference between student grades for online and F2F methods. She did not control for entering grade point average (GPA). Dell et al. (2010) found no differences between online and F2F sections of a graduate human development and an undergraduate psychology course. Ni (2013) found no significant differences in outcomes between online and F2F classes. Amparo et al. (2018) used a large sample (96,000 students) across two institutions to compare online and F2F results. They found that F2F students outperformed online students in course final GPA. Blau and Drennan (2017) used students' perceptions to compare different teaching formats and suggested that universities find ways to increase the perceived favorability of online and hybrid courses for those that prefer F2F.

None of these studies examined whether the previously more successful students preferred a particular teaching method. In conclusion, most previous research, which compared online and F2F sections of courses, did not examine differences in precourse GPAs or any demographics of students. They found no significant difference in final course grades between methods or that online courses achieved worse final course grades than F2F ones.

Examination Included

Student Demographics

Cavanaugh and Jacuemin (2013) used a large sample size (5,000 courses) in one institution. They found no significant differences overall between online and F2F classes. They did find that students with good precourse GPA did better than those who did not have a good GPA. Online courses increased the effect of a higher precourse GPA. They also found that better students tended to do online courses, as the mean precourse GPA was 3.41 for online students, while only 3.02 for F2F students.

Xu and Jaggers (2014) researched an extensive data set of online and F2F courses (500,000 student-course sets). They did allow for differences in precourse GPAs. They found that males, younger students, Black students, and those with lower precourse GPAs did worse in online courses, while females and Asians had no significant differences. Older students did better in online courses. They also looked at the subject matter and reported that computer science, communication, and health had no significant differences. All others had F2F giving better results than online courses. The social sciences, business, law, and nursing showed the most significant differences. The teaching method affected starting students more adversely than continuing students.

Nguyen (2015) summarized research comparing F2F and online teaching methods. He found that, generally, the research considers online learning as better, but there were problems with much of this research due to selection bias and a lack of rigorous methodology. Amro et al. (2015) showed that F2F students got higher grades than students studying online for their algebra courses. Although they looked at age and gender factors, they did not look at precourse GPAs to see if the students were similar in academic ability.

Biel and Brams (2016) compared student performance in online and F2F courses. They encountered mixed results; some studies showed that the F2F course was better than some online courses. Sun and Chen (2016) reviewed 47 papers comparing online and F2F teaching methods. They concluded that online teaching works as well as or better than F2F if done correctly. An effective course has well- designed content, motivating interaction, and well-prepared and supported instructors.

Most studies did not look at the effect of demographic factors. However, Cavanaugh and Jacuemin (2013) found that students, who had been more successful previously, tended to choose online courses. Xu and Jaggers (2014) reported that the outcome differences between online and F2F depend on race, gender, previous GPA, and age. They showed that older students did slightly better in online courses. These two studies hinted that demographics and precourse GPA might affect course outcomes. Blau et al. (2019) used the students’ intent to transfer as an output measure.

Studies That Did Not

Examine Student Demographics

Several studies compared hybrid to either or both F2F and online methods. Reasons et al. (2005) examined the three teaching formats and concluded that online was better in achieving a higher mean final course grade than hybrid or F2F. McFarlin (2008) examined grade results for hybrid and online sections. He found that student learning, as represented by grades, increased in hybrid and online sections compared to F2F sections. Lovern (2010) found no significant difference in outcomes between online, hybrid, and F2F sections of the same course. They did not examine precourse GPA self-selection. Son et al. (2016) looked at a lab class they offered in the three formats. They concluded that grades were highest in a hybrid method and lowest in a purely online format.

Studies That Looked

at Student Experience

Mansour and Mupinda (2007) looked at students’ experiences rather than outcomes in online and hybrid classes. They found that students preferred hybrid classes, but some preferred online courses. The difference may be reflected in the students’ learning styles. Senn (2008) reported on student perceptions in the three methods for one course, and he concluded that students felt that hybrid sections were more difficult for his technology-heavy course.

Larson and Sung (2009) looked at hybrid sections and online and F2F. Unfortunately, they used student perceptions of learning effectiveness, not actual learning achieved, as a variable. They did not look at whether students self-select types of courses by their precourse GPA. They showed that students preferred hybrid over online and online over F2F.

Yuen (2011) concluded that teachers and students liked blending learning in terms of easier communication between parties and constant availability of resources and technology-assisted self-learning time, namely when students could not contact a teacher.

Kemp and Grieve (2014) looked at student preferences and outcomes between F2F and online activities. They found no difference in learning outcomes but found students preferred online for written assignments and F2F for discussions. Goerke (2018) examined the three methods of training for one Air Force course, and she found no difference in customer satisfaction between the three methods. Cathorall et al. (2018) assessed student performance in hybrid and online classes, and they found no difference in student grades but higher student evaluations in online courses.

Studies That Examined

Student Demographics

Brau et al. (2010) reported completion and success results in a course transitioning from F2F to hybrid and online methods. They found that completion rates increased significantly, as did success rates. They did not think this was due to better students entering online and hybrid sections, and hybrid sections had higher completion rates than online sections.

Price et al. (2016) looked at different factors on student performance and satisfaction across methods. They looked at age, sex, interaction, clarity, control, and motivation. They found little correlation between age or sex and student outcomes. They found that course design (participant interaction, learner control, and course clarity) affected student outcomes, and the method had no significant effect. Kim and Keuegar (2017) compared hybrid and F2F courses. They concluded that using two formats, F2F and online, in the same course can be challenging for instructors. Baum and McPherson (2019) examined learning in online and hybrid sections, taking into account the academic weakness of entering students. They suggested that students with weak academic backgrounds and other risk factors, including socioeconomic status, struggle in online classes, and hybrid classes, do not exhibit these problems.

The research that includes student differences showed it sometimes affected student outcomes. In addition, they found that hybrid sections often achieved better outcomes than either online or F2F sections.

Kennesaw State University (KSU) provided every student-course record in KSU's Banner system from 2015 to 2019 for all KSU undergraduate courses. The study did not use later data available because of the effects of COVID-19. KSU has offered COVID synchronous online, plus rotating hybrids, standard hybrid, full F2F, and asynchronous online sections. KSU has also told faculty to give students the benefit of the doubt when grading, and many pure F2F faculty had to teach online for the first time with little or no training. Thus, the study considers any data after 2019 as tainted.

The researcher removed from the data set all student-record data that had no grade awarded or had a grade of I (incomplete), S (satisfactory), or U (unsatisfactory), as these grades did not give a full indication of student learning.

Each student-course record set originally consisted of the following:

  1. An arbitrary random number instead of student name. The researcher deleted this column from the working database as not useful.

  2. Final course grade in letters. Letter grades were converted to numbers: A = 4, B = 3, C = 2, D = 1, F = 0.

  3. The previous overall university GPA of the student at the start of the course was missing for some students who were just entering KSU. Previous GPA varied from zero to four. Starting transfer and first- year students would have no previous GPA. The analysis only deleted the students with no previous GPA when examining the effect of previous GPA analysis only.

  4. Age varied from 14 to 75. The study removed all those under 18, a small number, for institutional review board reasons.

  5. The analysis converted teaching method [online (OL), hybrid (Hy), or all-in-person (F2F)] to zero-one variables. That is online is [1, 0, 0], hybrid is [0, 1, 0], and F2F is [0, 0, 1] for columns online, hybrid, and F2F.

  6. Term-Fall, Spring, or Summer. Some analyses used one for summer and zero for fall or spring because the summer term is a different length (2, 4, 6, or 8 weeks, rather than 15 weeks).

  7. Calendar year.

  8. Course name, consisting of discipline and number.

  9. College.

  10. Academic department home of the course. I deleted extraneous courses offered through non-KSU-only entities.

  11. Course number. The first digit of course number gave the course level (1 = freshman, 2 = sophomore, 3 = junior, or 4 = senior)

  12. Sex of student. This researcher converted this to male = 1, and female = 0.

  13. Reported ethnicity converted an ethnicity of Alien, Asian, Black, Hispanic, Multiethnic, and White to zero or one variable. For example, Alien was [1, 0, 0, 0, 0, 0] for columns Alien, Asian, Black, Hispanic, Multiethnic, and White. Other ethnicities, such as American Indian, Hawaiian, and Pacific Islander, were grouped under the term Pacific and would be [0, 0, 0, 0, 0] for Alien, Asian, Black, Hispanic, Multiethnic, and White columns.

  14. The analysis did not use Instructor ID, which was an assigned random number.

  15. Previous number of F2F courses taken.

  16. Previous number of hybrid courses taken.

  17. Previous number of online courses taken.

These categories provided 939,917 student-course data records for the analysis. However, there were missing data under some demographics or circumstances, such as the first course the student took at KSU. As a result, the number of records was smaller for some analyses.

Table 1 shows the basic properties of each variable in the data set. Note that hybrid student-section records are a minor (5.29%) part of the overall data set. In addition, ethnicities do not add up to 1, as some students did not choose an ethnicity (1.96%).

Table 1

Properties of All Variables With Mean, Standard Deviation, or Percentage of Total Dataset (N = 939,917).

Variable NameMean or %SD
Course grade2.9801.174
Previous GPA3.1130.600
Age22.15.432
Course level2.111.08
Previous # F2F courses17.2613.02
Previous # online courses2.093.23
Previous # hybrid courses0.9251.36
All in person method76.67%
Hybrid method5.29%
Online method15.86%
Summer term9.74%
Sex – % Male52.4%
Alien ethnicity1.99%
Asian ethnicity5.26%
Black ethnicity20.54%
Hispanic ethnicity9.9%
Multiethnic ethnicity4.52%
White ethnicity55.83%
Other ethnicities (incl. Pacific)0.11%
ANOVA
Source of VariationSSdfMSF
Between groups6E+081833,295,9613,463,181
Within groups1.7E+0817,609,2569.614
Total7.7E+0817,609,274

Note:Bold numbers are the correlations above 0.1. The paper deleted columns with no correlations above 0.1.

The statistical analysis used the final grade awarded for the course as the predicted variable and all the other variables as predictor variables. The research reports the most significant results from the many correlations in Table 2 and the most interesting results from many regression analyses of the primary data set in Tables 3 and 4.

Table 2

Partial Correlation Results of All Variables With Course Final Grade

VariableCourse GradeSex: MaleSummer TermAgePrev. # F2FPrev. # OnlinePrev. # Hybrid
F2F–0.025
Hybrid0.038
Online0.004
Sex: Male–0.078
White0.0960.035
Black–0.119-0.056
Hispanic0.0160.028
Asian–0.0170.000
Multiethnic0.0240.011
Alien–0.013–0.013
Summer Term0.037-0.006
Age0.0030.0410.105
Previous GPA0.436–0.117–0.002–0.043
Previous # F2F0.0330.0630.0630.137
Previous # Online0.0120.0960.0810.2700.104
Previous # Hybrid0.021-0.0880.0460.0320.2080.161
Level0.1170.0020.0750.2690.4280.2780.215
Year #0.0210.0050.017–0.037–0.0100.1370.106

Note: Bold numbers are the correlations above 0.1. Columns with no correlations above 0.1 were excluded.

Table 3

Regression on Course Grade Using All Predictors Without Previous GPA

StatisticValue
Multiple R0.933
Adjusted R²0.871
Standard Error1.149
Observations939911
ANOVAdfSSMSF
Regression168370061523128396008
Residual93989512416051.3210
Total9399119611666
VariableCoefficientStandard Errort StatP Value
F2F method2.9020.010295.590
Hybrid method3.0660.011276.620
Online method2.9180.010280.020
Sex: Male–0.1990.002–82.620
White0.0320.0083.928.69E-05
Black–0.3450.009–40.590
Hispanic0.0150.0101.510.129811
Asian–0.1220.009–13.576.4E-42
Multiethnic0.1130.0129.551.29E-21
Alien–0.1350.010–13.709.63E-43
Summer term0.1330.00432.561.8E-232
Age–0.0020.000–8.021.1E-15
Previous # F2F–0.0020.000–21.263E-100
Previous # online–0.0120.000–29.006.9E-185
Previous # hybrid–0.0080.001–8.511.73E-17
Level0.1540.001115.840

Note: Bold figures are regression coefficients above 0.1.

Table 4

Results of Regression of Course Grade With Only Previous GPA Including Zero Previous GPA

StatisticValue
Multiple R0.944
Adjusted R²0.892
Standard Error1.053
Observations798860
ANOVAdfSSMSF
Regression1730859173085916596406
Residual798859885108.31.108
Total7988608193699
VariableCoefficientStandard Errort StatP Value
Previous GPA0.95480.000372568.30

Note: Bold figure indicates regression coefficient above 0.1.

As expected, the highest correlation is between the course grade awarded to the student in the course and the student’s previous GPA. One would expect a student with a high previous university GPA to get a high grade on a course. There is a correlation between course level and age, and there is a low correlation between course level and final grade. There is also a negative correlation between course grades with Black ethnicity. Next, the study reports some regression analyses.

This regression backed up the correlation analysis. Male is a negative predictor, and Black ethnicity is the highest negative predictor, followed by Alien and Asian ethnicities. Course level was also a positive predictor.

The most significant correlation with course grade was previous university GPA; the analysis ran a regression with only previous GPA with the results reported in Table 4. The results included those records with zero previous GPA, which were for those student courses where the students had failed all courses taken before. The exercise was without the records with blank previous GPAs, which were for those students that had not taken any previous courses at KSU.

The initial analysis suggested that the teaching method relates to the final course grade, so the study analyzed more, giving the results in Table 5.

Table 5

Mean Data for All Students by Instructional Method

VariableF2FHybridOnlineAll
Course grade2.9593.1632.9882.975
%78.86%5.29%15.85%
N74124649709148962939917
Sex: Male54.56%44.43%45.55%52.60%
White55.67%54.22%57.14%55.83%
Black20.54%23.24%22.08%20.93%
Asian5.26%4.60%4.06%5.03%
Hispanic9.90%9.23%8.18%9.59%
Alien1.99%1.74%1.39%1.88%
Multiethnic4.52%4.93%4.83%4.59%
Summer7.15%9.57%22.67%9.74%
Age21.7822.1124.3422.20
Previous # F2F14.7914.6714.5614.74
Previous # Online1.271.754.421.79
Previous # Hybrid0.701.431.010.79
Level2.0732.3252.2292.111
Previous GPA3.1233.0883.0613.111
Table 6

T Test for All Students by Method Comparisons

StatisticF2F–HybridF2F–OnlineOnline–Hybrid
Mean Difference–0.044–0.029–0.015
Variance0.100–0.1370.237
Observations699536592283107253
Degrees of Freedom4691920695871836
t Stat–7.680–8.341–2.321
P(T ≤ t) one-tail8.1E-153.69E-170.0102
P(T ≤ t) two-tail1.62E-147.39E-170.0203
MethodMeanVarianceObservations
F2F2.9591.363741245
Hybrid3.0031.26341709
Online2.9881.500148962

Separating results by teaching method shows that the hybrid method leads to higher course grades over the online method (5.85%) and online over F2F (0.98%). Note that the previous GPA for a hybrid is lower than online(0.88%), which is lower than that for F2F (2.02%), but the hybrid method leads to higher course grades for a lower previous GPA. However, these results are for all students. Online students had done the most online courses previously, while hybrid students had previously done the most hybrid courses.

The t-test results shown above show that all the differences in method course grade mean, although small, is significant. The t test between F2F and hybrid was 7.68, between

F2F and online was 8.34, and between hybrid and online was 2.32. Therefore, the differences in final grades between F2F and the other methods were highly significant, while that between online and hybrid was significant.

Previous university GPA before the start of the course is a strong indicator of academic ability. Hence, one would expect students with high previous university GPAs to get better final course grades. The analysis split previous GPA into eight bands, where the number is lowest GPA of band and band includes up to the next GPA listed above. Note that the previous GPA “0" row is for those students who had only filed for a course before at KSU. Figures 1 and 2 show the effect of the previous GPA.

Figure 1

Percentage of Students by Previous GPA Band and Method

Figure 1

Percentage of Students by Previous GPA Band and Method

Close modal
Figure 2

Course Final Grade for All Students by Instructor Method and Previous GPA Band

Figure 2

Course Final Grade for All Students by Instructor Method and Previous GPA Band

Close modal

Note that the previous GPA band distribution was nearly the same for all methods except that F2F had far more than the previous GPA band of below 2.5. F2F has marginally more from higher previous GPA bands and online more from middle previous GPA bands.

This shows that whatever the previous GPA band, the mean final grade is better for hybrid, which is better than online (except for the lowest two bands), which is better than F2F. Again, for all methods, the average grade for students who had not done courses at KSU before is slightly less than that for all students.

Figures 3 and 4 show the effect of the previous GPA when split by sexes.

Figure 3

Percentage Data for all Students by Previous GPA Band and Method

Figure 3

Percentage Data for all Students by Previous GPA Band and Method

Close modal
Figure 4

Percentages With Hybrid Method for Ethnicity and Previous GPA Band for Hybrid Method

Figure 4

Percentages With Hybrid Method for Ethnicity and Previous GPA Band for Hybrid Method

Close modal

Note that the percentage of males increases with a lower previous GPA for all methods. The percentage of males is about the same for those doing first courses at KSU as the percentage for all.

Analysis Using Previous GPA and Ethnicity

Figures 4,,5, and 6 show the effect of the previous GPA when split by ethnicity by method.

Figure 5

Percentages With Hybrid Method for Ethnicity and Previous GPA Band for Hybrid Method

Figure 5

Percentages With Hybrid Method for Ethnicity and Previous GPA Band for Hybrid Method

Close modal
Figure 6

Percentages With Online Method for Ethnicity and Previous GPA Band for Online Method

Figure 6

Percentages With Online Method for Ethnicity and Previous GPA Band for Online Method

Close modal

The percentage of the Black ethnicity increases with lower previous GPA for all methods. Note that the figures for students in the first courses at KSU are very similar to those for all.

Analysis for Sex

The analysis examined the results by vari ous student characteristics against the sex of the student and the method. Figures 7 and 8 summarize percentages and mean course grades by method.

Figure 7 shows that the overall sex balance is 52.6% male to 47.4% female. Despite this, females do more online and hybrid courses proportionally than male students. 18.2% of female student courses are online versus 13.7% for males. Proportionally, more female students (6.2%) do hybrid than male (4.5%) students.

Figure 7

Percentage Data for Sex by Sex and Method

Figure 7

Percentage Data for Sex by Sex and Method

Close modal

Figure 8 shows that hybrid is best for the final course grade for both sexes, but for females, F2F is better than online, while it is the opposite for males. Females get appreciably higher grades than males in all the methods, with the most significant differential in hybrid.

Figure 8

Grade Data for All Students by Sex and Method

Figure 8

Grade Data for All Students by Sex and Method

Close modal

Analysis by Ethnicity

The study considered whether different ethnicities were better at doing specific methods for their courses. Some students reported N/A or unknown for ethnicity, and thus, this analysis did not use those. Note that the Pacific ethnicity is a combination of Hawaiian, Pacific Islander, and Indigenous American ethnicities, a tiny proportion of the whole student body. Figures 9, 10, and 11 summarize the data.

Figure 9

Percentage Data for All Students by Ethnicity and Method

Figure 9

Percentage Data for All Students by Ethnicity and Method

Close modal
Figure 10

Percentage Data Compared to White, for All Students by Ethnicity and Method

Figure 10

Percentage Data Compared to White, for All Students by Ethnicity and Method

Close modal

Notice that the Black ethnicity predominantly attends the most hybrid sections and the Pacific ethnicity the least. The Black ethnicity attends the most online and the alien ethnicity the least. ICE regulations limit alien students in the proportion of courses they can take online.

Here, the Alien, Asian, Hispanic, and Pacific ethnicities do more F2F sections proportionally. In contrast, the Black and multiethnic ethnicities proportionally do more hybrid and online sections. The Alien, Asian, and Hispanic ethnicities do far fewer online sections, and the Pacific ethnicity does fewer hybrid sections proportionally.

Note that for all ethnicities in Figure 11, the hybrid method produces the highest grade, and for all except the Hispanic ethnicity, online is better than F2F. The study now uses the White ethnicity mean as the base case in Figure 12, the largest ethnicity. So, the analysis compared the other ethnicities with the White ethnicity for the mean course grade.

Figure 11

Grade Data for All Students by Ethnicity and Method

Figure 11

Grade Data for All Students by Ethnicity and Method

Close modal
Figure 12

Final Grade Data Compared to White, for All Students by Ethnicity and Method

Figure 12

Final Grade Data Compared to White, for All Students by Ethnicity and Method

Close modal

Note that the alien ethnicity does better than the White ethnicity in all methods. The Asian ethnicity has better grades than the White ethnicity in hybrid and online sections. However,the Black ethnicity reduces their deficit to the White ethnicity in hybrid sections, compared to F2F and online sections.

Analysis by Ethnicity and Sex

The analysis then separated ethnicities by sex in Figures 13 and 14.

The analysis then looked at the combination of ethnicity, sex, and method for course grade in Figure 15. Note that the Black and multiethnic ethnicities are the only ethnicities where there are more females than males.

Note that females have higher mean grades than males for all ethnicities and all methods, except the Pacific ethnicity, in online sections. The online proportion of the Pacific ethnicity is only 0.01% of the total student courses. The hybrid sections give the highest mean grade for all sex and ethnicity combinations.

Figure 13

Percentage of Ethnicity and Sex for All Students by Ethnicity, Sex, and Method

Figure 13

Percentage of Ethnicity and Sex for All Students by Ethnicity, Sex, and Method

Close modal
Figure 14

Percentage of Ethnicity That Is Female by Ethnicity

Figure 14

Percentage of Ethnicity That Is Female by Ethnicity

Close modal
Figure 15

Mean Course Grade Data by Ethnicity and Sex for Method

Figure 15

Mean Course Grade Data by Ethnicity and Sex for Method

Close modal

Analysis by Course Level

The study then investigated if the results varied by course level. Figure 16 shows some of the results.

Figure 16

Percentage of Student-Courses for All Students by Course Level and Method

Figure 16

Percentage of Student-Courses for All Students by Course Level and Method

Close modal

Note that overall, there is a drop in total student courses from the first-year students to sophomore years and from the junior to senior years. The percentage of hybrid and online student courses increased in the upper division. Interestingly, the overall mean final grade for all student courses is almost a B (3.975).

A hybrid has higher final grades than online and F2F at all levels. Online is almost the same as in all levels as F2F (marginally higher in sophomore and junior levels, and lower in freshmen level). Grades go slightly up with level for all methods. The mean F2F section grades at the senior level are higher than in online sections.

Analysis for Academic Term

The analysis looks at whether courses in summer have different student demographics and outcomes from the rest of the year. The summer term courses are 2, 4, or 8 weeks long, instead of 15 weeks for the other terms. KSU also emphasizes online teaching for the summer term. Figures 18 and 19 summarize the data for percentage and grade.

Figure 17

Mean Course Grade for All Students by Course Level and Method

Figure 17

Mean Course Grade for All Students by Course Level and Method

Close modal
Figure 18

Percentage for All Students by Term and Method

Figure 18

Percentage for All Students by Term and Method

Close modal
Figure 19

Mean Course Grade for all Students by Term for Method

Figure 19

Mean Course Grade for all Students by Term for Method

Close modal

These data show that fall and spring are similar in method distribution, but summer has a far higher percentage of online sections. The hybrid percentage does not vary much with the term.

There is not much difference in F2F and online method course final grades for all terms. However, the summer term has higher mean grades for all methods, and hybrid is the best for all terms. There is little difference between fall and spring in mean grades.

Analysis by Year

The analysis next looked at whether these percentage results had varied with the calendar year and reported some results in Figures 20 and 21.

Figure 20

Percentage of Year by Calendar Year for Teaching Method

Figure 20

Percentage of Year by Calendar Year for Teaching Method

Close modal
Figure 21

Course Grade Data for Calendar Year and Teaching Method

Figure 21

Course Grade Data for Calendar Year and Teaching Method

Close modal

The percentage of online sections has been rising steadily while that of F2F decreased, and the hybrid percentage remained flat. The analysis next looked in Figure 21 at whether the course grade results had varied with the calendar year. Figure 21 shows that the hybrid method has produced superior grades for 5 years. Online, which was below F2F, is now just above F2F. There has been a general increase in all average grades year to year.

Analysis by Age

The analysis by student age, using 16 age bands, shows the percentage results in Figure 22. Each number for a band shows the lowest age in the band, with the band covering up to just below the next age band below.

Figure 22

Percentage Data for Student Age Band and Teaching Method IAP PR

Figure 22

Percentage Data for Student Age Band and Teaching Method IAP PR

Close modal

There is a decline in F2F and hybrid methods with the student age band. The analysis by student age shows the mean course grades in Figure 23. The data show that hybrid is best for all ages of students. Interestingly, the mid-20s course dips for all methods, and the best average grades occur in the over 40s.

Figure 23

Course Grade Data by Student Age Band for Teaching Method

Figure 23

Course Grade Data by Student Age Band for Teaching Method

Close modal

Analysis by College

The study reports in Figure 24 the relative size of the college and Figure 25 whether the college that offers a course affected the percentage of student demand with different methods.

Figure 24

Percentage of All Student-Courses by College

Figure 24

Percentage of All Student-Courses by College

Close modal
Figure 25

Percentage of Student-courses in each College by Method

Figure 25

Percentage of Student-courses in each College by Method

Close modal

Note that all colleges, except Honors, offer both online and hybrid sections. Otherwise, the percentages vary a lot. Hybrid varies from 9.4% to 0.7%; online from 36% to zero. The study investigated whether the college that offers a course affected the average course grade with different methods and reported results in Figure 26.

Figure 26

Mean Final Grade Awarded in Each College by Method

Figure 26

Mean Final Grade Awarded in Each College by Method

Close modal

Note that hybrid sections have the highest mean grade in all colleges except three (in bold italics). University, and Architecture and Construction, which are tiny colleges, have their online section with the highest grades, while education, a large college, had F2F as the best.

Analysis by Department

The investigation then reported the percentage method data for each department in Table 7.

Departments had large variations in how they used teaching methods. Online use varied from 100% (Cybersecurity) to 0% (IT). Hybrid use varied from 34.3% (Industrial and systems engineering) to 0% (10 departments). The investigation then looked at each department's mean course grade data in Tables 8 and 9.

Table 7

Distribution of Instructional Methods by Department

DepartmentF2F % Dept.Hybrid % Dept.Online % Dept.Dept. % All
Accountancy91.34%0.19%8.47%2.676%
Architecture100.00%0.00%0.00%0.801%
Art and design84.17%2.78%13.05%1.836%
Biology91.51%0.18%8.31%6.638%
Business college courses91.16%0.27%8.57%0.059%
Chemistry94.76%5.20%0.04%4.704%
Civil and environmental engineering91.27%3.52%5.21%2.424%
Communication and media67.67%15.85%16.47%3.643%
Computer engineering99.97%0.02%0.00%0.517%
Computer science85.18%4.73%10.09%1.599%
Construction management98.40%1.29%0.32%0.876%
Culinary and hospitality88.48%1.46%10.06%0.986%
Cybersecurity0.00%0.00%100.00%0.079%
Dance87.25%0.00%12.75%0.473%
Early childhood education88.03%5.31%6.66%1.134%
Economics, finance, Q&A88.18%2.91%8.91%4.647%
Electrical and computer engineering96.59%0.00%3.41%1.449%
Engineering technology81.85%8.15%10.00%0.980%
English69.61%13.91%16.48%6.791%
Exercise science and sport82.87%6.42%10.71%1.670%
First year, trans studies86.54%8.00%5.45%1.336%
Foreign languages80.91%4.07%15.02%1.788%
Geography and anthropology54.55%6.41%39.04%3.135%
Georgia Film Academy, USG100.00%0.00%0.00%0.024%
Government and international73.83%2.64%23.52%3.234%
Health and physical education65.68%8.23%26.09%3.307%
History/philosophy86.19%0.16%13.65%5.158%
Honor’s department98.98%1.02%0.00%0.073%
Inclusive education50.52%6.10%43.38%0.421%
Industrial and system engineering33.02%34.32%32.66%1.016%
Information systems47.18%1.51%51.32%1.433%
Information technology26.08%10.42%63.50%1.015%
Instructional technology100.00%0.00%0.00%0.128%
Interdisciplinary studies38.02%13.78%48.20%2.629%
Management, entrepreneurial, and hospitality59.48%5.08%35.44%2.631%
Marketing and sales55.88%0.52%43.60%1.520%
Mathematics94.45%0.28%5.27%7.915%
Mechanical engineering97.56%1.56%0.88%1.778%
Music83.29%0.22%16.49%2.083%
Nursing84.83%11.48%3.68%0.948%
Physics98.16%0.00%1.84%2.636%
Psychology60.86%24.53%14.61%3.497%
Robotics and mechatronics engineering99.98%0.01%0.01%0.251%
Secondary and middle grades71.16%20.80%8.04%0.296%
Social work and health sciences75.99%11.97%12.04%0.818%
Sociology and criminal justice68.15%0.41%31.43%3.275%
Software and game71.70%1.40%26.90%1.904%
Statistics and analytical science87.76%1.59%10.65%1.055%
Tech communication and interior design56.95%18.95%24.10%0.725%
Theater and political science76.65%0.98%22.37%0.960%
All78.85%5.29%15.86%
Mean77.3%5.4%17.4%2.0%
Table 8

Grade Data for All Students by Department and Method

DepartmentAllF2FHybridOnlineBest MethodHybrid–F2FHybrid–OnlineOnline–F2F
Accountancy2.8812.8733.4352.955Hybrid0.5620.4790.083
Architecture2.8782.878
Art and design3.2003.1853.5473.228Hybrid0.3620.3190.043
Biology2.7612.7562.7232.807F2F–0.033–0.0830.050
Business college3.0573.844F2F
Chemistry2.5942.5593.2402.368Hybrid0.6810.872–0.191
Civil and environmental engineering3.0463.0642.9752.777F2F–0.0890.198–0.287
Communications and media3.0223.0163.1372.956Hybrid0.1220.181–0.060
Computer engineering3.0293.029F2F
Computer science2.8992.9292.4382.859F2F–0.491–0.421–0.070
Construction manager3.3533.3483.6233.731Online0.275–0.1080.383
Culinary and hospitality2.9852.9883.3762.897Hybrid0.3880.479–0.091
Cybersecurity3.0283.028Hybrid
Dance3.5593.6093.216F2F–0.394
Early childhood education3.5813.6053.5373.299Online–0.0680.238–0.306
Economics, finance, Q&A2.8822.8443.4813.161Hybrid0.6380.3210.317
Electrical and computer engineering3.0743.0763.030F2F–0.045
Engineering technology2.9022.9172.9202.762Hybrid0.0030.158–0.155
English3.0713.1083.0112.965F2F–0.0970.046–0.143
Exercise science and sport2.9693.2583.6303.473Hybrid0.3730.1570.215
First year, transfer students3.2203.3042.7592.554F2F–0.5460.205–0.750
Foreign languages3.0533.1193.4012.603Hybrid0.2820.798–0.516
Geography and anthropology2.9962.9442.8763.046Online–0.067–0.1700.103
Georgia Film, USG3.3673.367F2F
Government and international affairs2.8502.8002.9232.998Online0.123–0.0750.198
Health and physical education3.2133.2643.3053.055Hybrid0.0410.250–0.209
History/philosophy2.7462.7703.1042.589Hybrid0.3340.515–0.180
Honor’s department3.8113.8092.953F2F–0.856
Inclusive education3.4803.5293.4613.424F2F–0.0690.036–0.105
Industrial and system engineering3.2693.3633.2653.180Hybrid–0.0980.084–0.183

Table 9 lists the number of departments for which each method was the best. These data show considerable variation in the best method for a department.

Table 9

Number of Best Methods for Course Grades by Departments

Method# Best in
F2F14
Hybrid20
Online6
Hybrid not offered10
All50

The base data set has only 5.29% of all student-course records in hybrid sections, which may mean that the results are heavily biased toward online and F2F methods. However, due to a large number of student-course records, this analysis probably gives out helpful information. The analysis also showed little difference in the type of student who did each method, except older students tended to do more online courses. The most important predictor of a student’s grade was their previous GPA, followed by ethnicity and sex. This research replicates most previous studies with larger student populations but more information on how student types affect the results.

Detailed Results for Course Final Grade

Method

Overall, average hybrid grades were higher than online and F2F grades, and there was a significant difference between the methods for the average course grade.

Previous GPA

The most significant predictor of a student’s final grade in a course was their previous university GPA at the start of the course. The breakdown of previous GPA bands was very similar across the methods, except the F2F method had a far higher proportion of previous GPAs below 2.5. F2F had marginally more in higher previous GPA bands, and online had marginally more in middle previous GPA bands. F2F also had a constant proportion of more males for all previous GPA bands.

Hybrid had higher grades for all previous GPA bands than online, which had higher than F2F. Grades for those who had not done KSU courses before were like the average of all bands.

While the percentages of students were nearly the same for all previous GPA bands, this was not true for the Black ethnicity. The Black ethnicity proportion increased for all methods with lower previous GPA.

Sex

Female students tend to get higher final grades than male students in all methods. However, hybrid is the best for both sexes, and Online is second best for females, while F2F is second best for males.

Ethnicity

Proportionally, the Black ethnicity has the highest percentages for hybrid and online methods, and Aliens have the highest percentage for F2F method. This difference is probably because ICE regulations limit Aliens’ use of online sections.

Aliens tend to get the highest final course grades, and Black students get the lowest grades. Hybrid gives the highest final course grades for all ethnicities. However, the hybrid advantage is most significant for the Black ethnicity and least for the Hispanic one.

Ethnicity and Sex

Proportionally, the Black people and multiethnic ethnicities have a higher proportion of females than males, and the other ethnicities have more males. For hybrid, the largest group proportionally are female Blacks, and for online, the largest group proportionally is multiethnic females.

For all ethnicities for all methods, except the Pacific online combination, females achieve higher grades than males of the same ethnicity. Hybrid methods give the highest mean grade for all combinations of sex and ethnicity.

Course Level

The percentage of students using the online and hybrid methods is higher for upper-division courses than lower division ones. However, the proportion of the total student courses for all methods drops with higher level. Approximately 40% of all student courses are for freshman classes. The course grade increase for all methods with course level. However, for all course levels, hybrid gives higher grades.

Course Term

There were proportionally far more online courses in summer terms. However, the hybrid proportion remained constant over the three terms. For all methods, summer courses had higher grades than other terms. For all terms, hybrid had the highest mean grades.

Year

While the proportion of online sections increased over the years, the proportion of hybrid student courses remained much the same. Grading within each method did not vary much with year, and hybrid had the highest mean course grades for all the years. However, the mean course grade did increase slightly with each year.

Age

While the proportion of online students increased with age, rising to above 34% for the over 40s, that for hybrid was constant. Course grade dipped in the mid-20s, then rose to be the highest for the over 40s. The hybrid method was the best for all ages.

College . While all except the honors college offered online and hybrid sections, the proportions varied widely. Hybrid varied from 9.4% to 0 and online from 36% to 0. The hybrid method was the best in all colleges except for three, Online was the best in two, and F2F was the best in one education.

Department

Online offerings varied from 100% to zero and hybrid from 34.3% to zero. Ten departments did not offer hybrid sections. In 20 colleges, hybrid was best; in 14, F2F was best; and online was the best in six.

  1. The use of a previous GPA to represent the academic ability of an incoming student is a convenient assumption. However, that is how most students rate their learning.

  2. The use of course final grade to represent learning from a course is a common approximation of learning.

  3. This analysis did not consider other factors like how many online or hybrid courses the student had done before the course, how many online or hybrid courses the student took simultaneously, whether the student was only taking online courses, or mixing F2F with online and hybrid courses.

  4. In the main study, hybrid sections were only a small proportion of the total data.

  5. The study did not examine differences between instructors. However, many instructors grade harder than others do for the same course, and hybrid teaching instructors may grade higher than those only teaching other methods.

  6. The data for this case study comes from one university, and other universities and colleges may show completely different patterns.

This analysis supported previous research such as Means et al. (2010). They considered that students in online conditions performed

method mostly better, on average than those learning the same material through traditional all-in-person instruction. Instruction combining online and all-in-person elements had a larger advantage relative to purely all-in-person instruction than did purely online instruction.

  • Are there differences (both with demographics and previous academic achievement) in the students using the different teaching methods?

    There are variations between the demographics of students doing the different methods. For example, more females and Black people tend to do hybrids. However, the differences are not significant.

  • Do students from different demographics and in different parts of the university have different student final grade outcomes in different methods?

    There are apparent differences between outcomes for different teaching methods, and different demographics affect these outcomes. For example, Black people benefit the most from taking hybrid courses. There are apparent differences in how different departments use different teaching formats.

Bernard (2014) conducted a meta-analysis and found that technology has an overall positive effect on learning but focuses on blended learning and interaction with technology in higher education. They concluded that blended learning and technological interaction enhance student achievement, and this analysis supports their findings.

Currie (2016) claimed five reasons hybrid achieved better results.

  1. Students manage their time better to meet the course deadlines.

  2. Students get professor and classmate face time.

  3. Everyone is equal in online discussions.

  4. The learning does not stop when students leave the classroom.

  5. It can provide deeper and more effective learning.

This study supports his assertion that hybrids get better results. Moreover, it would be interesting to test his five reasons with further research.

An additional question arises from these results. Why, if the hybrid method generally results in higher course grades, do instructors teach such a small proportion this way? Financially, hybrid courses save capital and operating costs. If all F2F courses became hybrid, one would need half the number of classrooms for the same number of student sections.

However, one possibility is the increased workload for instructors. To teach a hybrid section, instructors will have to spend as much time setting up the online portion before class and administering the course as in online sections, and then they must spend the time to turn up on campus and teach in person in a classroom. So effectively, hybrid instructors are teaching the equivalent of half a F2F section plus a completely online section.

Based on these data, one may consider counseling Black ethnicity students to do hybrid sections of a course. Simpson (2006) considered the ethical implications of telling students their likelihood of success based on the teaching method. Other implications are that the administration may want to consider offering more hybrid sections in courses and less F2F. Alternatively, it may be that the type of instructor who wants to teach in a hybrid method gives higher mean course grades. This study would not apply if instructors who prefer F2F teaching started to teach hybrids (as has happened during COVID).

Another implication is that if junior and senior students do better in online and hybrid sections, a university need not build new classrooms to manage an increased student load. Alternately, if student numbers are falling or the same, administrators should consider reducing the number of classrooms by selling off or repurposing their surplus real estate. Although KSU is a high admittance rate institution, it is not an open institution. However, the implications of the advantages of hybrid teaching should work for open institutions, too, possibly through synchronous online classes.

One should repeat the same analysis using only data from those instructors who teach hybrid as one of their methods and ignore all data from instructors that do not teach in the hybrid method. As many courses are now, due to the COVID pandemic, being taught using the rotating hybrid (such as Hyflex, where one teaches in-person and online at the same time) and synchronous online (which is F2F but not in person) methods, then there should be research to examine how these new methods affect results.

While this study showed hybrid method teaching had better results than F2F, it did not show why. One line of interesting research would be to find out why hybrid does better. One theory could be that hybrid only does the interesting interactive stuff in person, while the less interesting basic learning is done online. Another theory might be that knowledge acquisition is best made using students’ preferred learning times and speed. In contrast, more advanced learning is best done in an interactive in-person manner. There is also the possibility that the instructors who give higher grades tend to be those who teach hybrid courses.

One other line of study would be to look at the rest by type of subject. That is, science, social studies, and art find if the lessons apply across all sorts of subject matter or only to certain types of subject matter.

It would be interesting to do similar studies with other universities and colleges to see if KSU's patterns are similar or different. If done with several other teaching institutions and one found similar results, then one could make generalized conclusions on the effect of the teaching method on course grades.

Amro
H. J.
Mundy
M.–.&
Kupczynski
L.
.(
2015
).
The effects of age and gender on student achievement in all-in-person and online college algebra classes
.
Research in Higher Education
,
27
,
1
22
.
Amparo
A. R.
&
Smith
G.
.(
2018
,
June
).
Gender and persistent grade performance differences between online and face-to-face undergraduate classes
.
Proceedings from EdMedia+Innovate Learning Conference
.
Amsterdam, Netherlands
.
Baum
S.
&
McPherson
M. S.
.(
2019
).
The human factor: The promise & limits of online education
.
Daedalus, the Journal of the American Academy of Arts & Sciences
,
148
(
4
),
235
254
.
Bernard
R. M.
Borokhovski
E.
Schmid
R. F.
Tamin
R. M.
&
Abrami
P. C.
.(
2014
).
A meta-analysis of blended learning and technology use in higher education: From the general to the applied
.
Journal of Computing in Higher Education
,
26
(
1
),
87
122
.
Biel
R.
&
Brams
C. J.
.(
2016
).
Traditional versus online biology courses: Connecting course design and student learning in an online setting
.
Journal of Microbiology & Biology Education
,
17
(
3
),
417
422
.
Blau
G.
&
Drennan
R.
.(
2017
).
Exploring differences in business undergraduate perceptions by preferred classroom delivery model
.
Online Learning
,
21
(
3
),
222
234
.
Blau
G.
Gaffney
M. A.
Schirmer
M.
Ozkan
B.
&
Kim
Y. J.
.(
2019
).
Exploring the relationship of background, technology, and motivation variables to business transfer intent for two mixed course format business undergraduate samples
.
Online Learning
,
23
(
1
),
80
&-
94
.
Brau
M.
Christian
S.
Hill
B.
McNair
S.
Sandoz
S.
&
Taylor
C.,
(
2010
).
Success and retention in online and hybrid courses
.
Lane Community College, Online Teaching and Learning Project, Phase 1
.
Lane Community College paper.
Cathorall
M. L.
Xin
H.-B.
Blankson
F.
Kempland
M.
&
Schaefer
C.
(
2018
).
Assessing student performance in hybrid versus web-facilitated personal health courses
.
The Turkish Online Journal of Educational Technology
,
17
(
1
).
Cavanaugh
J.
&
Jacquemin
S. J.,
(
2013
).
A large sample comparison of grade-based student learning outcomes in online versus face-to-face courses
.
Online Learning
,
19
(
2
),
454
&-
461
.
Currie
K.
.(
2016
).
5 reasons hybrid learning might be right for you
.
Northeastern University Graduate Blog
.
Retrieved from
https://www.northeastern.edu/graduate/blog/5-reasons-hybrid-learning-might-be-right-for-you/
Dell
C. A.
Low
C.
&
Wilker
J. F.
(
2010
).
Comparing student achievement in online and face-to-face class formats
.
MERLOT Journal of Online Learning and Teaching
,
6
(
1
).
Goerke
L. F.
(
2018
).
Student satisfaction in traditional, online, and hybrid continuing education courses.
Eaker Paper 1, Air University Press
.
Maxwell AFB, Alabama.
Kelly
V. A.
(
2009
).
A quantitative study of course grades and retention: Comparing online and face-to-face classes
.
[Doctoral dissertation]
.
Baker University
,
Topeka, Kansas.
Kemp
N.
&
Grieve
R.
(
2014
).
Face-to-face or face-to-screen? Undergraduates’ opinions and test performance in classroom vs online learning
.
Educational Psychology
,
5
,
Article 1278
,
1
11
.
Kim
D.–Y.
&
Krueger
T. M.
.(
2017
).
Comparison of student success in hybrid and traditional introductory finance classes
.
Journal of Accounting & Finance
,
17
(
5
),
124
134
.
Larson
D. K.
&
Sung
C.–H.
.(
2009
).
Comparing student performance: Online versus blended versus face-to-face
.
Journal of Asynchronous Learning Networks
,
13
(
1
),
31
44
.
Lovern
J. J.
.(
2010
).
Is there a difference in student achievement based on the delivery model in an undergraduate assessment course: A comparison of face-to-face, hybrid, and online sections
.
Proceedings from EdMedia+Innovate Learning Conference
.
Toronto, Canada.
Mansour
B. E.
&
Mupinga
D. M.
.(
2007
).
Students’ positive and negative experiences in hybrid and online classes
.
College Student Journal
,
41
(
1
),
242
248
.
McFarlin
B. K.
.(
2008
).
Hybrid lecture-online format increases student grades in an undergraduate exercise physiology course at a large university
.
Advances in Physiology Education
,
32
,
86
91
.
Means
B.
Toyama
Y.
Murphy
R.
Bakia
M.
&
Jones
K.
.(
2010
).
Evaluation of evidence-based practices in online learning: A meta-analysis and review of online learning studies
.
U.S. Department of Education
.
Moodie
D. R.
.(
2021
).
Comparing the outcomes of the different teaching modes: All-in-person, hybrid, and online, for different student demographic groups in a business school
.
Online Learning Journal
,
25
(
4
),
362
387
.
Nguyen
T.
. (
2015
).
The effectiveness of online learning: Beyond no significant differences and future horizon
.
MERLOT Journal of Online Learning and Teaching
,
11
(
3
),
309
319
.
Ni
A. Y.
.(
2013
).
Comparing the effectiveness of classroom and online learning: Teaching research methods
.
Journal of Public Affairs Education
,
19
(
2
),
199
215
.
Price
R. A.
Arthur
T. Y.
&
Pauli
K. P.
. (
2016
).
A comparison of factors affecting student performance and satisfaction in online, hybrid, and traditional courses
.
Business Education Innovation Journal
,
8
(
2
),
32
40
.
Reasons
S. G.
Valadares
K.
&
Slavkin
M.
. (
2005
).
Questioning the hybrid mode: Student outcomes in different course formats
.
Online Learning
,
9
(
1
),
83
94
.
Rivera
J. H.
. (
2016
).
Science-based laboratory comprehension: An examination of effective practices within traditional, online and blended learning environments
.
Open Learning: The Journal of Open, Distance and e-Learning
,
31
(
3
),
209
218
.
Sapp
D. A.
&
Simon
J. L.
. (
2005
).
Comparing grades in online and face-to-face writing courses: Interpersonal accountability and institutional commitment
.
Computers and Composition
,
22
(
4
),
471
489
.
Senn
G. J.
.
Comparison of face-to-face and hybrid delivery of a course that requires technology skills development
.
Journal of Information Technology Education
,
7267
283
.
Simpson
O.
. (
2006
).
Predicting student success in open and distance learning
.
Open Learning: The Journal of Open, Distance and e-Learning
,
21
(
2
),
125
138
.
Son
J. Y.
Narguizian
P.
Beitz
D.
&
Desharnais
R. A.
. (
2016
).
Comparing physical, virtual, and hybrid flipped labs for general education biology
.
Online Learning
,
20
(
3
),
228
243
.
Stern
B. S.
. (
2004
).
A comparison of online and all-in-person instruction in an undergraduate foundations of American education course
.
Contemporary Issues in Technology and Teacher Education
,
4
(
2
),
196
213
.
Summers
J. J.
Waigandt
A.
&
Whittaker
T. A.
. (
2005
).
A comparison of student achievement and satisfaction in an online versus a traditional all-in-person statistics class
.
Innovative Higher Education
,
29
(
3
),
233
250
.
Sun
A.
&
Chen
X.–F.
. (
2016
).
Online education and its effective practice: A research review
.
Journal of Information Technology Education: Research
,
15
,
157
190
.
Xu
D.
&
Jaggers
S. S.
. (
2014
).
Performance gaps between online and all-in-person courses: Differences across types of students and academic subject areas
.
The Journal of Higher Education
,
85
(
5
),
633
659
.
Yuen
A. H. K.
. (
2011
).
Exploring teaching approaches in blended learning
.
Research & Practice in Technology Enhanced Learning
,
6
(
1
),
3
23
.
Licensed re-use rights only

or Create an Account

Close Modal
Close Modal