Do tutors make a difference in online learning? A comparative study in two Open Online Courses

Richard Frederick Heller, Edward Chilolo, Jonny Elliott, Brian Johnson, David Lipman, Victoria Ononeze, Justin Richards

Abstract


Two free fully online courses were offered by Peoples-uni on its Open Online Courses site, both as self-paced courses available any time and as courses run over four weeks with tutor-led discussions. We tested the hypothesis that there are no measurable differences in outcomes between the two delivery methods. Similar numbers attended both versions of each course; students came from multiple countries and backgrounds. Numbers of discussion forum posts were greater in tutor-led than self-paced courses. Measured outcomes of certificates of completion, quiz completion and marks gained were very similar and not statistically significantly different between the tutor-led and the self-paced versions of either course. In light of little discernible difference in outcome between self-paced learning compared with courses including tutor-led discussions, the utility of the time cost to tutors is in question. The findings may be relevant to others designing online courses, including MOOCs.


Keywords


Open Online Courses, tutors, outcomes, student engagement, motivation, self-paced learning

Full Text:

HTML PDF XML

References


Bates, T. (2014, October 13). Comparing xMOOCs and cMOOCs: philosophy and practice [Blog post]. Online Learning and Distance Education Resources. Retrieved from https://www.tonybates.ca/2014/10/13/comparing-xmoocs-and-cmoocs-philosophy-and-practice/

Brooker, A., Corrin, L., de Barba, P., Lodge, J., & Kennedy, G. (2018). A tale of two MOOCs: How student motivation and participation predict learning outcomes in different MOOCs. Australasian Journal of Educational Technology, 34(1). https://doi.org/10.14742/ajet.3237

Cavanaugh, J. K. & Jacquemin, S. J. (2015). A Large Sample Comparison of Grade Based Student Learning Outcomes in Online vs. Face-to-Face Courses. Journal of Asynchronous Learning Networks, 19(2). Retrieved from https://www.learntechlib.org/p/157858/

Chiu, T., K. F. & Hew, T. K., F. (2018). Factors influencing peer learning and performance in MOOC asynchronous online discussion forum. Australasian Journal of Educational Technology, 34(4). https://doi.org/10.14742/ajet.3240

Cho, M-H, & Tobias, S. (2016). Should Instructors Require Discussion in Online Courses? Effects of Online Discussion on Community of Inquiry, Learner Time, Satisfaction, and Achievement. International Review of Research in Open and Distributed Learning, 17(2). https://doi.org/10.19173/irrodl.v17i2.2342

Coetzee, D., Fox, A., Hearst, M. A., & Hartmann, B. (2014). Should Your MOOC Forum Use a Reputation System? Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing (pp. 1176-1187). https://doi.org/10.1145/2531602.2531657

Creelman, A., & Witthaus, G. (2018) Facilitated MOOC support - closed bubbles in an open sea. In D. Jansen; L. Konings (Eds.). The 2018 OpenupEd Trend Report on MOOCs (pp. 31-34). Maastricht, NL: EADTU. Retrieved from https://tinyurl.com/2018OpenupEdtrendreport

Davidson, C. (2013, August 21). MOOC, SPOC, DOCC, Massive Online Face2Face Open . . . (Uh Oh!): Age of the Acronym [Blog post]. Hastac. Retrieved from https://www.hastac.org/blogs/cathy-davidson/2013/08/21/mooc-spoc-docc-massive-online-face2face-open-uh-oh-age-acronym

Fidalgo-Blanco, Á., Sein-Echaluce, M. L., García-Peñalvo, F. J., & Esteban-Escaño, J. (2014). Improving the MOOC learning outcomes throughout informal learning activities. In F. J. García-Peñalvo (Ed.). Proceedings of the Second International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM 2014) (Salamanca, Spain, October 1-3, 2014). (pp. 611-617). New York, NY, USA: ACM. https://doi.org/10.1145/2669711.2669963

Goldberg, L. & Crocombe, L. (2017). Advances in medical education and practice: role of massive open online courses. Advances in Medical Education and Practice, 8, 603-609. https://doi.org/10.2147/AMEP.S115321

Grandzol, C. J., & Grandzol PhD, J. R. (2006). Best Practices for Online Business Education. The International Review of Research in Open and Distributed Learning, 7(1). https://doi.org/10.19173/irrodl.v7i1.246

He, C., Ma, P, Zhou, L., & Wu, J. (2018). Is Participating in MOOC Forums Important for Students? A Data-driven Study from the Perspective of the Supernetwork. Journal of Data and Information Science 3(2), 62–77. https://doi.org/10.2478/jdis-2018-0009

Heller, R. F., Strobl, J., & Madhok, R. (2019). Online Education for Public Health Capacity Building in Low- to Middle-Income Countries. The International Review of Research in Open and Distributed Learning, 20(1). https://doi.org/10.19173/irrodl.v20i1.3927

Heller, R. F., Zurynski, R., Barrett, A., Oaiya, O., & Madhok, R. (2017). Open Online Courses in Public Health: experience from Peoples-uni.F1000Research 6:170. https://doi.org/10.12688/f1000research.10728.2

International Telecommunication Union News (2018). New ITU statistics show more than half the world is now using the Internet. ITU, the United Nations’ specialized agency for ICT. Retrieved from https://news.itu.int/itu-statistics-leaving-no-one-offline/

Jaggars, S., S. & Xu, D. (2013). Predicting Online Student Outcomes From a Measure of Course Quality. CCRC Working Paper No. 57. New York: Community College Research Center Teachers College, Columbia University.

Knowles, M., S. (1975). Self-Directed Learning: A Guide for Learners and Teachers. N.Y.: Cambridge Books.

Lowe, R. (2017). Physiotherapy, Exercise and Physical Activity Massive Open Online Course (PEPA MOOC) Evaluation Report. Physiospot, Feb 2017. Retrieved from https://www.physiospot.com/physiopedia/report-from-the-physiotherapy-exercise-and-physical-activity-mooc/

Manning, G. (2007). Self-Directed Learning: A Key Component of Adult Learning Theory. Journal of the Washington Institute of China Studies, 2(2), 104. Retrieved from https://www.bpastudies.org/bpastudies/article/view/38/78

Onah, D., F., O., Sinclair, J., E., & Boyatt, R. (2015). Forum Posting Habits and Attainment in a Dual-Mode MOOC. International Journal for Cross-Disciplinary Subjects in Education (IJCDSE), Special Issue 5(2). https://doi.org/10.20533/ijcdse.2042.6364.2015.0336

Otto, D., Bollmann, A., Becker, S., & Sander, K. (2018). It’s the learning, stupid! Discussing the role of learning outcomes in MOOCs, Open Learning: The Journal of Open, Distance and e-Learning, 33(3), 203-220. https://doi.org/10.1080/02680513.2018.1486183

Protopsaltis, S. & Baum, S. (2019). Does online education live up to its promise? A look at the evidence and implications for federal policy. George Mason University. Retrieved from https://mason.gmu.edu/~sprotops/OnlineEd.pdf

Siemens, G. (2005). Connectivism: A Learning Theory for the Digital Age. International Journal of Instructional Technology & Distance Learning, 2(1). Retrieved from http://www.itdl.org/journal/jan_05/article01.htm

Shah, D. (2015, December 28). MOOCs in 2015: Breaking Down the Numbers. EdSurge. Retrieved from https://www.edsurge.com/news/2015-12-28-moocs-in-2015-breaking-down-the-numbers

Sharif, A & Magrill, B. (2015) Discussion Forums in MOOCs. International Journal of Learning, Teaching and Educational Research, 12(1), 119-132. Retrieved from https://www.ijlter.org/index.php/ijlter/article/view/368

Stack, S. (2015). Learning Outcomes in an online vs traditional course. International Journal for the Scholarship of Teaching and Learning, 9(1). https://doi.org/10.20429/ijsotl.2015.090105

U.S. Department of Education (2009). Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies. Washington, D.C.: Office of Planning, Evaluation, and Policy Development.

Wise, A., F. & Cui, Y. (2018). Unpacking the relationship between discussion forum participation and learning in MOOCs: content is key. Proceedings of the 8th International Conference on Learning Analytics and Knowledge (pp. 330-339). Retrieved from https://dl.acm.org/citation.cfm?id=3170403&dl=ACM&coll=DL

Zhan, Z., Fong, P., S., W., Mei, H., Chang, X, Liang, T., Ma, Z. (2015). Sustainability Education in Massive Open Online Courses: A Content Analysis Approach. Sustainability, 7, 2274-2300. https://doi.org/10.3390/su7032274




DOI: http://dx.doi.org/10.5944/openpraxis.11.3.960

Refbacks

  • There are currently no refbacks.