The Effectiveness of Open Educational Resources in College Calculus. A Quantitative Study

Scott Kersey

Abstract


We investigate Open Educational Resources (OER) in post-secondary Calculus with face-to-face instruction using web-based homework in a side-by-side comparison with Closed (Proprietary) Educational Resources (CER). Statistical analyses using multilinear regression models are developed to demonstrate several significant effects, to within a probability of 5%. Our first finding is that students’ pretest scores and access dates to online homework were both significant factors in predicting first exam scores. While pretest scores were similar between the groups, students in the OER group accessed the online homework earlier in the semester, which contributed to higher first exam scores. Second, homework scores were significantly higher in the CER group, which was a significant measure of final exam scores. In understanding this result, we cite student comments suggesting the proprietary CER homework system had more resources providing help on problems. However, the differences in final course grades were not significant. We conclude from our study that the OER materials are effective, but recommend that care is taken to ensure the free materials provide a quality experience.


Keywords


open educational resources, OER, closed (proprietary) educational materials, mathematics, calculus, web-based homework, quantitative study

Full Text:

HTML PDF XML

References


Allen G., Guzman-Alvarez, A., Smith, A., Gamage, A., Molinaro, M., & Larsen, D. S. (2015). Evaluating the effectiveness of the open-access ChemWiki resource as a replacement for traditional general chemistry textbooks. Chemistry Education Research and Practice, 16, 939–948. https://doi.org/10.1039/C5RP00084J

Carpenter, J., & Camp, B. (2008). Using a web-based homework system to improve accountability and mastery in Calculus. ASEE Annual Conference & Exposition, Pittsburgh. Retrieved from https://peer.asee.org/using-a-web-based-homework-system-to-improve-accountability-and-mastery-in-calculus

Denny, J., & Yackel, C. (2005). Implementing and teaching with WeBWorK at Mercer University. Proceedings of the 2005 ASCUE Conference, June 12-16, Myrtle Beach, South Carolina. Retrieved from https://www.researchgate.net/publication/229052159_Implementing_and_teaching_with_WebWork_at_Mercer_University

Gage, M. E., & Pizer, A. K. (1999). WeBWorK – Math Homework on the Web. Proceedings of the Annual International Conference on Technology in Collegiate Mathematics.

Hauk, S. Powers, R., Safer, A., & Segalla, A. (2014). Impact of the web-based homework program WeBWorK on student performance in moderate enrollment college algebra courses. Retrieved from https://pdfs.semanticscholar.org/3264/2427b5f92a280175159a9bca8da462d1c4ab.pdf

Hilton, J. L., & Laman, C. (2012). One college’s use of an open psychology textbook. Open Learning: The Journal of Open and Distance Learning, 27(3), 265–272. https://doi.org/10.1080/02680513.2012.716657

Hilton, J. L. (2016). Open educational resources and college textbook choices: a review of research on efficacy and perceptions. Educational Technology Research and Development, 64(4), 573–590. https://doi.org/10.1007/s11423-016-9434-9

Hilton, J. L. (2018). A synthesis of research on OER efficacy and perceptions published between Sept. 2015 and Sept. 2018, OpenEd18, Niagara Falls, NY, October 10–12. Retrieved from https://openedconference.org/2018/program/

Hilton, J. L., Gaudet, D., Clark, P., Robinson, J., & Wiley, D. (2013). The adoption of open educational resources by one community college math department. The International Review of Research in Open and Distance Learning, 14(4), 37–50. https://doi.org/10.19173/irrodl.v14i4.1523

Nguyen, D. M., Hsieh. Y. C., & Allen, G. D. (2006). The impact of web-based assessment and practice on students’ mathematics learning attitudes. Journal of Computers in Mathematics and Science Teaching, 25(3), 251–279.

Robinson, T. J., Fischer, L., Wiley, D., & Hilton, J. L (2014). The impact of open textbooks on secondary science learning outcomes. Educational Researcher, 43(7), 341–351. https://doi.org/10.3102%2F0013189X14550275

Swanbom, M. K., Moller, D. W., Evans, K., & Reeves, T. (2016). Open-source, online homework for statics and mechanics of materials using WeBWorK: Assessing effects on student learning, ASEE’s 123rd Annual Conference and Exposition, New Orleans, LA, June 26–29. Retrieved from https://www.asee.org/public/conferences/64/papers/16092/view

Waters, A., Mallick, D. B., Grimaldi, P., & Baraniuk, R. (2018). Does OER improve learning? Exploring the access hypothesis. OpenEd18, Niagara Falls, NY, October 10–12. Retrieved from https://openedconference.org/2018/program/

Weller, M., de los Arcos, B., Farrow, R., Pitt, B., & McAndrew, P. (2015). The impact of OER on teaching and learning practice. Open Praxis, 7(4), 351–361. http://dx.doi.org/10.5944/openpraxis.7.4.227

Williams, A. (2012). Online homework vs. traditional homework: Statistics anxiety and self-efficacy in an educational statistics course. Technology Innovations in Statistics Education, 6(1), 1–19. Retrieved from https://escholarship.org/uc/item/32j2998k




DOI: http://dx.doi.org/10.5944/openpraxis.11.2.935

Refbacks

  • There are currently no refbacks.