Quality Control of Statistical Learning Environments and Prediction of Learning Outcomes through Reproducible Computing

Authors

  • Patrick Wessa K.U.Leuven Association Lessius, Dept. of Business Studies Belgium

Keywords:

Reproducible Computing, Learning Environment, Quality Control, Statistics Education, Psychometrics

Abstract

This article introduces a new approach to statistics education that allows us to accurately measure and control key aspects of the computations and communication processes that are involved in non-rote learning within the pedagogical paradigm of Constructivism. The solution that is presented relies on a newly developed technology (hosted at www.freestatistics.org) and computing framework (hosted at www.wessa.net) that supports reproducibility and reusability of statistical research results that are presented in a so-called Compendium. Reproducible computing leads to responsible learning behaviour, and a stream of high-quality communications that emerges when students are engaged in peer review activities. More importantly, the proposed solution provides a series of objective measurements of actual learning processes that are otherwise unobservable. A comparison between actual and reported data, demonstrates that reported learning process measurements are highly misleading in unexpected ways. However, reproducible computing and objective measurements of actual learning behaviour, reveal important guidelines that allow us to improve the effectiveness of learning and the e-learning system.

References

Arndt S., Turvey C., Andreasen N. (1999), Correlating and predicting psychiatric symptom ratings: Spearman's r versus Kendall's tau correlation, Journal of Psychiatric Research, 33, 97-104

http://dx.doi.org/10.1016/S0022-3956(98)90046-2

Arndt S., Magnotta V. (2001), Generating random series with known values of Kendall's tau, Computer Methods and Programs in Biomedicine, 65, 17-23

http://dx.doi.org/10.1016/S0169-2607(00)00102-4

Attitudes to Thinking and Learning Survey, (n.d.), Retrieved December 22, 2004, from www.moodle.org

Benson J. (1989). Structural components of statistical test anxiety in adults: An exploratory study, Journal of Experimental Education, 57, 247-261.

http://dx.doi.org/10.1080/00220973.1989.10806509

Buckheit J., and Donoho D. L. (1995), Wavelets and Statistics, Springer-Verlag, Editor: Antoniadis, A.

Chambers J. M., Cleveland, W. S., Kleiner, B. and Tukey, P. A. (1983), Graphical Methods for Data Analysis, Wadsworth & Brooks/Cole.

Chen Z. (2008), Learning about Learners: System Learning in Virtual Learning Environment, International Journal of Computers, Communications & Control, Vol. III, No. 1, pp. 33-40

http://dx.doi.org/10.15837/ijccc.2008.1.2372

Constructivist On-Line Learning Environment Survey, (n.d.), Retrieved December 22, 2004, from www.moodle.org

de Leeuw J. (2001), Reproducible Research: the Bottom Line, Department of Statistics Papers, 2001031101, Department of Statistics, UCLA., URL http://repositories.cdlib.org/uclastat/papers/2001031101

Donoho D. L., and Huo, X. (2005), BeamLab and Reproducible Research, International Journal of Wavelets, Multiresolution and Information Processing, 2(4), 391-414

http://dx.doi.org/10.1142/S0219691304000615

Eggen P., and Kauchak, D. (2001), Educational Psychology: Windows on Classrooms (5th ed.), Upper Saddle River, NJ: Prentice Hall.

Galotti K. M., Clinchy B. M., Ainsworth K., Lavin B. and Mansfield A. F. (1999), A new way of assessing ways of knowing: the attitudes towards thinking and learning survey (ATTLS), Sex roles, 40(9/10) p745-766

http://dx.doi.org/10.1023/A:1018860702422

Gentleman R. (2005), Applying Reproducible Research in Scientific Discovery, BioSilico, URL http://gentleman.fhcrc.org/Fld-talks/RGRepRes.pdf

Green P. J. (2003), Diversities of gifts, but the same spirit, The Statistician, 52(4), 423-438

http://dx.doi.org/10.1046/j.1467-9884.2003.02060.x

Hilton S., Schau C., Olsen J. (2004), Survey of Attitudes Toward Statistics: Factor Structure Invariance by Gender and by Administration Time, Structural Equation Modeling, 11(1)

http://dx.doi.org/10.1207/S15328007SEM1101_7

Hollander M., andWolfe D. A. (1973), Nonparametric statistical inference, New York: John Wiley & Sons., 185-194 (Kendall and Spearman tests).

Kay R. H. (2008), Exploring the relationship between emotions and the acquisition of computer knowledge, Computers & Education, 50, 1269-1283

http://dx.doi.org/10.1016/j.compedu.2006.12.002

Koenker R., and Zeileis A.(2007), A., Reproducible Econometric Research (A Critical Review of the State of the Art), Research Report Series, Department of Statistics and Mathematics Wirtschaftsuniversit Wien

Leisch F. (2003), Sweave and beyond: Computations on text documents, Proceedings of the 3rd International Workshop on Distributed Statistical Computing

Lewis J. R. (1993), IBM Computer Usability Satisfaction Questionnaires: Psychometric Evaluation and Instructions for Use, IBM Corporation, Technical Report 54.786

Lucy D., Aykroyd R. G. and Pollard A. M.(2002), Non-parametric calibration for age estimation, Applied Statistics 51(2), 183-196

http://dx.doi.org/10.1111/1467-9876.00262

Meelissen M. R. M., Drent M. (2008), Gender differences in computer attitudes: Does the school matter?, Computers in Human Behavior, 24, 969-985

http://dx.doi.org/10.1016/j.chb.2007.03.001

Miller J. B., (n.d.), Examining the interplay between constructivism and different learning styles, Retrieved October 20, 2005 from http://www.stat.auckland.ac.nz/Ëœiase/publications/1/8a4_mill.pdf

Mvududu N. (2003), A Cross-Cultural Study of the Connection Between Students' Attitudes Toward Statistics and the Use of Constructivist Strategies in the Course, Journal of Statistics Education, 11(3)

O'Dwyer L. M., Russell M., Bebell D., Seeley K. (2008), Examining the Relationship between Students Mathematics Test Scores and Computer Use at Home and at School, Journal of Technology, Learning, and Assessment, 6 (5)

Peng R. D., Dominici F., and Zeger S. L. (2006), Reproducible Epidemiologic Research, American Journal of Epidemiology, 163(9), 783-789

http://dx.doi.org/10.1093/aje/kwj093

Poelmans S., Wessa P., Milis K., Bloemen E., and Doom C. (2008), Usability and Acceptance of E-Learning in Statistics Education, based on the Compendium Platform, Proceedings of the International Conference of Education, Research and Innovation, International Association of Technology, Education and Development

Romero C., Ventura S., Garcia E. (2008), Data mining in course management systems: Moodle case study and tutorial, Computers & Education, 51, 368-384

http://dx.doi.org/10.1016/j.compedu.2007.05.016

Schwab M., Karrenbach N., and Claerbout J. (2000), Making scientific computations reproducible, Computing in Science & Engineering 2(6), 61-67

http://dx.doi.org/10.1109/5992.881708

Smith E. (1999), Social Constructivism, Individual Constructivism and the Role of Computers in Mathematics Education, Journal of mathematical behavior, 17(4)

Statistical Computations at FreeStatistics.org (2008a), Office for Research Development and Education, Retrieved Mon, 30 Jun 2008, URL http://www.freestatistics.org/blog/date/2008/Jun/30/t1214840420q0fyankop4x9ebf.htm

Statistical Computations at FreeStatistics.org (2008b), Office for Research Development and Education, Retrieved Mon, 30 Jun 2008, URL http://www.freestatistics.org/blog/date/2008/Jun/30/t12148409608o0dnj2k4s04jil.htm

Statistical Computations at FreeStatistics.org (2008c), Office for Research Development and Education, Retrieved Mon, 30 Jun 2008, URL http://www.freestatistics.org/blog/date/2008/Jun/30/t1214841152sn6jlyhgseclgqm.htm

Sun P., Tsai R. J., Finger G., Chen Y., Yeh D. (2008), What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction, Computers & Education, 50, 1183-1202

http://dx.doi.org/10.1016/j.compedu.2006.11.007

Von Glasersfeld E. (1987), Learning as a Constructive Activity, Problems of Representation in the Teaching and Learning of Mathematics, Hillsdale, NJ: Lawrence Erlbaum Associates, 3-17.

Wessa P. (2008a), A framework for statistical software development, maintenance, and publishing within an open-access business model, Computational Statistics, www.springerlink.com (DOI 10.1007/s00180-008-0107-y)

Wessa P. (2008b), Learning Statistics based on the Compendium and Reproducible Computing, Proceedings of the International Conference on Education and Information Technology, Berkeley, San Francisco, USA

Wessa P. (2008c), How Reproducible Research Leads to Non-Rote Learning Within a Socially Constructivist E-Learning Environment, Proceedings of the 7th European Conference on e-Learning, Cyprus

Wessa P. (2008d), Measurement and Control of Statistics Learning Processes based on Constructivist Feedback and Reproducible Computing, Proceedings of the 3rd International Conference on Virtual Learning, Constanta, Romania

Wessa P. (2009a), Discovering Computer-Assisted Learning Processes based on Objective Exam Score Transformations, Proceedings of the World Congress on Educational Sciences, Cyprus

http://dx.doi.org/10.1016/j.sbspro.2009.01.457

Published

2009-06-01

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.