Specification and Validation of a Formative Index to Evaluate the Ergonomic Quality of an AR-based Educational Platform


  • Costin Pribeanu National Institute for Research and Development in Informatics - ICI Bucharest Romania, 011455 Bucuresti, Bd. Maresal Averescu, 8-10


formative measurement model, formative index, augmented reality, usability, ergonomic quality


The ergonomic quality of educational systems is a key feature influencing both the usefulness and motivation for the learner. Desktop Augmented Reality (AR) systems are featuring specific interaction techniques that may create additional usability issues affecting the perceived ease of use. Measuring key usability aspects and understanding the causal relationships between them is a challenge that requires formative measurement models specification and validation. In this paper we present an evaluation instrument based on two main formative indexes that are capturing specific usability measures for two AR-based applications. The formative indexes are forming a second order formative construct that acts as predictor for both the general ease of use and ease of learning how to operate with the application.

Author Biography

Costin Pribeanu, National Institute for Research and Development in Informatics - ICI Bucharest Romania, 011455 Bucuresti, Bd. Maresal Averescu, 8-10

Department of Mathematics and Computer Science


Anderson, J.C., Gerbing, D.W. Structural Equation Modelling in Practice: A Review and Recommended Two-Step Approach. Psychological Bulletin 103(3), 411-423, 1988. http://dx.doi.org/10.1037/0033-2909.103.3.411

Arbuckle, J.L. AMOS 16.0 User's Guide. Amos Development Corporation, 2007.

Balog, A., Pribeanu, C. Developing a measurement model for the evaluation of AR-based educational systems. Studies in Informatics and Control 18(2), 137-148, 2009.

Balog, A., Pribeanu, C. The Role of Perceived Enjoyment in the Students' Acceptance of an Augmented Reality Teaching Platform: a Structural Equation Modelling Approach . Studies in Informatics and Control 19(3), 319-330, 2010.

Bach, C., Scapin, D., Obstacles and perspectives for Evaluating mixed Reality Systems Usability. Proceedings of IUI-CADUI Conference 2004, 72-79, 2004.

Bollen, K., Lennox, R. Conventional wisdom on measurement: a structural perspective. Psychological Bulletin 110(2), 305-314, 1991. http://dx.doi.org/10.1037/0033-2909.110.2.305

Bruhn, M., Georgi, D., Hadwich, K. Customer equity management as formative second order construct. Journal of Business Research 61, 1292-1301, 2008. http://dx.doi.org/10.1016/j.jbusres.2008.01.016

Cadogan, J., Souchon, A., Procter, D. The quality of market-oriented behaviors: Formative index construction. Journal of Business Research 61, 1263-1277, 2008. http://dx.doi.org/10.1016/j.jbusres.2008.01.014

Davis, F.D. Perceived usefulness, perceived easy of use, and user acceptance of information technology. MIS Quaterly 13, 319-340, 1989. http://dx.doi.org/10.2307/249008

Diamantopoulos, A., Winklhofer, H. Index construction with formative indicators : an alternative to scale development. Journal of Marketing Research 28, 269-277, 2001. http://dx.doi.org/10.1509/jmkr.

Diamantopoulos, A. The error term in formative measurement models : interpretation and modeling implications. Journal of Modeling in Management 1(1), 7-17, 2006. http://dx.doi.org/10.1108/17465660610667775

Diamantopoulos, A., Riefler, P., Roth, K. Advancing formative measurement models. Journal of Business Research 61, 1203-1218, 2008 http://dx.doi.org/10.1016/j.jbusres.2008.01.009

Edwards, J., Bagozzi, R. On the nature and direction of relationship between constructs and measures. Psychological Methods 5(2), 155-174, 2000. http://dx.doi.org/10.1037/1082-989X.5.2.155

Franke, G., Preacher, K., Rigdon, E. Proportional structural effects of formative indicators. Journal of Business Research 61, 1229-1237, 2008. http://dx.doi.org/10.1016/j.jbusres.2008.01.011

Gabbard, J., Swann, E. Usability engineering for augmented reality: Employing user-based studies to inform design. IEEE Transactions on Visualization and Computer Graphics 14(3), 513-525, 2008. http://dx.doi.org/10.1109/TVCG.2008.24

Hair, J.F., Black, W.C., Babin, B.J., Anderson, R.E., Tatham, R.L. Multivariate Data Analysis, Prentice Hall, 2006.

Hornbaek, K. Current practice in measuring usability: Challenges to usability studies and research. Int. J. Human Computer Studies. 64, 79-102, 2006. http://dx.doi.org/10.1016/j.ijhcs.2005.06.002

Huang, H.M., Rauch, U., Liaw, S.S. Investigating learners' attitude towards virtual reality learning environments: based on a constructivist approach. Computers & Education 55, 1171- 1182, 2010. http://dx.doi.org/10.1016/j.compedu.2010.05.014

ISO 9126-1:2001 Software Engineering - Software product quality. Part 1: Quality Model

Jarvis, C.B., Mackezie, S., Podsakoff, M. A critical review of construct indicators and measurement models misspecification in marketing and consumer research. Journal of Consumer Research 30, 199-218, 2003. http://dx.doi.org/10.1086/376806

Konradt, U., Christophersen, T., Schaefer-Kuelz, U. Predicting user satisfaction, strain and system usage of employee self-services. Int. J. of Human-Computer Studies 64, 1141-1153, 2006. http://dx.doi.org/10.1016/j.ijhcs.2006.07.001

Krauss, M., Riege, K., Winter, M., Pemberton, L. Remote Hands-On Experience: Distributed Collaboration with Augmented Reality. Proceedings EC-TEL 2009, LNCS 5794, Springer, 226-239, 2009

Pribeanu, C., Balog, A., Iordache, D.D. Measuring the usability of augmented reality elearning systems: a user-centered evaluation approach.Chapter 14: Software and Data Technologies, CCIS 47, Corderiro, H., Shiskov B, Ranchordas A, Helfert M (Eds.), Springer, 175-186, 2009.

Ruiz, D.M., Gremler, D., Washburn, J., Carrion, G.C. Service value revisited: specifying a high order formative measure. Journal of Business Research 61, 1278-1291, 2008. http://dx.doi.org/10.1016/j.jbusres.2008.01.015

Tabachnick, B. G., Fidell, L. S. . Using Multivariate Statistics, 5th ed. Boston: Allyn and Bacon, 2007.

Wilcox, J., Howell, R., Breivik, E. Questions about formative measurement. Journal of Business Research 61, 1219-1228, 2008. http://dx.doi.org/10.1016/j.jbusres.2008.01.010

Wind, J., Riege, K., Bogen M. SpinnstubeĊ½: A Seated Augmented Reality Display System, Virtual Environments: Proc. IPT-EGVE - EG/ACM Symposium, 17-23, 2007.



Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.