Specification and Validation of a Formative Index to Evaluate the Ergonomic Quality of an AR-based Educational Platform
Keywords:
formative measurement model, formative index, augmented reality, usability, ergonomic qualityAbstract
The ergonomic quality of educational systems is a key feature influencing both the usefulness and motivation for the learner. Desktop Augmented Reality (AR) systems are featuring specific interaction techniques that may create additional usability issues affecting the perceived ease of use. Measuring key usability aspects and understanding the causal relationships between them is a challenge that requires formative measurement models specification and validation. In this paper we present an evaluation instrument based on two main formative indexes that are capturing specific usability measures for two AR-based applications. The formative indexes are forming a second order formative construct that acts as predictor for both the general ease of use and ease of learning how to operate with the application.
References
Anderson, J.C., Gerbing, D.W. Structural Equation Modelling in Practice: A Review and Recommended Two-Step Approach. Psychological Bulletin 103(3), 411-423, 1988. http://dx.doi.org/10.1037/0033-2909.103.3.411
Arbuckle, J.L. AMOS 16.0 User's Guide. Amos Development Corporation, 2007.
Balog, A., Pribeanu, C. Developing a measurement model for the evaluation of AR-based educational systems. Studies in Informatics and Control 18(2), 137-148, 2009.
Balog, A., Pribeanu, C. The Role of Perceived Enjoyment in the Students' Acceptance of an Augmented Reality Teaching Platform: a Structural Equation Modelling Approach . Studies in Informatics and Control 19(3), 319-330, 2010.
Bach, C., Scapin, D., Obstacles and perspectives for Evaluating mixed Reality Systems Usability. Proceedings of IUI-CADUI Conference 2004, 72-79, 2004.
Bollen, K., Lennox, R. Conventional wisdom on measurement: a structural perspective. Psychological Bulletin 110(2), 305-314, 1991. http://dx.doi.org/10.1037/0033-2909.110.2.305
Bruhn, M., Georgi, D., Hadwich, K. Customer equity management as formative second order construct. Journal of Business Research 61, 1292-1301, 2008. http://dx.doi.org/10.1016/j.jbusres.2008.01.016
Cadogan, J., Souchon, A., Procter, D. The quality of market-oriented behaviors: Formative index construction. Journal of Business Research 61, 1263-1277, 2008. http://dx.doi.org/10.1016/j.jbusres.2008.01.014
Davis, F.D. Perceived usefulness, perceived easy of use, and user acceptance of information technology. MIS Quaterly 13, 319-340, 1989. http://dx.doi.org/10.2307/249008
Diamantopoulos, A., Winklhofer, H. Index construction with formative indicators : an alternative to scale development. Journal of Marketing Research 28, 269-277, 2001. http://dx.doi.org/10.1509/jmkr.38.2.269.18845
Diamantopoulos, A. The error term in formative measurement models : interpretation and modeling implications. Journal of Modeling in Management 1(1), 7-17, 2006. http://dx.doi.org/10.1108/17465660610667775
Diamantopoulos, A., Riefler, P., Roth, K. Advancing formative measurement models. Journal of Business Research 61, 1203-1218, 2008 http://dx.doi.org/10.1016/j.jbusres.2008.01.009
Edwards, J., Bagozzi, R. On the nature and direction of relationship between constructs and measures. Psychological Methods 5(2), 155-174, 2000. http://dx.doi.org/10.1037/1082-989X.5.2.155
Franke, G., Preacher, K., Rigdon, E. Proportional structural effects of formative indicators. Journal of Business Research 61, 1229-1237, 2008. http://dx.doi.org/10.1016/j.jbusres.2008.01.011
Gabbard, J., Swann, E. Usability engineering for augmented reality: Employing user-based studies to inform design. IEEE Transactions on Visualization and Computer Graphics 14(3), 513-525, 2008. http://dx.doi.org/10.1109/TVCG.2008.24
Hair, J.F., Black, W.C., Babin, B.J., Anderson, R.E., Tatham, R.L. Multivariate Data Analysis, Prentice Hall, 2006.
Hornbaek, K. Current practice in measuring usability: Challenges to usability studies and research. Int. J. Human Computer Studies. 64, 79-102, 2006. http://dx.doi.org/10.1016/j.ijhcs.2005.06.002
Huang, H.M., Rauch, U., Liaw, S.S. Investigating learners' attitude towards virtual reality learning environments: based on a constructivist approach. Computers & Education 55, 1171- 1182, 2010. http://dx.doi.org/10.1016/j.compedu.2010.05.014
ISO 9126-1:2001 Software Engineering - Software product quality. Part 1: Quality Model
Jarvis, C.B., Mackezie, S., Podsakoff, M. A critical review of construct indicators and measurement models misspecification in marketing and consumer research. Journal of Consumer Research 30, 199-218, 2003. http://dx.doi.org/10.1086/376806
Konradt, U., Christophersen, T., Schaefer-Kuelz, U. Predicting user satisfaction, strain and system usage of employee self-services. Int. J. of Human-Computer Studies 64, 1141-1153, 2006. http://dx.doi.org/10.1016/j.ijhcs.2006.07.001
Krauss, M., Riege, K., Winter, M., Pemberton, L. Remote Hands-On Experience: Distributed Collaboration with Augmented Reality. Proceedings EC-TEL 2009, LNCS 5794, Springer, 226-239, 2009
Pribeanu, C., Balog, A., Iordache, D.D. Measuring the usability of augmented reality elearning systems: a user-centered evaluation approach.Chapter 14: Software and Data Technologies, CCIS 47, Corderiro, H., Shiskov B, Ranchordas A, Helfert M (Eds.), Springer, 175-186, 2009.
Ruiz, D.M., Gremler, D., Washburn, J., Carrion, G.C. Service value revisited: specifying a high order formative measure. Journal of Business Research 61, 1278-1291, 2008. http://dx.doi.org/10.1016/j.jbusres.2008.01.015
Tabachnick, B. G., Fidell, L. S. . Using Multivariate Statistics, 5th ed. Boston: Allyn and Bacon, 2007.
Wilcox, J., Howell, R., Breivik, E. Questions about formative measurement. Journal of Business Research 61, 1219-1228, 2008. http://dx.doi.org/10.1016/j.jbusres.2008.01.010
Wind, J., Riege, K., Bogen M. SpinnstubeĊ½: A Seated Augmented Reality Display System, Virtual Environments: Proc. IPT-EGVE - EG/ACM Symposium, 17-23, 2007.
Published
Issue
Section
License
ONLINE OPEN ACCES: Acces to full text of each article and each issue are allowed for free in respect of Attribution-NonCommercial 4.0 International (CC BY-NC 4.0.
You are free to:
-Share: copy and redistribute the material in any medium or format;
-Adapt: remix, transform, and build upon the material.
The licensor cannot revoke these freedoms as long as you follow the license terms.
DISCLAIMER: The author(s) of each article appearing in International Journal of Computers Communications & Control is/are solely responsible for the content thereof; the publication of an article shall not constitute or be deemed to constitute any representation by the Editors or Agora University Press that the data presented therein are original, correct or sufficient to support the conclusions reached or that the experiment design or methodology is adequate.
