Specification and Validation of a Formative Index to Evaluate the Ergonomic Quality of an AR-based Educational Platform

Costin Pribeanu

Abstract


The ergonomic quality of educational systems is a key feature influencing both the usefulness and motivation for the learner. Desktop Augmented Reality (AR) systems are featuring specific interaction techniques that may create additional usability issues affecting the perceived ease of use. Measuring key usability aspects and understanding the causal relationships between them is a challenge that requires formative measurement models specification and validation. In this paper we present an evaluation instrument based on two main formative indexes that are capturing specific usability measures for two AR-based applications. The formative indexes are forming a second order formative construct that acts as predictor for both the general ease of use and ease of learning how to operate with the application.


Keywords


formative measurement model, formative index, augmented reality, usability, ergonomic quality

Full Text:

PDF

References


Anderson, J.C., Gerbing, D.W. Structural Equation Modelling in Practice: A Review and Recommended Two-Step Approach. Psychological Bulletin 103(3), 411-423, 1988.
http://dx.doi.org/10.1037/0033-2909.103.3.411

Arbuckle, J.L. AMOS 16.0 User's Guide. Amos Development Corporation, 2007.

Balog, A., Pribeanu, C. Developing a measurement model for the evaluation of AR-based educational systems. Studies in Informatics and Control 18(2), 137-148, 2009.

Balog, A., Pribeanu, C. The Role of Perceived Enjoyment in the Students' Acceptance of an Augmented Reality Teaching Platform: a Structural Equation Modelling Approach . Studies in Informatics and Control 19(3), 319-330, 2010.

Bach, C., Scapin, D., Obstacles and perspectives for Evaluating mixed Reality Systems Usability. Proceedings of IUI-CADUI Conference 2004, 72-79, 2004.

Bollen, K., Lennox, R. Conventional wisdom on measurement: a structural perspective. Psychological Bulletin 110(2), 305-314, 1991.
http://dx.doi.org/10.1037/0033-2909.110.2.305

Bruhn, M., Georgi, D., Hadwich, K. Customer equity management as formative second order construct. Journal of Business Research 61, 1292-1301, 2008.
http://dx.doi.org/10.1016/j.jbusres.2008.01.016

Cadogan, J., Souchon, A., Procter, D. The quality of market-oriented behaviors: Formative index construction. Journal of Business Research 61, 1263-1277, 2008.
http://dx.doi.org/10.1016/j.jbusres.2008.01.014

Davis, F.D. Perceived usefulness, perceived easy of use, and user acceptance of information technology. MIS Quaterly 13, 319-340, 1989.
http://dx.doi.org/10.2307/249008

Diamantopoulos, A., Winklhofer, H. Index construction with formative indicators : an alternative to scale development. Journal of Marketing Research 28, 269-277, 2001.
http://dx.doi.org/10.1509/jmkr.38.2.269.18845

Diamantopoulos, A. The error term in formative measurement models : interpretation and modeling implications. Journal of Modeling in Management 1(1), 7-17, 2006.
http://dx.doi.org/10.1108/17465660610667775

Diamantopoulos, A., Riefler, P., Roth, K. Advancing formative measurement models. Journal of Business Research 61, 1203-1218, 2008
http://dx.doi.org/10.1016/j.jbusres.2008.01.009

Edwards, J., Bagozzi, R. On the nature and direction of relationship between constructs and measures. Psychological Methods 5(2), 155-174, 2000.
http://dx.doi.org/10.1037/1082-989X.5.2.155

Franke, G., Preacher, K., Rigdon, E. Proportional structural effects of formative indicators. Journal of Business Research 61, 1229-1237, 2008.
http://dx.doi.org/10.1016/j.jbusres.2008.01.011

Gabbard, J., Swann, E. Usability engineering for augmented reality: Employing user-based studies to inform design. IEEE Transactions on Visualization and Computer Graphics 14(3), 513-525, 2008.
http://dx.doi.org/10.1109/TVCG.2008.24

Hair, J.F., Black, W.C., Babin, B.J., Anderson, R.E., Tatham, R.L. Multivariate Data Analysis, Prentice Hall, 2006.

Hornbaek, K. Current practice in measuring usability: Challenges to usability studies and research. Int. J. Human Computer Studies. 64, 79-102, 2006.
http://dx.doi.org/10.1016/j.ijhcs.2005.06.002

Huang, H.M., Rauch, U., Liaw, S.S. Investigating learners' attitude towards virtual reality learning environments: based on a constructivist approach. Computers & Education 55, 1171- 1182, 2010.
http://dx.doi.org/10.1016/j.compedu.2010.05.014

ISO 9126-1:2001 Software Engineering - Software product quality. Part 1: Quality Model

Jarvis, C.B., Mackezie, S., Podsakoff, M. A critical review of construct indicators and measurement models misspecification in marketing and consumer research. Journal of Consumer Research 30, 199-218, 2003.
http://dx.doi.org/10.1086/376806

Konradt, U., Christophersen, T., Schaefer-Kuelz, U. Predicting user satisfaction, strain and system usage of employee self-services. Int. J. of Human-Computer Studies 64, 1141-1153, 2006.
http://dx.doi.org/10.1016/j.ijhcs.2006.07.001

Krauss, M., Riege, K., Winter, M., Pemberton, L. Remote Hands-On Experience: Distributed Collaboration with Augmented Reality. Proceedings EC-TEL 2009, LNCS 5794, Springer, 226-239, 2009

Pribeanu, C., Balog, A., Iordache, D.D. Measuring the usability of augmented reality elearning systems: a user-centered evaluation approach.Chapter 14: Software and Data Technologies, CCIS 47, Corderiro, H., Shiskov B, Ranchordas A, Helfert M (Eds.), Springer, 175-186, 2009.

Ruiz, D.M., Gremler, D., Washburn, J., Carrion, G.C. Service value revisited: specifying a high order formative measure. Journal of Business Research 61, 1278-1291, 2008.
http://dx.doi.org/10.1016/j.jbusres.2008.01.015

Tabachnick, B. G., Fidell, L. S. . Using Multivariate Statistics, 5th ed. Boston: Allyn and Bacon, 2007.

Wilcox, J., Howell, R., Breivik, E. Questions about formative measurement. Journal of Business Research 61, 1219-1228, 2008.
http://dx.doi.org/10.1016/j.jbusres.2008.01.010

Wind, J., Riege, K., Bogen M. SpinnstubeŽ: A Seated Augmented Reality Display System, Virtual Environments: Proc. IPT-EGVE - EG/ACM Symposium, 17-23, 2007.




DOI: https://doi.org/10.15837/ijccc.2012.4.1370



Copyright (c) 2017 Costin Pribeanu

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

CC-BY-NC  License for Website User

Articles published in IJCCC user license are protected by copyright.

Users can access, download, copy, translate the IJCCC articles for non-commercial purposes provided that users, but cannot redistribute, display or adapt:

  • Cite the article using an appropriate bibliographic citation: author(s), article title, journal, volume, issue, page numbers, year of publication, DOI, and the link to the definitive published version on IJCCC website;
  • Maintain the integrity of the IJCCC article;
  • Retain the copyright notices and links to these terms and conditions so it is clear to other users what can and what cannot be done with the  article;
  • Ensure that, for any content in the IJCCC article that is identified as belonging to a third party, any re-use complies with the copyright policies of that third party;
  • Any translations must prominently display the statement: "This is an unofficial translation of an article that appeared in IJCCC. Agora University  has not endorsed this translation."

This is a non commercial license where the use of published articles for commercial purposes is forbiden. 

Commercial purposes include: 

  • Copying or downloading IJCCC articles, or linking to such postings, for further redistribution, sale or licensing, for a fee;
  • Copying, downloading or posting by a site or service that incorporates advertising with such content;
  • The inclusion or incorporation of article content in other works or services (other than normal quotations with an appropriate citation) that is then available for sale or licensing, for a fee;
  • Use of IJCCC articles or article content (other than normal quotations with appropriate citation) by for-profit organizations for promotional purposes, whether for a fee or otherwise;
  • Use for the purposes of monetary reward by means of sale, resale, license, loan, transfer or other form of commercial exploitation;

    The licensor cannot revoke these freedoms as long as you follow the license terms.

[End of CC-BY-NC  License for Website User]


INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL (IJCCC), With Emphasis on the Integration of Three Technologies (C & C & C),  ISSN 1841-9836.

IJCCC was founded in 2006,  at Agora University, by  Ioan DZITAC (Editor-in-Chief),  Florin Gheorghe FILIP (Editor-in-Chief), and  Misu-Jan MANOLESCU (Managing Editor).

Ethics: This journal is a member of, and subscribes to the principles of, the Committee on Publication Ethics (COPE).

Ioan  DZITAC (Editor-in-Chief) at COPE European Seminar, Bruxelles, 2015:

IJCCC is covered/indexed/abstracted in Science Citation Index Expanded (since vol.1(S),  2006); JCR2018: IF=1.585..

IJCCC is indexed in Scopus from 2008 (CiteScore2018 = 1.56):

Nomination by Elsevier for Journal Excellence Award Romania 2015 (SNIP2014 = 1.029): Elsevier/ Scopus

IJCCC was nominated by Elsevier for Journal Excellence Award - "Scopus Awards Romania 2015" (SNIP2014 = 1.029).

IJCCC is in Top 3 of 157 Romanian journals indexed by Scopus (in all fields) and No.1 in Computer Science field by Elsevier/ Scopus.

 

 Impact Factor in JCR2018 (Clarivate Analytics/SCI Expanded/ISI Web of Science): IF=1.585 (Q3). Scopus: CiteScore2018=1.56 (Q2); Editors-in-Chief: Ioan DZITAC & Florin Gheorghe FILIP.