Using Augmented Reality in Remote Laboratories

Hector Vargas, Gonzalo Farias, Jose Sanchez, Sebastian Dormido, Francisco Esquembre

Abstract


This paper introduces the concept of “augmented reality” as a novel way to enhance visualization in remote laboratories for engineering education. In a typical remote experimentation session, students get access to a remote real plant located at the laboratory to carry out their assignments. Usually, the graphical user interface allows users to watch the equipment by video stream in live. However, in some cases, visual feedback by video stream could be enhanced by means of augmented reality techniques, which mix together in one image, the video stream and computer generated data. Such mixture produces an added value to remote experimentation, increasing the sense of presence and reality, and helping to understand much better the concepts under study. In this work, a Java-based approach to be used in the remote experimentation context for pedagogical purposes is presented. Firstly, a pure Java example is given to readers (including the source code) and then, a more sophisticated example using a Java-based open source tool known as Easy Java Simulations is introduced. This latter option takes advantage of a new developed component, called camimage, which is an easy-to-use visual element that allows authors to capture video stream from IP cameras in order to mix real images with computer generated graphics.

Keywords


Augmented reality; Virtual-labs; Remote-labs; Engineering education

Full Text:

PDF

References


Azuma, R. (1997); A Survey of Augmented Reality, Presence: Teleoperators and Virtual Environments, 6(4): 355-385.

Azuma, R. et al. (2001); Recent advances in augmented reality, IEEE Computer Graphics and Applications, ISSN 0272-1716, 21(6): 34-47.

Feiner, S. et al. (1997); A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment, Personal and Ubiquitous Computing, ISSN 1617-4909, 21(6): 208-217.

Kalkofen, D. et al. (2007); Interactive Focus and Context Visualization for Augmented Reality, Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, ISBN 978-1-4244-1749-0, pp. 1-10.

Klopfer, E. and Squire, K. (2008); Environmental Detectives the development of an augmented reality platform for environmental simulations, Educational Technology Research and Development, ISSN 1042-1629, 56: 203-228.

Esquembre, F. (2004); Easy Java Simulations: a software tool to create scientific simulations in Java, Computer Physics Communications, ISSN 0010-4655, 156(2): 199-204.

Ejs Java Simulations home page, http://www.um.es/fem/EjsWiki.

Dormido, S. (2002); Control learning: Present and future, IFAC Annual Control Reviews, 28: 115-136.

Dormido, S. et al. (2005); The role of interactivity in control learning, The International Journal of Engineering Education, 21(6): 1122-1133.

Sanchez, J. et al. (2005); The learning of control concepts using interactive tools, Computer Applications in Engineering Education, 13(1): 84-98.

Farias, G. (2010); Adding Interactive Human Interface to Engineering Software, Ph.D. Thesis from Department of Computer Science and Automatic Control.

Farias, G. et al. (2010); Java Simulations of Embedded Control Systems, Sensors, 9(10): 8585-8603.

Vargas, H. et al. (2009); Web-enabled Remote Scientific Environments, Computing in Science and Engineering, 11(3): 36-46.

Vargas, H. (2010); An Integral Web-based Environment for Control Engineering Education, Ph.D. Thesis from Department of Computer Science and Automatic Control.

Farias, G. et al. (2010); Developing Networked Control Labs: A Matlab and Easy Java Simulations Approach, IEEE Transactions on Industrial Electronics, 57(10): 3266-3275.

Aliane, N. (2010); Limitations of Remote Laboratories in Control Engineering Education, International Journal Online Engineering, 6(1): 31-33.

Casini, M. (2003); The Automatic Control Telelab: A User-Friendly Interface for Distance Learning, IEEE Transactions on Education, 46(2): 252-257.

Casini, M. (2007); Web-Based Control and Robotics Education, Publisher Springer, pp. 127-151.

Martin, C. (2007); Web-Based Control and Robotics Education, Publisher Springer, pp. 103-125.

Internet Remote Experimentation from NUS (2011); http://vlab.ee.nus.edu.sg/vlab.

Dormido, S. el al. (2005); Adding Interactivity to Existing Simulink Models Using Easy Java Simulations, Proc. 44th IEEE Conference on Decision and Control and the European Control, Sevilla, Spain.

Nguyen, A.V. (2006); Iterative Design and Evaluation of a Web-Based Experimentation Environment, User-Centered Design of Online Learning Communities, pp. 286-313.

Nguyen, A.V. (2007); Activity Theoretical Analysis and Design Model for Web-Based Experimentation, Proc. Int’l Conf. Human-Computer Interaction.

Restivo M.T. and Silva M.G. (2009); Portuguese Universities Sharing Remote Laboratories, Int’l J. Online Eng., 5: 16-19.

Dormido, R. et al. (2008); Development of a Collaborative Web-Based Control Laboratory for Automation Technicians: The Three-Tank System, IEEE Transactions on Education, 51(1): 35-44.

Vargas, H. et al. (2011); A Network of Automatic Control Web-based Laboratories, IEEE Transactions on Learning Technologies, 4(3): 197-208.Azuma, R. (1997); A Survey of Augmented Reality, Presence: Teleoperators and Virtual Environments, 6(4): 355-385.

Azuma, R. et al. (2001); Recent advances in augmented reality, IEEE Computer Graphics and Applications, ISSN 0272-1716, 21(6): 34-47.

Feiner, S. et al. (1997); A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment, Personal and Ubiquitous Computing, ISSN 1617-4909, 21(6): 208-217.

Kalkofen, D. et al. (2007); Interactive Focus and Context Visualization for Augmented Reality, Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, ISBN 978-1-4244-1749-0, pp. 1-10.

Interactive Focus and Context Visualization for Augmented Reality, Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, ISBN 978-1-4244-1749-0, pp. 1-10.

Klopfer, E. and Squire, K. (2008); Environmental Detectives the development of an augmented reality platform for environmental simulations, Educational Technology Research and Development, ISSN 1042-1629, 56: 203-228.

Esquembre, F. (2004); Easy Java Simulations: a software tool to create scientific simulations in Java, Computer Physics Communications, ISSN 0010-4655, 156(2): 199-204.

Ejs Java Simulations home page, http://www.um.es/fem/EjsWiki.

Dormido, S. (2002); Control learning: Present and future, IFAC Annual Control Reviews, 28: 115-136.

Dormido, S. et al. (2005); The role of interactivity in control learning, The International Journal of Engineering Education, 21(6): 1122-1133.

Sanchez, J. et al. (2005); The learning of control concepts using interactive tools, Computer Applications in Engineering Education, 13(1): 84-98.

The learning of control concepts using interactive tools, Computer Applications in Engineering Education, 13(1): 84-98.
http://dx.doi.org/10.1002/cae.20033

Farias, G. (2010); Adding Interactive Human Interface to Engineering Software, Ph.D. Thesis from Department of Computer Science and Automatic Control.

Farias, G. et al. (2010); Java Simulations of Embedded Control Systems, Sensors, 9(10): 8585-8603.
http://dx.doi.org/10.3390/s100908585

Vargas, H. et al. (2009); Web-enabled Remote Scientific Environments, Computing in Science and Engineering, 11(3): 36-46.
http://dx.doi.org/10.1109/MCSE.2009.61

Vargas, H. (2010); An Integral Web-based Environment for Control Engineering Education, Ph.D. Thesis from Department of Computer Science and Automatic Control.

Farias, G. et al. (2010); Developing Networked Control Labs: A Matlab and Easy Java Simulations Approach, IEEE Transactions on Industrial Electronics, 57(10): 3266-3275.
http://dx.doi.org/10.1109/TIE.2010.2041130

Aliane, N. (2010); Limitations of Remote Laboratories in Control Engineering Education, International Journal Online Engineering, 6(1): 31-33.

Casini, M. (2003); The Automatic Control Telelab: A User-Friendly Interface for Distance Learning, IEEE Transactions on Education, 46(2): 252-257.
http://dx.doi.org/10.1109/TE.2002.808224

Casini, M. (2007); Web-Based Control and Robotics Education, Publisher Springer, pp. 127-151.

Martin, C. (2007); Web-Based Control and Robotics Education, Publisher Springer, pp. 103-125.

Internet Remote Experimentation from NUS (2011); http://vlab.ee.nus.edu.sg/vlab.

Dormido, S. el al. (2005); Adding Interactivity to Existing Simulink Models Using Easy Java Simulations, Proc. 44th IEEE Conference on Decision and Control and the European Control, Sevilla, Spain.

Adding Interactivity to Existing Simulink Models Using Easy Java Simulations, Proc. 44th IEEE Conference on Decision and Control and the European Control, Sevilla, Spain.

Nguyen, A.V. (2006); Iterative Design and Evaluation of a Web-Based Experimentation Environment, User-Centered Design of Online Learning Communities, pp. 286-313.

Nguyen, A.V. (2007); Activity Theoretical Analysis and Design Model for Web-Based Experimentation, Proc. Int'l Conf. Human-Computer Interaction.

Restivo M.T. and Silva M.G. (2009); Portuguese Universities Sharing Remote Laboratories, Int'l J. Online Eng., 5: 16-19.

Dormido, R. et al. (2008); Development of a Collaborative Web-Based Control Laboratory for Automation Technicians: The Three-Tank System, IEEE Transactions on Education, 51(1): 35-44.

Development of a Collaborative Web-Based Control Laboratory for Automation Technicians: The Three-Tank System, IEEE Transactions on Education, 51(1): 35-44.
http://dx.doi.org/10.1109/TE.2007.893356

Vargas, H. et al. (2011); A Network of Automatic Control Web-based Laboratories, IEEE Transactions on Learning Technologies, 4(3): 197-208.
http://dx.doi.org/10.1109/TLT.2010.35




DOI: https://doi.org/10.15837/ijccc.2013.4.42



Copyright (c) 2017 Hector Vargas, Gonzalo Farias, Jose Sanchez, Sebastian Dormido, Francisco Esquembre

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

CC-BY-NC  License for Website User

Articles published in IJCCC user license are protected by copyright.

Users can access, download, copy, translate the IJCCC articles for non-commercial purposes provided that users, but cannot redistribute, display or adapt:

  • Cite the article using an appropriate bibliographic citation: author(s), article title, journal, volume, issue, page numbers, year of publication, DOI, and the link to the definitive published version on IJCCC website;
  • Maintain the integrity of the IJCCC article;
  • Retain the copyright notices and links to these terms and conditions so it is clear to other users what can and what cannot be done with the  article;
  • Ensure that, for any content in the IJCCC article that is identified as belonging to a third party, any re-use complies with the copyright policies of that third party;
  • Any translations must prominently display the statement: "This is an unofficial translation of an article that appeared in IJCCC. Agora University  has not endorsed this translation."

This is a non commercial license where the use of published articles for commercial purposes is forbiden. 

Commercial purposes include: 

  • Copying or downloading IJCCC articles, or linking to such postings, for further redistribution, sale or licensing, for a fee;
  • Copying, downloading or posting by a site or service that incorporates advertising with such content;
  • The inclusion or incorporation of article content in other works or services (other than normal quotations with an appropriate citation) that is then available for sale or licensing, for a fee;
  • Use of IJCCC articles or article content (other than normal quotations with appropriate citation) by for-profit organizations for promotional purposes, whether for a fee or otherwise;
  • Use for the purposes of monetary reward by means of sale, resale, license, loan, transfer or other form of commercial exploitation;

    The licensor cannot revoke these freedoms as long as you follow the license terms.

[End of CC-BY-NC  License for Website User]


INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL (IJCCC), With Emphasis on the Integration of Three Technologies (C & C & C),  ISSN 1841-9836.

IJCCC was founded in 2006,  at Agora University, by  Ioan DZITAC (Editor-in-Chief),  Florin Gheorghe FILIP (Editor-in-Chief), and  Misu-Jan MANOLESCU (Managing Editor).

Ethics: This journal is a member of, and subscribes to the principles of, the Committee on Publication Ethics (COPE).

Ioan  DZITAC (Editor-in-Chief) at COPE European Seminar, Bruxelles, 2015:

IJCCC is covered/indexed/abstracted in Science Citation Index Expanded (since vol.1(S),  2006); JCR2018: IF=1.585..

IJCCC is indexed in Scopus from 2008 (CiteScore2018 = 1.56):

Nomination by Elsevier for Journal Excellence Award Romania 2015 (SNIP2014 = 1.029): Elsevier/ Scopus

IJCCC was nominated by Elsevier for Journal Excellence Award - "Scopus Awards Romania 2015" (SNIP2014 = 1.029).

IJCCC is in Top 3 of 157 Romanian journals indexed by Scopus (in all fields) and No.1 in Computer Science field by Elsevier/ Scopus.

 

 Impact Factor in JCR2018 (Clarivate Analytics/SCI Expanded/ISI Web of Science): IF=1.585 (Q3). Scopus: CiteScore2018=1.56 (Q2); Editors-in-Chief: Ioan DZITAC & Florin Gheorghe FILIP.