An Approach for Construction of Augmented Reality Systems using Natural Markers and Mobile Sensors in Industrial Fields

Daniel Lima Gomes Jr, Paulo Roberto Jansen dos Reis, Anselmo Cardoso de Paiva, Aristófanes Corrêa Silva, Geraldo Braz Jr, Marcelo Gattass, Antônio Sérgio de Araújo

Abstract


This paper presents a methodology for the development of augmented reality (AR) visualization applications in industrial scenarios. The proposal presents the use of georreferenced natural markers detected in real time, which enables the construction of AR systems. This use of augmented visualization allows the creation of tools that can aid on-site maintenance activities for operators. AR use makes possible including information about the equipment during a specific procedure. In this work, the detection of natural markers in the scene are based on Haar-like features associated with equipment geolocalization. This approach enable the detection of equipment in multiple user’s viewpoints in the industrial scenario and makes it possible the inclusion of real information about those equipment in real time as AR annotations. In this way, beyond a methodology approach, this paper presents a new way for Power System information visualization in the field that can be used in both for training and for control operations.

Keywords


Augmented Reality, Data Visualization, Natural Markers

Full Text:

PDF

References


Antonijevic M.; Sucic S.; Keserica H. (2016); Augmented Reality for Substation Automation by Utilizing IEC 61850 Communication, 39th International Convention on Information and Communication Technology, Electronics and Microelectronics - Distributed Computing, Visualization and Biomedical Engineering, Opatija, Croatia, 2016.

Aukstakalnis S.; Blatner D. (1992); Silicon Mirage - The Art and Science of Virtual Reality, Peachpit Press, ISBN: 978-0938151821, 317, 1992.

Azuma R.T. (1997); A Survey of Augmented Reality, Presence: Teleoperators and Virtual Environments, 355-385, 1997.
https://doi.org/10.1162/pres.1997.6.4.355

Bay H.; Ess A.; Tuytelaars T.; Gool L. V. (2008); Speeded-up Robust Features (SURF), Computer Vision and Image Understanding, 110(3), 346-359, 2008.
https://doi.org/10.1016/j.cviu.2007.09.014

CEPEL (2004); Open Energy Management System (Sistema Aberto de Gerenciamento de Energia), [Online] Avaiable: http://sage.cepel.br

Côté S.; Barnard J.; Snyder R. (2013); Offline Spatial Panoramic Video Augmentation for Visual Communication in the AEC Industry, 13th International Conference on Construction Applications of Virtual Reality (CONVR 2013), 82-89, 2013.

Dai J.; Zhang L. (2011); Registered Localization Method-Based on OpenCV for Augmented Reality, International Conference of Soft Computing and Pattern Recognition (SoCPaR), 492-495, 2011.
https://doi.org/10.1109/socpar.2011.6089144

Farag H. E. Z.; El-Saadany E.F. (2012); A Novel Cooperative Protocol for Distributed Voltage Control in Active Distribution Systems, IEEE Transactions on Power Systems, 1645-1656, 2012.

Google (2016); Google Cardboard, [Online] Available at http://googlecardboard.com.br

GPS (2014); GPS Accuracy, Official U.S. Government information about the Global Positioning System, [Online] Available: http://www.gps.gov/systems/gps/performance/accuracy/

Jian Y.; Xin W.; Xue Z.; Zhenyou D. (2015); Cloud Computing and Visual Attention Based Object Detection for Power Substation Surveillance Robots, IEEE 28th Canadian Conference on Electrical and Computer Engineering, 337-342, 2015.

Kim J.; Jun H. (2011); Implementation of Image Processing and Augmented Reality Programs for Smart Mobile Device, The 6th International Forum on Strategic Technology, 1070- 1073, 2011.

Li Z.; Wang J.; Sun H.; Guo Q. (2015); Transmission Contingency Analysis Based on Integrated Transmission and Distribution Power Flow in Smart Grid, IEEE Transactions on Power Systems, 3356-3367, 2015.

Liang M.; Min H.; Luo R.; Zhu J. (2015); Simultaneous Recognition and Modeling for Learning 3-D Object Models From Everyday Scenes, IEEE Transactions on Cybernetics, 45(10), 2237-2248, 2015.
https://doi.org/10.1109/TCYB.2014.2368127

Lienhart, R.; Maydt, J. (2002); An Extended Set of Haar-like Features for Rapid Object Detection, IEEE International Conference on Image Processing (ICIP), 900-903, 2002.

Lin H.; Sambamoorthy S.; Shukla S.; Thorp, J.; Mili L. (2011); Power System and Communication Network Co-Simulation for Smart Grid Applications, Innovative Smart Grid Technologies (ISGT), 1-6, 2011.

Lowe D.G. (2004); Distinctive Image Features from Scale-Invariant Keypoints, International Journal of Computer Vision, 60(2), 91-110, 2004.
https://doi.org/10.1023/B:VISI.0000029664.99615.94

Mahadev P. M.; Christie R. D. (1993); Envisioning Power System Data: Concepts and a Prototype System State Rep-resentation, IEEE Transactions on Power Systems, 8(3), 1084-1090, 1993.
https://doi.org/10.1109/59.260890

Mahadev P. M.; Christie R. D. (1994); Envisioning power system data: vulnerability and severity representations for static security assessment, IEEE Transactions on Power Systems, 9(4), 1915-1920, 1994.
https://doi.org/10.1109/59.331450

Mikkelsen C.; Johansson J.; Cooper M. (2012); Visualization of Power System Data on Situation Overview Displays, 16th International Conference on Information Visualisation, 188-197, 2012.

Milgram P.; Kishino F. (1994); A Taxonomy of Mixed Reality Visual Displays, IEICE Trans. Information and Systems, 1321-1329, 1994.

Nigam S.; Deb K.; Khare A. (2013); Moment Invariants based Object Recognition for Different Pose and Appearances in Real Scenes, International Conference on Informatics, Electronics & Vision (ICIEV), ISBN: 978-1-4799-0397-9, 1-5, 2013.

Overbye T. J.; Weber J. D. (2000); New Methods for the Visualization of Electric Power System Information, IEEE Symposium on Information Visualization, ISSN: 1522-404X, 1-9, 2000.

Overbye T. J.; Weber J. D. (2000); Visualization of power system data, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences, 1-7, 2000.

Pribeanu C. (2012); Specification and Validation of a Formative Index to Evaluate the Ergonomic Quality of an AR-based Educational Platform, International Journal of Computers Communications & Control, 7(4), 721-732, 2012.
https://doi.org/10.15837/ijccc.2012.4.1370

Prochazk D.; Stencl M.; Popelka O.; Stastny J. (2011); Mobile Augmented Reality Applications, Proceedings of Mendel 2011: 17th International Conference on Soft Computing, 469-476, 2011.

Ribeiro T. R.; Reis P. R. J.; Braz Jr., G.; Paiva A. C.; Silva A. C.; Maia I. M. O.; Araújo A. S. (2014); Agito: Virtual reality environment for power systems substations operators training, International Conference on Augmented and Virtual Reality (AVR), 113-123, 2014.

Rublee E.; Rabaud, V.; Konolige K.; Bradski, G. (2011); ORB: an efficient alternative to SIFT or SURF, IEEE International Conference on Computer Vision, 2564-2571, 2011.

Schwegmann C.P.; Kleynhans W.; Salmon B.P. (2014); Ship detection in South African oceans using SAR, CFAR, and a Haar-like feature classifier, Geoscience and Remote Sensing Symposium (IGARSS), 557-570, 2014.

Szeliski R. (2011); Computer Vision: Algorithms and Applications, Springer-Verlag London, ISBN: 978-1-84882-935-0, 812, 2011.

Vargas H.; Farias G.; Sanchez J.; Dormido S.; Esquembre F. (2013); Using Augmented Reality in Remote Laboratories, International Journal of Computers Communications & Control, 8(4), 622-634, 2013.
https://doi.org/10.15837/ijccc.2013.4.42

Viola P.; Jones M. J. (2001); Rapid Object Detection using a Boosted Cascade of Simple Features, Computer Vision and Pattern Recognition (CVPR), 511-518, 2001.

Weber J. D.; Overbye T. J. (2000); Voltage Contours for Power System Visualization, IEEE Transactions on Power Systems, 15(1), 404-409, 2000.
https://doi.org/10.1109/59.852151




DOI: https://doi.org/10.15837/ijccc.2017.4.2658



Copyright (c) 2017 Daniel Lima Gomes Jr, Paulo Roberto Jansen dos Reis, Anselmo Cardoso de Paiva, Aristófanes Corrêa Silva, Geraldo Braz Jr, Marcelo Gattass, Antônio Sérgio de Araújo

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

CC-BY-NC  License for Website User

Articles published in IJCCC user license are protected by copyright.

Users can access, download, copy, translate the IJCCC articles for non-commercial purposes provided that users, but cannot redistribute, display or adapt:

  • Cite the article using an appropriate bibliographic citation: author(s), article title, journal, volume, issue, page numbers, year of publication, DOI, and the link to the definitive published version on IJCCC website;
  • Maintain the integrity of the IJCCC article;
  • Retain the copyright notices and links to these terms and conditions so it is clear to other users what can and what cannot be done with the  article;
  • Ensure that, for any content in the IJCCC article that is identified as belonging to a third party, any re-use complies with the copyright policies of that third party;
  • Any translations must prominently display the statement: "This is an unofficial translation of an article that appeared in IJCCC. Agora University  has not endorsed this translation."

This is a non commercial license where the use of published articles for commercial purposes is forbiden. 

Commercial purposes include: 

  • Copying or downloading IJCCC articles, or linking to such postings, for further redistribution, sale or licensing, for a fee;
  • Copying, downloading or posting by a site or service that incorporates advertising with such content;
  • The inclusion or incorporation of article content in other works or services (other than normal quotations with an appropriate citation) that is then available for sale or licensing, for a fee;
  • Use of IJCCC articles or article content (other than normal quotations with appropriate citation) by for-profit organizations for promotional purposes, whether for a fee or otherwise;
  • Use for the purposes of monetary reward by means of sale, resale, license, loan, transfer or other form of commercial exploitation;

    The licensor cannot revoke these freedoms as long as you follow the license terms.

[End of CC-BY-NC  License for Website User]


INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL (IJCCC), With Emphasis on the Integration of Three Technologies (C & C & C),  ISSN 1841-9836.

IJCCC was founded in 2006,  at Agora University, by  Ioan DZITAC (Editor-in-Chief),  Florin Gheorghe FILIP (Editor-in-Chief), and  Misu-Jan MANOLESCU (Managing Editor).

Ethics: This journal is a member of, and subscribes to the principles of, the Committee on Publication Ethics (COPE).

Ioan  DZITAC (Editor-in-Chief) at COPE European Seminar, Bruxelles, 2015:

IJCCC is covered/indexed/abstracted in Science Citation Index Expanded (since vol.1(S),  2006); JCR2016: IF=1.374. .

IJCCC is indexed in Scopus from 2008 (CiteScore 2017 = 1.04; SNIP2017 = 0.616, SJR2017 =0.326):

Nomination by Elsevier for Journal Excellence Award Romania 2015 (SNIP2014 = 1.029): Elsevier/ Scopus

IJCCC was nominated by Elsevier for Journal Excellence Award - "Scopus Awards Romania 2015" (SNIP2014 = 1.029).

IJCCC is in Top 3 of 157 Romanian journals indexed by Scopus (in all fields) and No.1 in Computer Science field by Elsevier/ Scopus.

 

 Impact Factor in JCR2017 (Clarivate Analytics/SCI Expanded/ISI Web of Science): IF=1.29 (Q3). Scopus: CiteScore2017=1.04 (Q2); Editors-in-Chief: Ioan DZITAC & Florin Gheorghe FILIP.