Evaluation of an Information Assistance System Based on an Agent-based Architecture in Transportation Domain: First Results

Abdelwaheb Trabelsi, Houcine Ezzeddine

Abstract


The evaluation of interactive systems is a wide and rich research domain: many methods, criteria and tools are available. In this article, we are focused on agent-based interactive systems. We first describe the agent oriented architecture used in our researches. Then we propose an evaluation approach based on three complementary techniques: assistance evaluation tool, questionnaire, and verbalization. The validation of our approach occurred within the framework of a project involving an industrial partner which is running the current urban transport network (tramway and bus) in the town of Valenciennes, France. The main results of the evaluation of an agent-based Information Assistance System (IAS) are presented. This evaluation is based on two scenarios: normal or distrupted running mode. This evaluation has been conducted in laboratory.

Keywords


Evaluation, Human-Computer Interaction, Electronic informer, Information Assistance System, traffic regulation.

Full Text:

PDF

References


L. Bass, R. Little, R. Pellegrino, and S. Reed. The arch model: Seeheim revisited. In User Interface DeveloppersWorkshop, Seeheim, 1991.

F. T. Bernard and B. David. AMF : un modèle d'architecture multi-agents multi-facettes. TSI, 18(5):555-586, 1999.

J. Coutaz. PAC, on object oriented model for dialog design. In Interact'87, 1987. 6 pages.

J. Coutaz and L. Nigay. Architecture logicielle conceptuelle des systèmes interactifs, 207-246. 2001. Chapitre 7 Analyse et Conception de l'Interaction Homme-Machine dans les syst'emes d'information, Kolski Ed., Hermes Publ.

I. Dzitac and B.E. Barbat. Artificial intelligence + distributed systems = agents. Int J Comput Commun, 1(4):17-26, 2009.

H. Ezzedine, T. Bonte, C. Kolski, and C. Tahon. Integration of trafic management and traveller information systems: basic principles and case study in intermodal transport system management. Int J Comput Commun, 3(3):281-294, 2008.

H. Ezzedine and C. Kolski. Use of petri nets for modeling an agent-based interactive system: basic principles and case study. In V. Kordic (Ed.), Petri Net: Theory and Application, I-Tech Education and Publishing, Vienna, Austria, 131-148, 2008.

H. Ezzedine, C. Kolski, and A. Péninou. Agent-oriented design of human-computer interface: application to supervision of an urban transport network. Eng. Appl. Artif. Intell., 18(3):255- 270, April 2005.
http://dx.doi.org/10.1016/j.engappai.2004.09.013

H. Ezzedine, A. Trabelsi, and C. Kolski. Modelling of an interactive system with an agentbased architecture using petri nets, application of the method to the supervision of a transport system. Mathematics and Computers in Simulation, 70(5-6):358-376, 2006.
http://dx.doi.org/10.1016/j.matcom.2005.11.006

F. G. Filip and K. Leivisk¨a. Large-scale complex systems. In Handbook of Automation, 619-638. 2009.

A. Goldberg. SMALLTALK-80: the interactive programming environment. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, 1984.

D. Gracanin, P. Srinivasan, and K. P. Valavanis. Parameterized petri nets and their application to planning and coordination in intelligent systems. Systems, Man and Cybernetics, IEEE Transactions on, 24(10):1483-1497, oct 1994.

A. Holyer. Methods for evaluating user interfaces. In School of Cognitive and Computing Sciences, University of Sussex, Brighton., 1993.

M.Y. Ivory and M.A. Hearst. The state of the art in automating usability evaluation of user interfaces. ACM Comput. Surv., 33(4): 470-516, 2001.
http://dx.doi.org/10.1145/503112.503114

C. Kolski, P. Forbrig, B. David, P. Girard, C. D. Tran, and H. Ezzedine. Agent-based architecture for interactive system design: Current approaches, perspectives and evaluation. In HCI (1), 624-633, 2009.

J. Nielsen. Usability engineering. Academic Press, 1993.

J. Nielsen and T. K. Landaue. A mathematical model of the finding of usability problems. In Proceedings of the INTERACT '93 and CHI '93 conference on Human factors in computing systems, CHI '93, ACM, New York, NY, USA, 206-213, 1993.

M. Pivec, C. Trummer, and J. Pripfl. Eye-tracking adaptable e-learning and content authoring support. Informatica (Slovenia), 30(1):83-86, 2006.

A. Sears and J.A. Jacko, editors. The Human Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications. Lawrence Erlbaum Associates, Mahwah, NJ, 2. edition, 2008.

S. Senach. Évaluation ergonomique des interfaces homme-machine: une revue de la littérature. Technical report, Sophia Antipolis, 1990.

R. Susannah and J. Graham. Evaluating usability of human-computer interfaces: a practical method. Halsted Press, New York, NY, USA, 1989.

J.C. Tarby, H. Ezzedine, and C. Kolski. Trace-based usability evaluation using aspect oriented programming and agent-based software architecture. In Human-Centered Software Engineering, 257-276. 2009.

A. Trabelsi. Contribution à l'évaluation des systèmes interactifs orientés agents : application à un poste de supervision du transport urbain. PhD thesis, University of Valenciennes and Hainaut-Cambrésis, September 2006.

A. Trabelsi and H. Ezzedine. Un pas vers un outil d'aide aux évaluateurs de systèmes interactifs à base d'agents. In Colloque scientifique sur l'ergonomie et l'informatique avancée, pages 337-341, Biarritz, France, 2006.

A. Trabelsi, H. Ezzedine, and C. Kolski. Architecture modelling and evaluation of agentbased interactive systems. In SMC (6), 5159-5164, 2004.

A. Trabelsi, H. Ezzedine, and C. Kolski. Un mouchard électronique orienté agent pour l'évaluation de systèmes interactifs de supervision. In Conférence Internationale Francophone d'Automatique, Bordeaux, France, 2006.

A. Trabelsi, H. Ezzedine, and C. Kolski. Evaluation of agent-based interactive systems, application to an information assistance system: first results. In European Annual Conference on Human Decision-Making and Manual Control, Reims, France, 2009.

C. D. Tran. Vers un environnement genérique et configurable pour l'aide à l'évaluation des systèmes interactifs à base d'agents, Application à un Système d'Aide à l'Information voyageurs. PhD thesis, University of Valenciennes and Hainaut-Cambrésis, July 2009.

C. D. Tran, H. Ezzedine, and C. Kolski. Evaluation of agent-based interactive systems: Proposal of an electronic informer using petri nets. J. UCS, 14(19):3202-3216, 2008.

C. D. Tran, H. Ezzedine, and C. Kolski. A generic and configurable electronic informer to assist the evaluation of agent-based interactive systems. In CADUI, 251-263, 2008.

R. A. Virzi. Streamlining the design process: Running fewer subjects. In Human Factors Society 34th Annual Meeting, 291-294, 1993.




DOI: https://doi.org/10.15837/ijccc.2013.2.312



Copyright (c) 2017 Abdelwaheb Trabelsi, Houcine Ezzeddine

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

CC-BY-NC  License for Website User

Articles published in IJCCC user license are protected by copyright.

Users can access, download, copy, translate the IJCCC articles for non-commercial purposes provided that users, but cannot redistribute, display or adapt:

  • Cite the article using an appropriate bibliographic citation: author(s), article title, journal, volume, issue, page numbers, year of publication, DOI, and the link to the definitive published version on IJCCC website;
  • Maintain the integrity of the IJCCC article;
  • Retain the copyright notices and links to these terms and conditions so it is clear to other users what can and what cannot be done with the  article;
  • Ensure that, for any content in the IJCCC article that is identified as belonging to a third party, any re-use complies with the copyright policies of that third party;
  • Any translations must prominently display the statement: "This is an unofficial translation of an article that appeared in IJCCC. Agora University  has not endorsed this translation."

This is a non commercial license where the use of published articles for commercial purposes is forbiden. 

Commercial purposes include: 

  • Copying or downloading IJCCC articles, or linking to such postings, for further redistribution, sale or licensing, for a fee;
  • Copying, downloading or posting by a site or service that incorporates advertising with such content;
  • The inclusion or incorporation of article content in other works or services (other than normal quotations with an appropriate citation) that is then available for sale or licensing, for a fee;
  • Use of IJCCC articles or article content (other than normal quotations with appropriate citation) by for-profit organizations for promotional purposes, whether for a fee or otherwise;
  • Use for the purposes of monetary reward by means of sale, resale, license, loan, transfer or other form of commercial exploitation;

    The licensor cannot revoke these freedoms as long as you follow the license terms.

[End of CC-BY-NC  License for Website User]


INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL (IJCCC), With Emphasis on the Integration of Three Technologies (C & C & C),  ISSN 1841-9836.

IJCCC was founded in 2006,  at Agora University, by  Ioan DZITAC (Editor-in-Chief),  Florin Gheorghe FILIP (Editor-in-Chief), and  Misu-Jan MANOLESCU (Managing Editor).

Ethics: This journal is a member of, and subscribes to the principles of, the Committee on Publication Ethics (COPE).

Ioan  DZITAC (Editor-in-Chief) at COPE European Seminar, Bruxelles, 2015:

IJCCC is covered/indexed/abstracted in Science Citation Index Expanded (since vol.1(S),  2006); JCR2018: IF=1.585..

IJCCC is indexed in Scopus from 2008 (CiteScore2018 = 1.56):

Nomination by Elsevier for Journal Excellence Award Romania 2015 (SNIP2014 = 1.029): Elsevier/ Scopus

IJCCC was nominated by Elsevier for Journal Excellence Award - "Scopus Awards Romania 2015" (SNIP2014 = 1.029).

IJCCC is in Top 3 of 157 Romanian journals indexed by Scopus (in all fields) and No.1 in Computer Science field by Elsevier/ Scopus.

 

 Impact Factor in JCR2018 (Clarivate Analytics/SCI Expanded/ISI Web of Science): IF=1.585 (Q3). Scopus: CiteScore2018=1.56 (Q2); Editors-in-Chief: Ioan DZITAC & Florin Gheorghe FILIP.