Evaluation of an Information Assistance System Based on an Agent-based Architecture in Transportation Domain: First Results
Keywords:
Evaluation, Human-Computer Interaction, Electronic informer, Information Assistance System, traffic regulation.Abstract
The evaluation of interactive systems is a wide and rich research domain: many methods, criteria and tools are available. In this article, we are focused on agent-based interactive systems. We first describe the agent oriented architecture used in our researches. Then we propose an evaluation approach based on three complementary techniques: assistance evaluation tool, questionnaire, and verbalization. The validation of our approach occurred within the framework of a project involving an industrial partner which is running the current urban transport network (tramway and bus) in the town of Valenciennes, France. The main results of the evaluation of an agent-based Information Assistance System (IAS) are presented. This evaluation is based on two scenarios: normal or distrupted running mode. This evaluation has been conducted in laboratory.References
L. Bass, R. Little, R. Pellegrino, and S. Reed. The arch model: Seeheim revisited. In User Interface DeveloppersWorkshop, Seeheim, 1991.
F. T. Bernard and B. David. AMF : un modèle d'architecture multi-agents multi-facettes. TSI, 18(5):555-586, 1999.
J. Coutaz. PAC, on object oriented model for dialog design. In Interact'87, 1987. 6 pages.
J. Coutaz and L. Nigay. Architecture logicielle conceptuelle des systèmes interactifs, 207-246. 2001. Chapitre 7 Analyse et Conception de l'Interaction Homme-Machine dans les syst'emes d'information, Kolski Ed., Hermes Publ.
I. Dzitac and B.E. Barbat. Artificial intelligence + distributed systems = agents. Int J Comput Commun, 1(4):17-26, 2009.
H. Ezzedine, T. Bonte, C. Kolski, and C. Tahon. Integration of trafic management and traveller information systems: basic principles and case study in intermodal transport system management. Int J Comput Commun, 3(3):281-294, 2008.
H. Ezzedine and C. Kolski. Use of petri nets for modeling an agent-based interactive system: basic principles and case study. In V. Kordic (Ed.), Petri Net: Theory and Application, I-Tech Education and Publishing, Vienna, Austria, 131-148, 2008.
H. Ezzedine, C. Kolski, and A. Péninou. Agent-oriented design of human-computer interface: application to supervision of an urban transport network. Eng. Appl. Artif. Intell., 18(3):255- 270, April 2005. http://dx.doi.org/10.1016/j.engappai.2004.09.013
H. Ezzedine, A. Trabelsi, and C. Kolski. Modelling of an interactive system with an agentbased architecture using petri nets, application of the method to the supervision of a transport system. Mathematics and Computers in Simulation, 70(5-6):358-376, 2006. http://dx.doi.org/10.1016/j.matcom.2005.11.006
F. G. Filip and K. Leivisk¨a. Large-scale complex systems. In Handbook of Automation, 619-638. 2009.
A. Goldberg. SMALLTALK-80: the interactive programming environment. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, 1984.
D. Gracanin, P. Srinivasan, and K. P. Valavanis. Parameterized petri nets and their application to planning and coordination in intelligent systems. Systems, Man and Cybernetics, IEEE Transactions on, 24(10):1483-1497, oct 1994.
A. Holyer. Methods for evaluating user interfaces. In School of Cognitive and Computing Sciences, University of Sussex, Brighton., 1993.
M.Y. Ivory and M.A. Hearst. The state of the art in automating usability evaluation of user interfaces. ACM Comput. Surv., 33(4): 470-516, 2001. http://dx.doi.org/10.1145/503112.503114
C. Kolski, P. Forbrig, B. David, P. Girard, C. D. Tran, and H. Ezzedine. Agent-based architecture for interactive system design: Current approaches, perspectives and evaluation. In HCI (1), 624-633, 2009.
J. Nielsen. Usability engineering. Academic Press, 1993.
J. Nielsen and T. K. Landaue. A mathematical model of the finding of usability problems. In Proceedings of the INTERACT '93 and CHI '93 conference on Human factors in computing systems, CHI '93, ACM, New York, NY, USA, 206-213, 1993.
M. Pivec, C. Trummer, and J. Pripfl. Eye-tracking adaptable e-learning and content authoring support. Informatica (Slovenia), 30(1):83-86, 2006.
A. Sears and J.A. Jacko, editors. The Human Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications. Lawrence Erlbaum Associates, Mahwah, NJ, 2. edition, 2008.
S. Senach. Évaluation ergonomique des interfaces homme-machine: une revue de la littérature. Technical report, Sophia Antipolis, 1990.
R. Susannah and J. Graham. Evaluating usability of human-computer interfaces: a practical method. Halsted Press, New York, NY, USA, 1989.
J.C. Tarby, H. Ezzedine, and C. Kolski. Trace-based usability evaluation using aspect oriented programming and agent-based software architecture. In Human-Centered Software Engineering, 257-276. 2009.
A. Trabelsi. Contribution à l'évaluation des systèmes interactifs orientés agents : application à un poste de supervision du transport urbain. PhD thesis, University of Valenciennes and Hainaut-Cambrésis, September 2006.
A. Trabelsi and H. Ezzedine. Un pas vers un outil d'aide aux évaluateurs de systèmes interactifs à base d'agents. In Colloque scientifique sur l'ergonomie et l'informatique avancée, pages 337-341, Biarritz, France, 2006.
A. Trabelsi, H. Ezzedine, and C. Kolski. Architecture modelling and evaluation of agentbased interactive systems. In SMC (6), 5159-5164, 2004.
A. Trabelsi, H. Ezzedine, and C. Kolski. Un mouchard électronique orienté agent pour l'évaluation de systèmes interactifs de supervision. In Conférence Internationale Francophone d'Automatique, Bordeaux, France, 2006.
A. Trabelsi, H. Ezzedine, and C. Kolski. Evaluation of agent-based interactive systems, application to an information assistance system: first results. In European Annual Conference on Human Decision-Making and Manual Control, Reims, France, 2009.
C. D. Tran. Vers un environnement genérique et configurable pour l'aide à l'évaluation des systèmes interactifs à base d'agents, Application à un Système d'Aide à l'Information voyageurs. PhD thesis, University of Valenciennes and Hainaut-Cambrésis, July 2009.
C. D. Tran, H. Ezzedine, and C. Kolski. Evaluation of agent-based interactive systems: Proposal of an electronic informer using petri nets. J. UCS, 14(19):3202-3216, 2008.
C. D. Tran, H. Ezzedine, and C. Kolski. A generic and configurable electronic informer to assist the evaluation of agent-based interactive systems. In CADUI, 251-263, 2008.
R. A. Virzi. Streamlining the design process: Running fewer subjects. In Human Factors Society 34th Annual Meeting, 291-294, 1993.
Published
Issue
Section
License
ONLINE OPEN ACCES: Acces to full text of each article and each issue are allowed for free in respect of Attribution-NonCommercial 4.0 International (CC BY-NC 4.0.
You are free to:
-Share: copy and redistribute the material in any medium or format;
-Adapt: remix, transform, and build upon the material.
The licensor cannot revoke these freedoms as long as you follow the license terms.
DISCLAIMER: The author(s) of each article appearing in International Journal of Computers Communications & Control is/are solely responsible for the content thereof; the publication of an article shall not constitute or be deemed to constitute any representation by the Editors or Agora University Press that the data presented therein are original, correct or sufficient to support the conclusions reached or that the experiment design or methodology is adequate.
