Evaluation of an Information Assistance System Based on an Agent-based Architecture in Transportation Domain: First Results


  • Abdelwaheb Trabelsi 1. LOGIQ-GIADE, FSEG, University of Sfax 2. Faculty of sciences, PB 1171, 3000 Sfax, Tunisia
  • Houcine Ezzeddine 1. Univ Lille Nord de France, F-59000 Lille, France 2. UVHC, LAMIH, F-59313 Valenciennes, France 3. CNRS, UMR 8530, F-59313 Valenciennes, France


Evaluation, Human-Computer Interaction, Electronic informer, Information Assistance System, traffic regulation.


The evaluation of interactive systems is a wide and rich research domain: many methods, criteria and tools are available. In this article, we are focused on agent-based interactive systems. We first describe the agent oriented architecture used in our researches. Then we propose an evaluation approach based on three complementary techniques: assistance evaluation tool, questionnaire, and verbalization. The validation of our approach occurred within the framework of a project involving an industrial partner which is running the current urban transport network (tramway and bus) in the town of Valenciennes, France. The main results of the evaluation of an agent-based Information Assistance System (IAS) are presented. This evaluation is based on two scenarios: normal or distrupted running mode. This evaluation has been conducted in laboratory.


L. Bass, R. Little, R. Pellegrino, and S. Reed. The arch model: Seeheim revisited. In User Interface DeveloppersWorkshop, Seeheim, 1991.

F. T. Bernard and B. David. AMF : un modèle d'architecture multi-agents multi-facettes. TSI, 18(5):555-586, 1999.

J. Coutaz. PAC, on object oriented model for dialog design. In Interact'87, 1987. 6 pages.

J. Coutaz and L. Nigay. Architecture logicielle conceptuelle des systèmes interactifs, 207-246. 2001. Chapitre 7 Analyse et Conception de l'Interaction Homme-Machine dans les syst'emes d'information, Kolski Ed., Hermes Publ.

I. Dzitac and B.E. Barbat. Artificial intelligence + distributed systems = agents. Int J Comput Commun, 1(4):17-26, 2009.

H. Ezzedine, T. Bonte, C. Kolski, and C. Tahon. Integration of trafic management and traveller information systems: basic principles and case study in intermodal transport system management. Int J Comput Commun, 3(3):281-294, 2008.

H. Ezzedine and C. Kolski. Use of petri nets for modeling an agent-based interactive system: basic principles and case study. In V. Kordic (Ed.), Petri Net: Theory and Application, I-Tech Education and Publishing, Vienna, Austria, 131-148, 2008.

H. Ezzedine, C. Kolski, and A. Péninou. Agent-oriented design of human-computer interface: application to supervision of an urban transport network. Eng. Appl. Artif. Intell., 18(3):255- 270, April 2005. http://dx.doi.org/10.1016/j.engappai.2004.09.013

H. Ezzedine, A. Trabelsi, and C. Kolski. Modelling of an interactive system with an agentbased architecture using petri nets, application of the method to the supervision of a transport system. Mathematics and Computers in Simulation, 70(5-6):358-376, 2006. http://dx.doi.org/10.1016/j.matcom.2005.11.006

F. G. Filip and K. Leivisk¨a. Large-scale complex systems. In Handbook of Automation, 619-638. 2009.

A. Goldberg. SMALLTALK-80: the interactive programming environment. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, 1984.

D. Gracanin, P. Srinivasan, and K. P. Valavanis. Parameterized petri nets and their application to planning and coordination in intelligent systems. Systems, Man and Cybernetics, IEEE Transactions on, 24(10):1483-1497, oct 1994.

A. Holyer. Methods for evaluating user interfaces. In School of Cognitive and Computing Sciences, University of Sussex, Brighton., 1993.

M.Y. Ivory and M.A. Hearst. The state of the art in automating usability evaluation of user interfaces. ACM Comput. Surv., 33(4): 470-516, 2001. http://dx.doi.org/10.1145/503112.503114

C. Kolski, P. Forbrig, B. David, P. Girard, C. D. Tran, and H. Ezzedine. Agent-based architecture for interactive system design: Current approaches, perspectives and evaluation. In HCI (1), 624-633, 2009.

J. Nielsen. Usability engineering. Academic Press, 1993.

J. Nielsen and T. K. Landaue. A mathematical model of the finding of usability problems. In Proceedings of the INTERACT '93 and CHI '93 conference on Human factors in computing systems, CHI '93, ACM, New York, NY, USA, 206-213, 1993.

M. Pivec, C. Trummer, and J. Pripfl. Eye-tracking adaptable e-learning and content authoring support. Informatica (Slovenia), 30(1):83-86, 2006.

A. Sears and J.A. Jacko, editors. The Human Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications. Lawrence Erlbaum Associates, Mahwah, NJ, 2. edition, 2008.

S. Senach. Évaluation ergonomique des interfaces homme-machine: une revue de la littérature. Technical report, Sophia Antipolis, 1990.

R. Susannah and J. Graham. Evaluating usability of human-computer interfaces: a practical method. Halsted Press, New York, NY, USA, 1989.

J.C. Tarby, H. Ezzedine, and C. Kolski. Trace-based usability evaluation using aspect oriented programming and agent-based software architecture. In Human-Centered Software Engineering, 257-276. 2009.

A. Trabelsi. Contribution à l'évaluation des systèmes interactifs orientés agents : application à un poste de supervision du transport urbain. PhD thesis, University of Valenciennes and Hainaut-Cambrésis, September 2006.

A. Trabelsi and H. Ezzedine. Un pas vers un outil d'aide aux évaluateurs de systèmes interactifs à base d'agents. In Colloque scientifique sur l'ergonomie et l'informatique avancée, pages 337-341, Biarritz, France, 2006.

A. Trabelsi, H. Ezzedine, and C. Kolski. Architecture modelling and evaluation of agentbased interactive systems. In SMC (6), 5159-5164, 2004.

A. Trabelsi, H. Ezzedine, and C. Kolski. Un mouchard électronique orienté agent pour l'évaluation de systèmes interactifs de supervision. In Conférence Internationale Francophone d'Automatique, Bordeaux, France, 2006.

A. Trabelsi, H. Ezzedine, and C. Kolski. Evaluation of agent-based interactive systems, application to an information assistance system: first results. In European Annual Conference on Human Decision-Making and Manual Control, Reims, France, 2009.

C. D. Tran. Vers un environnement genérique et configurable pour l'aide à l'évaluation des systèmes interactifs à base d'agents, Application à un Système d'Aide à l'Information voyageurs. PhD thesis, University of Valenciennes and Hainaut-Cambrésis, July 2009.

C. D. Tran, H. Ezzedine, and C. Kolski. Evaluation of agent-based interactive systems: Proposal of an electronic informer using petri nets. J. UCS, 14(19):3202-3216, 2008.

C. D. Tran, H. Ezzedine, and C. Kolski. A generic and configurable electronic informer to assist the evaluation of agent-based interactive systems. In CADUI, 251-263, 2008.

R. A. Virzi. Streamlining the design process: Running fewer subjects. In Human Factors Society 34th Annual Meeting, 291-294, 1993.



Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.