Fuzzy Logic-Based System for the Estimation of the Usability Level in User Tests

Authors

  • Gabriel Elías Chanchí Golondrino University of Cartagena, Colombia
  • Luz Marina Sierra Martí­nez University of Cauca, Colombia
  • Wilmar Yesid Campo Muñoz University of Quindí­o, Colombia

DOI:

https://doi.org/10.15837/ijccc.2022.2.4476

Keywords:

ISO 9241-11, fuzzy logic, usability test, usability

Abstract

Starting from the challenge of obtaining the usability level in numerical and linguistic terms within a user test based on the three attributes that define usability, the development of a system based on fuzzy logic is proposed for estimating the level of output usability in a test with users based on the ISO 9241-11 standard. The attributes are effectiveness, efficiency, and satisfaction, which have different metrics and numerical scales. For the development of the system, five methodological stages were defined: characterization of the structure of a usability test, definition of membership functions for the inputs and outputs of the system, design of the inference rules that relate the inputs and outputs, design and implementation of the fuzzy system, and development of the case study. The proposed system was implemented using the FCL (Fuzzy Control Language) and the jFuzzyLogic API that takes as inputs the values calculated for the attributes of effectiveness, efficiency, and satisfaction, and obtains the usability level as output considering the membership functions of the inputs and outputs, as well as a set of inference rules defined by a set of experts. As a case study, the proposed fuzzy system was validated from the results obtained in a usability test with 5 users which was developed on the Sigma Electrónica website. From the results obtained in the case study, it could be concluded that the implemented system is adequate in terms of obtaining a level of usability in numerical and linguistic terms in conventional usability tests developed in a usability laboratory considering the attributes of ISO 9241-11.

References

[1] Albornoz, D. A.; Moncayo, S. A.; Ruano-Hoyos, S.; Chanchí­-Golondrino, G.E.; Márceles-Villalba, K. (2019). Sistema software para la ejecución de pruebas de usabilidad bajo el enfoque de mouse tracking, TecnoLógicas, DOI: 10.22430/22565337.1511, 22, 19-31, 2019. https://doi.org/10.22430/22565337.1511

[2] Axinte, S.D.; Bacivarov, I. C. (2009). Improving the Quality of Web Applications Through Targeted Usability Enhancements, 2018 10th International Conference on Electronics, Computers and Artificial Intelligence (ECAI), DOI: 10.1109/ECAI.2018.8679098,1-4, 2009. https://doi.org/10.1109/ECAI.2018.8679098

[3] Aznar-Colino, E.; Royo-Garcí­a, J. (2007). Conceptos y aplicaciones de la lógica borrosa, Técnica industrial, (269), 58-62, 2007.

[4] Baquero-Hernández, L. R.; Rodriguez-Valdés, O.; Ciudad-Ricardo, F. A. (2016). Lógica Difusa Basada en la Experiencia del Usuario para Medir la Usabilidad, Revista Latinoamericana de Ingenierí­a de Software, DOI: 10.18294/relais.2016.48-54, 4(1), 48-54, 2016. https://doi.org/10.18294/relais.2016.48-54

[5] Chanchí­-Golondrino, G.E.; Muñoz-Sanabria, L.F.; Campo-Muñoz, W. (2018). Proposal of a tool for the stimation of satisfaction in usability test under the approach of thinking aloud, Communications in Computer and Information Science, DOI: 10.1007/978-3-030-03763-5_18, 944, 211-222, 2018. https://doi.org/10.1007/978-3-030-03763-5_18

[6] Chanchí­-Golondrino, G.E.; Ospina, M.A.; Pérez, J.L. (2020). Sistema IoT para la monitorización de la variabilidad del ritmo cardiaco en pruebas de usabilidad, Espacios, 41(25), 84-97, 2020. https://doi.org/10.48082/espacios-a20v41n50p04

[7] Santos-Peñas, M.; Miranda-Suescun, E. (2012). Chanchi-Golondrino, G.E.; Ospina, M. A.; Monroy, M. E. (2020). Aplicación de la lógica difusa en el análisis de inspecciones heurí­sticas de usabilidad, Espacios, 41(27),159-173, 2020.

[8] Chanchí­-Golondrino, G. E.; Sierra-Martí­nez, L. M.; Campo-Muñoz, W. Y. (2021). Aplicación de la lógica difusa en la implementación de rúbricas de evaluación en el contexto universitario, Revista Ibérica de Sistemas e Tecnologias de Informaí§ão, (E42), 174-187, 2021.

[9] Delgado, D.M.; Girón-Timana, D.F.; Chanchí­-Golondrino, G.E.; Márceles-Villalba, K. (2019). Estimación del atributo satisfacción en test de usuarios a partir del análisis de la expresión facial, Ingenierí­as, DOI: 10.22395/rium.v19n36a1, 19(36), 13-28, 2019. https://doi.org/10.22395/rium.v19n36a1

[10] Dí­az-Córdova, J.F.; Coba-Molina, E.; Navarrete, P. (2017). Lógica difusa y el riesgo financiero. Una propuesta de clasificación de riesgo financiero al sector cooperativo, Contadurí­a y Administración, DOI: 10.1016/j.cya.2017.09.001, 62(5), 1670-1686, 2017. https://doi.org/10.1016/j.cya.2017.09.001

[11] Dí­az-Gutiérrez, E.; Valderrama-Garcí­a, C. F. (2018). Evaluación de la usabilidad de los EVA (entornos virtuales de aprendizaje) a partir de la experiencia de usuarios aplicando lógica difusa, Ví­nculos, DOI: 10.14483/2322939X.14006, 15(2), 56-65, 2018. https://doi.org/10.14483/2322939X.14006

[12] Dzulfiqar, M. D.; Khairani, D.; Wardhani, L. K. (2019). The Development of University Website using User Centered Design Method with ISO 9126 Standard, 2018 6th International Conference on Cyber and IT Service Management (CITSM), DOI: 10.1109/CITSM.2018.8674325, 2019. https://doi.org/10.1109/CITSM.2018.8674325

[13] Enriquez, J. G.; Casas, S. (2013). Usabilidad en aplicaciones móviles, Informe Cientí­fico Técnico UNPA, 5(2), 25-47, 2013. https://doi.org/10.22305/ict-unpa.v5i2.71

[14] Esquivel-Garcí­a, R; Felix-Benjamin, G.; Bello-Pérez, R. (2014). Evaluación del impacto de la capacitación con lógica difusa, Ingeniare, DOI: http://dx.doi.org/10.4067/S0718- 33052014000100005, 22(1), 41-52, 2014. https://doi.org/10.4067/S0718-33052014000100005

[15] Farinazzo Martins, V.; Marcos, H.; Nakagawa, J.; de Paiva Guimarí¢es, M. (2013). Usability testing of a Brain-Computer Interface, 8th Iberian Conference on Information Systems and Technologies (CISTI), 1-6, 2013.

[16] Farinazzo Martins, V.; de Paiva Guimarí¢es, M.; Correa, A.G. (2013). Usability test for Augmented Reality applications, 2013 XXXIX Latin American Computing Conference (CLEI), DOI: 10.1109/CLEI.2013.6670668, 2013. https://doi.org/10.1109/CLEI.2013.6670668

[17] Finstad, K. (2010). The usability metric for user experience, Interacting with Computers, DOI: 10.1016/j.intcom.2010.04.004, 22(5), 323-327, 2010. https://doi.org/10.1016/j.intcom.2010.04.004

[18] Garcí­a-Serrano, A. (2018). Inteligencia Artificial - Fundamentos, práctica y aplicaciones, Alfaomega, 2018.

[19] González-Sánchez, J.L.; Montero-Simarro, F.; Gutiérrez-Vela, F.L. (2012). Evolución del concepto de usabilidad como indicador de la calidad del software, El Profesional de la Información, DOI: 10.3145/epi.2012.sep.13, 21(5), 529-536, 2012. https://doi.org/10.3145/epi.2012.sep.13

[20] Melendreras-Ruiz, R. (2008). ImplanTDT: Usability laboratory, real user DTT monitoring platform and MHP-based services, 2008 5th IEEE Consumer Communications and Networking Conference, CCNC 2008, DOI: 10.1109/ccnc08.2007.62, 249-250, 2008. https://doi.org/10.1109/ccnc08.2007.62

[21] Ramí­rez-Pérez, N. V.; Laguna-Estrada, M. (2012). La lógica borrosa conjuntos borrosos , razonamiento aproximado y control borroso, Pistas Educativas, (100), 55-65, 2012.

[22] Rosenbaum, S. (2012). Emulating field research in the usability lab: Lessons learned from stage design, 2012 IEEE International Professional Communication Conference, DOI: 10.1109/IPCC.2012.6408593, 1-4, 2012. https://doi.org/10.1109/IPCC.2012.6408593

[23] Ruiz, G. A.; Peña, A.; Castro, C. A.; Alaguna, í.; Areiza, L.; Rincón, R. (2006). Modelo de Evaluación de Calidad de Software Basado en Lógica Difusa, Aplicada a Métricas de Usabilidad de Acuerdo con la Norma ISO/IEC 9126, Revista Avances en Sistemas e Informática, 3(2), 25-29, 2006.

[24] Salcedo-Benavides, E.; Gil-Aros, C. (2012). Sistema difuso para la evaluación de la calidad externa del software orientado a la web, Educación en Ingenierí­a, DOI: 10.26507/rei.v7n13.173, 7(13), 91-101, 2012.

[25] Santos, C.; Novais, T.; Ferreira, M.; Albuquerque, C.; De Farias, I. H.; Furtado, A. P. C. (2016). Metrics focused on usability ISO 9126 based, Iberian Conference on Information Systems and Technologies, CISTI, DOI: 10.1109/CISTI.2016.7521437, 1-3, 2016. https://doi.org/10.1109/CISTI.2016.7521437

[26] Santos-Peñas, M.; Miranda-Suescun, E. (2012). Aplicación de la lógica difusa en el ámbito de las energí­as renovables, Elementos, 2(1),102-114, 2012. https://doi.org/10.15765/e.v2i2.186

[27] [Online]. Available: https://www.sigmaelectronica.net//

[28] Suwawi, D. D. J.; Darwiyanto, E.; Rochmani, M. (2015). Evaluation of academic website using ISO/IEC 9126, 2015 3rd International Conference on Information and Communication Technology, DOI: 10.1109/ICoICT.2015.7231426, 222-227, 2015. https://doi.org/10.1109/ICoICT.2015.7231426

[29] Valenzuela-Hernández, J. G.; Montoya-Giraldo, O. D.; Giraldo-Buitrago, D. (2013). Lógica Difusa Aplicada al Control Local del Péndulo Invertido con Rueda de Reacción, Scientia et Technica, 18(4), 623-632, 2013.

[30] Weichbroth, P. (2020). Usability of mobile applications: A systematic literature study, IEEE Access, DOI: 10.1109/ACCESS.2020.2981892, 8, 55563-55577, 2020. https://doi.org/10.1109/ACCESS.2020.2981892

[31] Weir, C.; McKay, I.; Jack, M. (2010). Functionality and usability in design for eStatements in eBanking services, Interacting with Computers, DOI: 10.1016/j.intcom.2006.08.010, 19(2), 241- 256, 2007. https://doi.org/10.1016/j.intcom.2006.08.010

[32] Zadeh, L. (1994). Fuzzy Logic, Neural Networks, and Soft Computing, Communications of the ACM, DOI: 10.1145/175247.175255, 37(3), 77-84, 1994. https://doi.org/10.1145/175247.175255

[33] Zeman, J.; Tanuska, P.; Kebisek, M. (2009). The utilization of metrics usability to evaluate the software quality, ICCTD 2009 - 2009 International Conference on Computer Technology and Development, DOI: 10.1109/ICCTD.2009.58, 1, 243-246, 2009. https://doi.org/10.1109/ICCTD.2009.58

Additional Files

Published

2022-02-18

Issue

Vol. 17 No. 2 (2022): International Journal of Computers Communications & Control (April)

Section

Articles

License

ONLINE OPEN ACCES: Acces to full text of each article and each issue are allowed for free in respect of Attribution-NonCommercial 4.0 International (CC BY-NC 4.0.

You are free to:

-Share: copy and redistribute the material in any medium or format;

-Adapt: remix, transform, and build upon the material.

The licensor cannot revoke these freedoms as long as you follow the license terms.

 

DISCLAIMER: The author(s) of each article appearing in International Journal of Computers Communications & Control is/are solely responsible for the content thereof; the publication of an article shall not constitute or be deemed to constitute any representation by the Editors or Agora University Press that the data presented therein are original, correct or sufficient to support the conclusions reached or that the experiment design or methodology is adequate.

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.