An inquiry-based method for Choquet integral-based aggregation of interface usability parameters

Miguel-Ángel Sicilia; Elena García Barriocanal; Tomasa Calvo

Kybernetika (2003)

  • Volume: 39, Issue: 5, page [601]-614
  • ISSN: 0023-5954

Abstract

top
The concept of usability of man-machine interfaces is usually judged in terms of a number of aspects or attributes that are known to be subject to some rough correlations, and that are in many cases given different importance, depending on the context of use of the application. In consequence, the automation of judgment processes regarding the overall usability of concrete interfaces requires the design of aggregation operators that are capable of modeling approximate or ill-defined interactions among criteria. In addition, justified expert opinions are given a prominent status in the current practice of usability evaluation, which points to the convenience of including experts as an integral part of the aggregation operator design process. On the basis of these assumptions we review in this paper possible approaches to design a suitable aggregation operation and describe a method for such kind of design process that explicitly models expert-elicited relationships among criteria, enforcing some properties on a Choquet capacity. The method subsequently uses experimental data to fine-tune operator design. A case study is described to illustrate the method, and a comparative study with other common aggregation approaches is also provided.

How to cite

top

Sicilia, Miguel-Ángel, Barriocanal, Elena García, and Calvo, Tomasa. "An inquiry-based method for Choquet integral-based aggregation of interface usability parameters." Kybernetika 39.5 (2003): [601]-614. <http://eudml.org/doc/33668>.

@article{Sicilia2003,
abstract = {The concept of usability of man-machine interfaces is usually judged in terms of a number of aspects or attributes that are known to be subject to some rough correlations, and that are in many cases given different importance, depending on the context of use of the application. In consequence, the automation of judgment processes regarding the overall usability of concrete interfaces requires the design of aggregation operators that are capable of modeling approximate or ill-defined interactions among criteria. In addition, justified expert opinions are given a prominent status in the current practice of usability evaluation, which points to the convenience of including experts as an integral part of the aggregation operator design process. On the basis of these assumptions we review in this paper possible approaches to design a suitable aggregation operation and describe a method for such kind of design process that explicitly models expert-elicited relationships among criteria, enforcing some properties on a Choquet capacity. The method subsequently uses experimental data to fine-tune operator design. A case study is described to illustrate the method, and a comparative study with other common aggregation approaches is also provided.},
author = {Sicilia, Miguel-Ángel, Barriocanal, Elena García, Calvo, Tomasa},
journal = {Kybernetika},
keywords = {usability; Choquet integral; inquiry methods; usability; Choquet integral; inquiry methods},
language = {eng},
number = {5},
pages = {[601]-614},
publisher = {Institute of Information Theory and Automation AS CR},
title = {An inquiry-based method for Choquet integral-based aggregation of interface usability parameters},
url = {http://eudml.org/doc/33668},
volume = {39},
year = {2003},
}

TY - JOUR
AU - Sicilia, Miguel-Ángel
AU - Barriocanal, Elena García
AU - Calvo, Tomasa
TI - An inquiry-based method for Choquet integral-based aggregation of interface usability parameters
JO - Kybernetika
PY - 2003
PB - Institute of Information Theory and Automation AS CR
VL - 39
IS - 5
SP - [601]
EP - 614
AB - The concept of usability of man-machine interfaces is usually judged in terms of a number of aspects or attributes that are known to be subject to some rough correlations, and that are in many cases given different importance, depending on the context of use of the application. In consequence, the automation of judgment processes regarding the overall usability of concrete interfaces requires the design of aggregation operators that are capable of modeling approximate or ill-defined interactions among criteria. In addition, justified expert opinions are given a prominent status in the current practice of usability evaluation, which points to the convenience of including experts as an integral part of the aggregation operator design process. On the basis of these assumptions we review in this paper possible approaches to design a suitable aggregation operation and describe a method for such kind of design process that explicitly models expert-elicited relationships among criteria, enforcing some properties on a Choquet capacity. The method subsequently uses experimental data to fine-tune operator design. A case study is described to illustrate the method, and a comparative study with other common aggregation approaches is also provided.
LA - eng
KW - usability; Choquet integral; inquiry methods; usability; Choquet integral; inquiry methods
UR - http://eudml.org/doc/33668
ER -

References

top
  1. Beliakov G., 10.1002/int.10120, J. Intelligent Systems 18 (2003), 903–923 DOI10.1002/int.10120
  2. Beliakov G., Mesiar, R., Valášková, L ’., Fitting generated aggregation operators to empirical data, Internat. J. Uncertainty, Fuzziness and Knowledge-based Systems (2003) (to appear) Zbl1073.28012MR2075312
  3. Brajnik J., Towards valid quality models for websites, In: Proc. 7th Human Factors and the Web Conference, 2001 
  4. Calvo T., Kolesárová A., Komorníková, M., Mesiar R., Aggregation operators: Basic concepts, issues and properties, In: Aggregation Operators: New Trends and Applications (T. Calvo, G. Mayor, and R. Mesiar, eds.), Studies in Fuzziness and Soft Computing 97 (2002), 3–106 MR1936383
  5. Dix A., Abowd G., Beale, R., Finlay J., Human-Computer Interaction, Prentice Hall, Englewood Cliffs, N.J. 1998 Zbl0812.68026
  6. Frøkjær E., Hertzum, M., Hornbæk K., Measuring usability: are effectiveness, efficiency and satisfaction really correlated? In: Proc, Human Factors in Computing Systems, 2000, pp. 345–352 
  7. Grabisch M., A new algorithm for identifying fuzzy measures and its application to pattern recognition, In: IEEE Fuzzy Systems Internat. Joint Conference 1995, pp. 145–150 (1995) 
  8. Grabisch M., 10.1016/0377-2217(95)00176-X, European J. Oper. Res. 89 (1996), 445–456 (1996) Zbl0916.90164DOI10.1016/0377-2217(95)00176-X
  9. Grabisch M., The interaction and Mobius representations of fuzzy measures on finite spaces, k -additive measures: a survey, In: Fuzzy Measures and Integrals. Theory and Applications (M. Grabisch, T. Murofushi, and M. Sugeno, eds.), Physica–Verlag, Heidelberg 2000, pp. 70–93 MR1767746
  10. Bevan N.//ISO 9241: Ergonomic requirements for office work with visual display terminals (VDTs) – Part 11: Guidance on usability, TC 159, SC 4 Technical Committee of International Organization for Standardization 1998 
  11. Ivory M. Y., Hearst M. A., 10.1145/503112.503114, ACM Computing Surveys 33 (2001), 4, 1–47 DOI10.1145/503112.503114
  12. Izyumov B., Kalinina, E., Wagenknecht M., Software tools for regression analysis of fuzzy data, In: Proc. 9th Zittau Fuzzy Colloquium 2001, pp. 221–229 
  13. Kalinina E., Wagenknecht M., Fuzzy regression analysis and application to a crisp model, In: Proc. 8th Zittau Fuzzy Colloquium 2000 
  14. Kirakowski J., Cierlik B., Measuring the usability of web sites, In: Human Factors and Ergonomics Society Annual Conference 1998 
  15. Klayman J., Ha Y.-W., 10.1037/0033-295X.94.2.211, Psychological Review 94 (1987), 2, 211–228 (1987) DOI10.1037/0033-295X.94.2.211
  16. Linstone H., (eds.) M. Turoff, The Delphi Method: Techniques and Applications, Addison Wesley, Reading 1975 Zbl0347.62081
  17. Marichal J. L., 10.1109/91.890347, IEEE Trans. Fuzzy Systems 8 (2000), 6, 800–807 DOI10.1109/91.890347
  18. Nielsen J., Heuristic evaluation, In: Usability Inspection Methods (J. Nielsen and R. L. Mack, eds.), Wiley, New York 1994, pp. 25–61 (1994) 
  19. Nielsen J., Guerrila HCI: using discount usability engineering to penetrate the intimidation barrier, In: Cost-Justifying Usability (R. G. Bias and D. J. Mayhew, eds.), Academic Press, New York 1994, pp. 245–272 (1994) 
  20. Olsina L., Rossi G., 10.1109/MMUL.2002.1041945, IEEE Multimedia Magazine 9 (2002), 4, 20–29 DOI10.1109/MMUL.2002.1041945
  21. Sicilia M. A., García E., Modelling interacting Web usability criteria through fuzzy measures, In: Proc. 3rd Internat. Conference on Web Engineering (Lecture Notes in Computer Science 2722), Springer–Verlag, Berlin 2003, pp. 182–185 Zbl1029.68901
  22. Sicilia M. A., García, E., Calvo T., On the use of the Choquet integral for the aggregation of usability interface related scores, In: Proc. Summer School on Aggregation Operators (AGOP 2003), University of Alcala de Henares (Spain), 2003, pp. 159–164 
  23. Sicilia M. A., García, E., Alcalde R., Fuzzy specializations and aggregation operator design in competence-based human resource selection, In: Proc. 8th World Federation on Soft Computing Conference 2003 (to appear) 
  24. Welie M. Van, Veer G. C. van der, Eliëns A., Breaking down usability, Proc. Interact’99 (1999), pp. 613–620 (1999) 

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

                
Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.