Performance Comparison of Manual and Touch Interface using Video-based Behavior Analysis Lee, Chai-Woo; Bahn, Sang-Woo; Kim, Ga-Won; Yun, Myung-Hwan;
The objective of this study is to quantitatively incorporate user observation into usability evaluation of mobile interfaces using monitoring techniques in first- and third-person points of view. In this study, an experiment was conducted to monitor and record users' behavior using Ergoneers Dikablis, a gaze tracking device. The experiment was done with 2 mobile phones each with a button keypad interface and a touchscreen interface for comparative analysis. The subjects included 20 people who have similar experiences and proficiency in using mobile devices. Data from video recordings were coded with Noldus Observer XT to find usage patterns and to gather quantitative data for analysis in terms of effectiveness, efficiency and satisfaction. Results showed that the button keypad interface was generally better than the touchcreen interface. The movements of the fingers and gaze were much simpler when performing given tasks on the button keypad interface. While previous studies have mostly evaluated usability with performance measures by only looking at task results, this study can be expected to contribute by suggesting a method in which the behavioral patterns of interaction is evaluated.
Goldberg, J. H. and Kotval, X. P., Computer interface evaluation using eye movements: methods and constructs, International Journal of Industrial Ergonomics, 24(6), 631-645, 1999.
Gonzalez, M. P., Lores, J. and Granollers, A., Enhancing usability testing through datamining techniques: A novel approach to detecting usability problem patterns for a context of use, Information and Software Technology, 50(6), 547-568, 2008.
ISO 9241-11, Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs), Part 11: Guidance on Usability, International Organization for Standardization, Geneva, 1998.
Jang, H., A study on patterns in the use of hands when handling with screen-touch mobile multimedia devices, Unpublished Master's Thesis, Kookmin University, 2008.
Kjeldskov, J. and Stage, J., New techniques for usability evaluation of mobile systems, International Journal of Human-Computer Studies, 60(5-6), 599-620, 2004.
Lee, Y. S., Hong, S. W., Smith-Jackson, T. L., Nussbaum, M. A. and Tomioka, K., Systematic evaluation methodology for cell phone user interfaces, Interacting with Computers, 18(2), 304-325, 2006.
Nakamichi, N., Sakai, M., Shima, K., Hu, J. and Matsumoto, K., WebTracer: A new web usability evaluation environment using gazing point information, Electronic Commerce Research and Applications, 6(1), 63-73, 2007.
Oh, Y. S. and Lee, K. P., A comparative study of user observation methods in actual mobile environment, Proceedings of the International Conference of the Korean Society of Design Science, 2004.
Park, Y. J. and Kim, D. H., The influence of altering mobile phone interface on the generation of mental model, Korean Journal of the Science of Emotion and Sensibility, 11(4), 575-588, 2008.
Sawahata, Y., Khosla, R., Komine, K., Hiruma, N., Itou, T., Watanabe, S., Suzuki, Y., Hara, Y. and Issiki, N., Determining comprehension and quality of TV programs using eye-gaze tracking, Pattern Recognition, 41(5), 1610-1626, 2008.
Schroeder, W., Testing web sites with eye-tracking, User Interface Engineering Newsletter, 1998.