Advanced SearchSearch Tips
Performance Comparison of Manual and Touch Interface using Video-based Behavior Analysis
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
Performance Comparison of Manual and Touch Interface using Video-based Behavior Analysis
Lee, Chai-Woo; Bahn, Sang-Woo; Kim, Ga-Won; Yun, Myung-Hwan;
  PDF(new window)
The objective of this study is to quantitatively incorporate user observation into usability evaluation of mobile interfaces using monitoring techniques in first- and third-person points of view. In this study, an experiment was conducted to monitor and record users` behavior using Ergoneers Dikablis, a gaze tracking device. The experiment was done with 2 mobile phones each with a button keypad interface and a touchscreen interface for comparative analysis. The subjects included 20 people who have similar experiences and proficiency in using mobile devices. Data from video recordings were coded with Noldus Observer XT to find usage patterns and to gather quantitative data for analysis in terms of effectiveness, efficiency and satisfaction. Results showed that the button keypad interface was generally better than the touchcreen interface. The movements of the fingers and gaze were much simpler when performing given tasks on the button keypad interface. While previous studies have mostly evaluated usability with performance measures by only looking at task results, this study can be expected to contribute by suggesting a method in which the behavioral patterns of interaction is evaluated.
User-observation;Usability;Mobile interface;Gaze-tracking;
 Cited by
Eye Tracking Metrics: A Toolbox for Assessing the Effects of Clutter on Attention Allocation, Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2012, 56, 1, 1366  crossref(new windwow)
Goldberg, J. H. and Kotval, X. P., Computer interface evaluation using eye movements: methods and constructs, International Journal of Industrial Ergonomics, 24(6), 631-645, 1999. crossref(new window)

Gonzalez, M. P., Lores, J. and Granollers, A., Enhancing usability testing through datamining techniques: A novel approach to detecting usability problem patterns for a context of use, Information and Software Technology, 50(6), 547-568, 2008. crossref(new window)

ISO 9241-11, Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs), Part 11: Guidance on Usability, International Organization for Standardization, Geneva, 1998.

Jang, H., A study on patterns in the use of hands when handling with screen-touch mobile multimedia devices, Unpublished Master's Thesis, Kookmin University, 2008.

Kjeldskov, J. and Stage, J., New techniques for usability evaluation of mobile systems, International Journal of Human-Computer Studies, 60(5-6), 599-620, 2004. crossref(new window)

Lee, Y. S., Hong, S. W., Smith-Jackson, T. L., Nussbaum, M. A. and Tomioka, K., Systematic evaluation methodology for cell phone user interfaces, Interacting with Computers, 18(2), 304-325, 2006. crossref(new window)

Nakamichi, N., Sakai, M., Shima, K., Hu, J. and Matsumoto, K., WebTracer: A new web usability evaluation environment using gazing point information, Electronic Commerce Research and Applications, 6(1), 63-73, 2007. crossref(new window)

Oh, Y. S. and Lee, K. P., A comparative study of user observation methods in actual mobile environment, Proceedings of the International Conference of the Korean Society of Design Science, 2004.

Park, Y. J. and Kim, D. H., The influence of altering mobile phone interface on the generation of mental model, Korean Journal of the Science of Emotion and Sensibility, 11(4), 575-588, 2008.

Sawahata, Y., Khosla, R., Komine, K., Hiruma, N., Itou, T., Watanabe, S., Suzuki, Y., Hara, Y. and Issiki, N., Determining comprehension and quality of TV programs using eye-gaze tracking, Pattern Recognition, 41(5), 1610-1626, 2008. crossref(new window)

Schroeder, W., Testing web sites with eye-tracking, User Interface Engineering Newsletter, 1998.