Advanced SearchSearch Tips
A Usability Assessment Metric for Ubiquitous Services: Quantification of the Interactivity Attribute in Inter-personal Services
facebook(new window)  Pirnt(new window) E-mail(new window) Excel Download
 Title & Authors
A Usability Assessment Metric for Ubiquitous Services: Quantification of the Interactivity Attribute in Inter-personal Services
Lee, Joo-Hwan; Song, Joo-Bong; Yun, Myung-Hwan;
  PDF(new window)
Objective: The main objective of this study is to propose a user-centered assessment metric for ubiquitous services. Background: As the ubiquitous era took off, the interactions between ubiquitous services and users have come to take an important position. It is essential to conceptualize a new assessment model that considers human-system interaction capability with a user-centered design perspective. Method: The evaluation model for the interactivity of ubiquitous service was approached from the concept of usability and inter-personality of services. As a validation study, suggested assessment metric was utilized to evaluate the u-Home service. Priority weighting of each assessment metric was derived using the quantification type-I analysis. Results: To evaluate interactivity, this study suggested a quantitative metric for user testing performed after classifying the interactivity characteristics to contextualization; ubiquity; user experience; and service capability. Conclusion: This study suggest the metric for the ubiquitous service that are experienced in real life, and introduced the concept of ubiquitous service interactivity. Application: The suggested evaluation metric can be used to evaluate interactivity level of ubiquitous service and identify the potential problem and usability requirements at the early stage of service development.
Ubiquitous service;Interactivity;User-Centered design;Usability evaluation method;
 Cited by
Abowd, G. D., Software design issues for ubiquitous computing, Proceedings of VLSI(Very Large Scale Integration) System Level Design, IEEE Computer Society Workshop 1998, USA. 1998.

Arnstein, L., Kang, J. H. and Borriello, G., Evaluation Scope for Ubiquitous Computing, Intel Research Lab., Seattle. USA. 2006.

Barkhuus, L. and Dey, A., Is context-aware computing taking control away from the user three levels of interactivity examined, Proceeding of the 5th International Conference on Ubiquitous Computing, (pp.149 -156), 2003.

Barki, H. and Hartwick, J., Measuring User Participation, User Involvement, and User Attitude, MIS Quarterly, 18(1), 59-82, 1994. crossref(new window)

Barton, J. J. and Kindberg, T., The cooltown user experience, Proceedings of CHI200, Seattle. USA. 2001.

Bartram, L. and Czerwinski, M., Design and evaluation of notification interfaces for ubiquitous computing, UbiComp02 Workshop 9, 2002.

BenMoussa, C., Supporting Salespersons through Location Based Mobile Applications and Services, Proceedings of 4th International Conference on E-Commerce, E-Business, E-Government(I3E), (pp.149-167), 2004.

Blaine, A. P., Karim, A. and Bashar, N., Keeping ubiquitous computing to yourself: A practical model for user control of privacy, International Journal of Human-Computer Studies, 63, 228-253, 2005. crossref(new window)

Burnett, M., and Rainsford, C. P., A hybrid evaluation approach for ubiquitous computing environments, Workshop on Evaluation Methodologies for Ubiquitous Computing 2001, Atlanta. USA. 2001.

Burrell, J., Gay, G. K., Kubo, K. and Farina, N., Context-Aware Computing: A Test Case, Proceedings 4th International Conference Ubiquitous Computing, (pp.1-15), 2002.

Christensen, G. L. and Olson, J. C., Mapping consumers' mental models with ZMET, Psychology & Marketing, 19(6), 477-502, 2002. crossref(new window)

Chun, H. M. and Pyun, J. S., The Impact of Ubiquitous factors on Buyers' Purchase Intentions, Proceedings of the Korea Society of Management Information Systems(KMIS) 2004, (pp.605-612), 2004.

Chung, D. B., A study on the evaluation framework development for business model commercialization strategy in ubiquitous environment, M.S. Thesis, Yonsei University, Korea. 2005.

Constantine, L. L. and Lockwood, L. A. D., Software for Use: A Practical Guide to the Models and Methods of Usage-Centered Design, Addison-Wesley, NY, USA. 1999.

Cronin, J. J. and Taylor, S. A., Measuring service quality: A reexamination and extension, Journal of Marketing, 56(3), 55-68, 1992.

CUCN(National Center of Excellence for Ubiquitous Computing and Networking), Ubiquitous Computing System technology, Center for Advanced RFID/USN Technology(CARUT) workshop, Korea. 2005.

Edwards, W. K., Bellotti, V., Dey, A. K. and Newman, M. W., The challenges of user-centered design and evaluation for infrastructure, Proceedings of the SIGCHI conference on Human factors in computing systems, 2003.

Fleisch, E. and Tellkamp, C., The challenge of identifying value creating ubiquitous computing applications, Workshop on Ubiquitous Commerce, UbiComp03, 2003.

Greenfield, A., Everyware: The dawning age of ubiquitous computing, New Riders, Berkeley, CA, USA. 2006.

Ham, J. J., A study on deriving killer application and developing evaluation model of ubiquitous computing, M.S. Thesis, Yonsei University, Korea. 2006.

Heckmann, D., Ubiquitous User Modeling, Ph.D Dissertation, Universität des Saarlandes, Deuch. 2005.

Heeter, C., Implications of new interactive technologies for conceptualizing communication, in Salvaggio, J. L. and Bryant, J. (eds.), Media use in the information age: Emerging patterns of adoption and consumer use, Lawrence Erlbaum Associates: 217-235, NJ, USA. 1989.

Iqbal, R., Sturm, J., Kulyk, O., Wang, J. and Terken, J., User-Centered Design and Evaluation of Ubiquitous Services, 23rd Annual International Conference on Design of Communication(SIGDOC 2005), (pp.138 -145), 2005.

ISO 20282, Ease of operation of everyday products, International Standards Organization, Geneva, Switzerland. 2006.

ISO/IEC 25000, Software Engineering - Software Product Quality Requirements and Evaluation(SQuaRE) - Guide to SQuaRE, International Standards Organization, Geneva, Switzerland. 2005.

Jo, W. D., Lee, K. J., Lee, H. K., Kwon, O. B., Kim, K. G. and Lee, E. J., Ubiquitous Paradigm and u-Society, Jinhan M&B Inc., Korea. 2006.

Jokela, T., Koivumaa, J., Pirkola, J., Salminen, P. and Kantola, N., Methods for quantitative usability requirements: a case study on the development of the user interface of a mobile phone, Personal and Ubiquitous Computing, 10, 345-355, 2006. crossref(new window)

Junglas, I. A. and Watson, R. T., u-Commerce: An experimental investigation of ubiquity and uniqueness, Proceedings of 24th International Conference on Information Systems(ICIS), (pp.414-426), 2003.

Kim, C. R., MDS & Conjoint analysis using SAS, Freedom Academy, Korea. 2003.

Kristen, K. G., Michael, D. B. and Sarah, P. E., A comparison of Usability between Voting Methods, Proceedings of USENIX/Accurate EVT (Electronic Voting Technology) workshop, Vancouver. Canada. 2006.

Kwon, O. B. and Kim, J. H., Ubi-SERVQUAL: An Amended SERVQUAL Model for Assessing the Quality of Ubiquitous Computing Services, Conference of the Korea Society of Management Information Systems, Seoul. Korea. 2005.

Kwon, O., Yoo, K. and Suh, E., ubiES: Applying ubiquitous computing technologies to an expert system for context-aware proactive services, Electronic Commerce Research and Applications, 5, 209-219, 2006. crossref(new window)

Lattin, J., Carroll, J. D. and Green, P. E., Analyzing Multivariate Data, Brooks/Cole-Thomson Learning Inc., Canada. 2003.

Lee, S. H., The effects of ubiquitous attributes of mobile contents on perceived interactivity and behavioral outcome, Ph.D. Dissertation, Seoul National University, Korea. 2006.

Lee, W. J., The effects of Ubiquitous interactivity characteristic of new product on adoption and diffusion, Ph.D. Dissertation, Seoul National University, Korea. 2005.

Leonard, M., Jessup, and Robey, D., The relevance of social issues in ubiquitous computing environments, Communications of the ACM, 45(12), 2002.

Lin, H. X., Choong, Y. and Salvendy, G., A proposed index of usability: A method for comparing the relative usability of different software systems, Behavior and Information Technology, 16, 267-277, 1997. crossref(new window)

Lindenberg, J., Pasman, W., Kranenborg, K., Stegeman, J. and Neerincx, M. A., Improving service matching and selection in ubiquitous computing environments: a user study, Personal and Ubiquitous Computing, 11, 59-68, 2007. crossref(new window)

Loiacono, E. T., Watson, R. T. and Goodhue, D. L., WebQual: A website quality instrument, Working paper 2000-126-0, University of Georgia, 2000.

Lombard, M. and Snyder-Dutch, J., Interactive Advertising and Presence: A Framework, Journal of Interactive Advertising, 1(2), 2001.

Lyytinen, K. and Yoo, Y. Issues and challenges in Ubiquitous Computing, Communications of the ACM, 45(12), 63-65, 2002.

Markett, C., Arnedillo, I., Weber, S. and Tangney, B., Using short message service to encourage interactivity in the classroom, Computers & Education, 46(3), 280-293, 2006. crossref(new window)

McMillan, S. J., Four models of cyber-interactivity: Individual perceptions of interactivity in computer-mediated environments, International Communication Association Annual Conference, SF. CA. 1999.

Morikawa, H. and Aoyama, T., Realizing the ubiquitous network: the internet and beyond, Telecommunication Systems, 25, 449-468, 2004. crossref(new window)

Newman, W. M. and Lamming, M. G., Interactive System Design, Addison- Wesley. Wokingham. 1995.

Norman, D. A., Invisible Computing; Why Good Products Can Fail, the Personal Computer Is So Complex and Information Appliances Are the Solution, MIT Press, 1999.

Parasuraman, A. and Zeithaml, V. A., Alternative scales for measuring service quality: A comparative assessment based on psychometric, Journal of Retailing, 70(3), 201-230, 1994. crossref(new window)

Peter, T., Christopher, S. C., Tian, X. and Myra, D., Evaluation of Visual Notification Cues for Ubiquitous Computing, UbiComp03, Lecture Notes in Computer Science(LNCS), 2864, 349-366, 2003.

Rafaeli, S., Interactivity: From new media to communication, in R. P. Hawkins, J. M. Wieman and S. Pingree(eds.), Advancing Communication Science: Merging Mass and Interpersonal Processes, Newbury Park. CA. 110-134, 1998.

Resnick, P., Beyond Bowling Together; SocioTechnical Capital, in John M. Carroll(eds.), Human-Computer Interaction in the New Millennium, Addison-Wesley, ACM Press, NY. 2001.

Riekki, J., Isomursu, P. and Isomursu, M., Evaluating the calmness of ubiquitous applications, Proceedings of Production focused Software Process Improvement, 5th International Conference, PROFES 2004, Kansei Science City, Japan. 2004.

Ryu, H., Hong, G. Y. and James, H., Quality assessment technique for ubiquitous software and middleware, Res. Lett. Inf. Math. Sci.(Research Letters Information Mathematics Science), 9, 13-87, 2006.

Scholtz, J., Metrics for Evaluating Human Information Interaction Systems, Interacting With Computers, 18, 507-527, 2006. crossref(new window)

Scholtz, J. and Consolvo, S., Toward a framework for evaluating ubiquitous computing applications, Pervasive Computing, 3(2), 82-89, 2004.

Seffah, A., Donyaee, M., Kline, R. B. and Padda, H. K., Usability measurement and metrics: A consolidated model, Software Quality Journal, 14, 159-178, 2006. crossref(new window)

Steitz, N. A., Tandler, P., Muller-Tomfelde, C. and Konomi, S., Roomware: Toward the Next Generation of Human-Computer Interaction Based on an Integrated Design of Real and Virtual Worlds, in John M. Carroll(eds.), Human-Computer Interaction in the New Millennium, Addison-Wesley, ACM Press, NY. 2001.

Sweeney, M., Maguire, M. and Shackel, B., Evaluating user-computer interaction: a framework, International Journal of Man-Machine Studies, 38, 689-711, 1993. crossref(new window)

UbiComp01, Evaluation methodologies for ubiquitous computing, Workshop on Evaluation Methodologies for Ubiquitous Computing, 2001.

UbiComp02, User-Centered Evaluation of Ubiquitous Computing Application, Workshop on User-Centered Evaluation of Ubiquitous Computing Application, 2002.

Williams, J. R., Developing Performance Support for Computer Systems: a Strategy for Maximizing Usability and Learnability, CRC Press, 2004.