• The Journal of Society for e-Business Studies
• /
• v.6 no.2
• /
• pp.73-85
• /
• 2001

Usability is defined by the effectiveness, efficiency and satisfaction with which specified users can achieve specified goal in particular environment. Today, many factors such as software acquisition, business re-engineering and the trend of software market have software industry considers usability as an important quality of software products. Therefore, the specification and measurement method for establishing the acceptable usability level of software is required during software development acquisition and evaluation. To evaluate whether software products is usable or not, we need evaluation method for software usability. This paper is not only to provide a framework for specifying the usability attributes of a product and establishing a comprehensive set of usability criteria, but also assessing usability metrics of the software. The usability metrics and checklist is developed based on the properties of the user interface using ISO standard and general usability principles with product-oriented view which means the Product has attributes contributing to determine the usability. This paper also suggested the way to weight the relative importance of the individual usability item depending on the software categories.

• Journal of Korea Multimedia Society
• /
• v.20 no.8
• /
• pp.1338-1346
• /
• 2017

To achieve software quality and human-centred design for electronic ship navigation called e-navigation, an international guideline of software quality assurance and human-centred design was approved in 2015. Usability is a common goal of both software quality assurance and human-centred design as developing e-navigation system and software developments. Therefore, research is needed to evaluate the usability of e-navigation systems and software such as metrics that can use usability testing. This paper derives effectiveness metrics for e-Navigation usability testing based on international standards. The research method is to analyses and compares the effectiveness measurement and metrics in ISO 9241-11 for human-centered design and ISO/IEC 25022 and 25023 for software quality to find out measurements and metrics being defined commonly. The derived metrics are applied to Electronic Chart Display and Information System as a case study based on performance standard.

• Journal of the Ergonomics Society of Korea
• /
• v.36 no.4
• /
• pp.343-353
• /
• 2017

Objective: This study aims to evaluate the efficiency of two representative subway map design types, namely a diagram type and a geographical type using physiological metrics, performance metrics, and self-reported metrics, which are representative usability metrics. Background: Subway maps need to be designed in order for users to quickly search and recognize subway line information. Although most cities' subway maps currently use the diagram type designed by Henry Beck, New York City's subway map has recently been changed to the subway map type combined with the geographical type designed by Michael Hertz. However, not many studies on its efficiency are found, and the studies that are available mainly depend on questionnaire surveys or take on a subjective behavioral study type based on experts' experiences. In this regard, evaluation through a more objective method is needed. Method: This study employed usability metrics as a method to evaluate the efficiency of information search targeting the diagram type and geographical type subway maps used mostly as subway maps. To this end, physiological metrics obtained through eye tracking, task completion time, representative metric of task performance, and subjective evaluation metrics were used for the suitability evaluation of subway map designs. Results: In the result of gaze movement distance analysis, no significant difference was shown in the two design types in terms of a process finding a departure station from the starting point and a process finding a transfer station between the departure station and arrival station (destination). However, the gaze movement distance in the process finding the arrival station at the departure station was significantly shorter in the geographical type, rather than in the diagram type. The analysis of task completion time showed a result similar to the gaze movement distance analysis result. Task completion time was significantly shorter in the geographical type, rather than in the diagram type, which is in the process finding the arrival station at the departure station. In other information search processes, no significant difference was shown. As a result of subjective evaluation metrics analysis, no significant difference was revealed in the two design types. Conclusion: An analysis on the two representative subway map design types was carried out via the adoption of usability metrics. As a result, although no significant difference was shown in some information search processes, it was revealed that information search was easier in the geographical type overall. Also, it was found that usability metrics can be effectively used to evaluate the design types of subway maps. Application: The study results can be used to set design direction to offer ease in information search on subway lines. The study also can be used as a method to evaluate a subway map's design type.

• Science of Emotion and Sensibility
• /
• v.14 no.1
• /
• pp.83-92
• /
• 2011

Because of the development of digital technologies and information-oriented products, the importance of user interface design and usability are increasing in recent year. So we need a systematic and rational way to measure and manage how effective the improvement of user interface is. The purpose of this study is to develop measurable ‘Usability Improvement Index' which signify how much usability has improved in user interface design. First, I made the framework of measuring and evaluating usability through analysis of existing usability metrics and previous studies. Then, I suggested the process of calculating 'Usability Improvement Index' based on categorizing characteristics of measurable usability and definition of usability metrics. The process is as in the following : measuring the present level of usability, analysis of problems, making alternative user interface design, measuring the improved level of usability, calculating Usability Improvement Index. For verification, the case study on application of Usability Improvement Index to usability improvement of application software of digital camcorder presented. This study is expected to assist 'goal oriented user interface design' and to manage usability systematically.

• Journal of the Korea Society of Computer and Information
• /
• v.11 no.5 s.43
• /
• pp.139-148
• /
• 2006

This study is intended to propose quality criteria and Web metrics for usability quality evaluation of multimedia Web sites. Recently, applications of the Web sites are not limited to the area of industry and operating as it integrates the new technology. Also as information super highway becomes common with development or network technology, multimedia Web site is on the rise due to various use of multimedia attributes. Therefore this study expands to apply HTML based Web site quality evaluation studied in Software engineering, HCI, Hypermedia to multimedia Web site, and suggests new metrics by integrating flash usability which is expanding its portion in multimedia Web site lately. The Web metrics proposed in this study are verified by heuristic evaluation from a group of expert. It analyses the results of quantitative and qualitative qualify evaluation on Web Award Korea by comparing the award-winning, high-quality Web site with non-winning Web sites. This study can be used to establish guideline for high-quality multimedia Web site development in the future.

• Journal of Internet Computing and Services
• /
• v.3 no.2
• /
• pp.109-119
• /
• 2002

Usability is defined by the effectiveness efficiency and satisfaction with which specified users can achieve a specified goal in the particular environment. This paper is not only to provide a framework for specifying the usability attributes of a product and establishing a comprehensive set of usability criteria, but also to asses usability metrics of the software. The Evaluation Tool for Software Usability are developed based on the properties of the a user interface using ISO standard and general usability principles with product-oriented view. It means that product has attributes contributing to determine the usability. This paper also suggests the way to weight the relative importance of the individual usability item depending on the software categories.

• Journal of Information Technology Services
• /
• v.7 no.4
• /
• pp.151-165
• /
• 2008

This study suggests the organization-level standard(model and process) for quality evaluation of information systems(IS) in non-use organizations despite international standards(ISO/IEC 9126 and ISO/IEC 14598) and national standards(KS X 9126 and KS X 14598) related to quality evaluation of IS. The standard in this study is composed of quality evaluation processes, a quality model, and quality metrics. The weights of the attributes and the sub-attributes in the quality model were calculated by an analytic hierarchy process(AHP). The minimum level and the target level of each metrics were determined by brainstorming of the committee. Furthermore, the case study for the investigation of the applicability and the usability of the suggested organizational standard in the real IS development project was performed. For gaining significant benefits of the standard, both the diffusion and the experience accumulation by its continuous use are needed.

• Proceedings of the Korean Information Science Society Conference
• /
• 2001.10a
• /
• pp.535-537
• /
• 2001

최근 소프트웨어 산업에 있어서 사용자 인터페이스는 가장 중요한 품질 요소의 하나가 되었다. 개발된 소프트웨어는 평균 48% 가량의 코드가 사용자 인터페이스(user interface)를 위한 것이다. 또한 소프트웨어의 품질향상에 대한 중요성이 증대되고 있으며 소프트웨어의 품질 관련 국제 규격들에 대한 표준화가 많은 진전을 보이고 있다. 본 논문은 소프트웨어 품질 평가를 목적으로 사용성에 대한 평가모델을 개발하여 소프트웨어 설계 개선요인을 발견.하고 제품의 품질을 개발자 및 사용자 측면에서 향상시킬 수 있게 하는 것이 목적이다.

• Journal of KIISE:Software and Applications
• /
• v.35 no.8
• /
• pp.512-521
• /
• 2008

Web-based information services should be evaluated for accessibility and usability with various types of Internet Web-browsing devices, interacting with web information servers. A reliable ubiquitous Web information server, accessible and usable with a variety of Web-browsing devices (e.g. a full-browsing mobile phone), should be a unified center for personalized ubiquitous Web information services as well as for business models based on personalized advertisements. We studied an estimation of the accessibility and usability in Web interaction for personalized ubiquitous Web information services, as metrics for real-time estimation. We show empirical results based on implementation and experiments in Korea, Japan and China, using a test-bed Web site ('ktrip.net') and single-character Korean domain names (e.g. 김.net, 이.net, 박.net, 최.net, ㄱ.net, ㄴ.net ... ㅎ.net, ㅏ.net, ... ㅔ.net, ㄱ.com, ㄴ.com ... ㅎ.com).

• The Transactions of the Korea Information Processing Society
• /
• v.5 no.1
• /
• pp.49-62
• /
• 1998

Softwares which have many functions to satisfy user's requirements is developing. But generally, users use partial functions of software. If we could construct software which leave useful functions and remove unuseful functions in software with many functions, we could enhance execution efficiency by reduction of program size and quality of software. There are 6 items in international standard ISO/IEC 9126 about quality of software. These are functionality, reliability, usability, efficiency, maintenance and portability. In this study, we proposed metrics for measurement of efficiency and simplification method for source code. And we described products evaluation result and indicated problem and progress method for practical development project about proposed efficiency metrics.