• Title/Summary/Keyword: evaluation metric

Search Result 295, Processing Time 0.024 seconds

An User-Centered Design(UCD) Approach for Ubiquitous Service Evaluation: an Evaluation Metric focus on Human-System Interaction Capability (사용자 중심의 유비쿼터스 서비스 설계 지원을 위한 상호작용성 평가 metric 개발)

  • Lee, Joo-Hwan;Bahn, Sang-Woo;Yun, Myung-Hwan
    • 한국HCI학회:학술대회논문집
    • /
    • 2008.02a
    • /
    • pp.292-297
    • /
    • 2008
  • 유비쿼터스 컴퓨팅 서비스 환경은 사용자와 시스템간의 상호작용성이 매우 중요하며, 이러한 상호작용성을 사용자 중심의 시각에서 평가하기 위한 새로운 평가 기법의 개발이 필요하다. 본 연구는 유비쿼터스 서비스의 특성이 반영된 사용자 중심의 상호작용성 평가 metric 개발을 목표로 한다. 이를 위하여 첫째, 기존의 유비쿼터스 서비스 평가방법론을 검토하여, 유비쿼터스 서비스 평가를 위한 평가 속성을 정의하였으며, 둘째, 대인 서비스 평가기법, 사용성 평가기법, 정신측정학 기반의 평가기법 등의 기존의 서비스 평가방법론의 한계를 극복할 수 있는 사용자중심의 상호작용성 평가 metric 을 개발하였다. 그리고 본 연구에서 제안된 평가 metric 을 u-home 서비스의 평가에 실제로 적용하여 그 유효성을 검증하고 각 지표별 중요도를 구해보았다. 본 연구에서 제안한 상호작용성 평가 metric 은 유비쿼터스 서비스 상호작용성 수준을 평가함으로써 잠재 서비스 사용자들을 분석하고, 제안된 프레임워크의 서비스 개발단계에서의 잠재 서비스 사용자에 대한 요구사항 수렴 및 수준 파악에 유용하게 활용될 수 있다.

  • PDF

A Usability Assessment Metric for Ubiquitous Services: Quantification of the Interactivity Attribute in Inter-personal Services

  • Lee, Joo-Hwan;Song, Joo-Bong;Yun, Myung-Hwan
    • Journal of the Ergonomics Society of Korea
    • /
    • v.31 no.1
    • /
    • pp.63-76
    • /
    • 2012
  • Objective: The main objective of this study is to propose a user-centered assessment metric for ubiquitous services. Background: As the ubiquitous era took off, the interactions between ubiquitous services and users have come to take an important position. It is essential to conceptualize a new assessment model that considers human-system interaction capability with a user-centered design perspective. Method: The evaluation model for the interactivity of ubiquitous service was approached from the concept of usability and inter-personality of services. As a validation study, suggested assessment metric was utilized to evaluate the u-Home service. Priority weighting of each assessment metric was derived using the quantification type-I analysis. Results: To evaluate interactivity, this study suggested a quantitative metric for user testing performed after classifying the interactivity characteristics to contextualization; ubiquity; user experience; and service capability. Conclusion: This study suggest the metric for the ubiquitous service that are experienced in real life, and introduced the concept of ubiquitous service interactivity. Application: The suggested evaluation metric can be used to evaluate interactivity level of ubiquitous service and identify the potential problem and usability requirements at the early stage of service development.

A Novel Journal Evaluation Metric that Adjusts the Impact Factors across Different Subject Categories

  • Pyo, Sujin;Lee, Woojin;Lee, Jaewook
    • Industrial Engineering and Management Systems
    • /
    • v.15 no.1
    • /
    • pp.99-109
    • /
    • 2016
  • During the last two decades, impact factor has been widely used as a journal evaluation metric that differentiates the influence of a specific journal compared with other journals. However, impact factor does not provide a reliable metric between journals in different subject categories. For example, higher impact factors are given to biology and general sciences than those assigned to other traditional engineering and social sciences. This study initially analyzes the trend of the time series of the impact factors of the journals listed in Journal Citation Reports during the last decade. This study then proposes new journal evaluation metrics that adjust the impact factors across different subject categories. The proposed metrics possibly provides a consistent measure to mitigate the differences in impact factors among subject categories. On the basis of experimental results, we recommend the most reliable and appropriate metric to evaluate journals that are less dependent on the characteristics of subject categories.

A Study on the Evaluation Unit of a Military Aircraft Noise (군용항공기 소음평가 단위에 관한 연구)

  • Lee, Jun-Ho
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.15 no.5 s.98
    • /
    • pp.550-557
    • /
    • 2005
  • Korean 'Law of Aviation' and 'Test Method of Measuring Noise and Vibration' designate to use WECPNL metric based on $L_{max}$ measurement for the accessment of aircraft noise in Korea. However, time duration of noise event can not be considered in $L_{max}$ metric in principle, compensation on the duration has been utilized. A study was done recently to evaluate appropriate duration compensation for the accessment of military aircraft noise under current metric of WECPNL and $L_{max}$. This study was carried out to evaluate what metric is the most appropriate to express aircraft noise including time duration of single noise event, computing and comparing noise exposure with 1 second noise measurement data of military aircraft in $L_{max}$, $L_{Aeq,\;T}$ and SEL. This study shows SEL is the most appropriate noise metric for the evaluation of noise exposure with time duration such as aircraft noise without compensation. It is suggested to use SEL noise metric instead of $L_{max}$ noise metric with duration compensation for the aircraft noise accessment either military aircraft or civilian aircraft.

A Study on the Evaluation Metric of a Civil Aircraft Noise (민간항공기 소음평가 단위에 관한 연구)

  • Lee, Jun-Ho
    • Transactions of the Korean Society for Noise and Vibration Engineering
    • /
    • v.16 no.5 s.110
    • /
    • pp.503-513
    • /
    • 2006
  • The duration time of aircraft noise event is also an important factor for the evaluation of civil aircraft noise, which is considered as a notable characteristic of military aircraft noise. SEL is proved as a suitable noise metric for the measuring military aircraft noise of various flight pattern considering the duration time of noise event. This study reviews whether SEL is a suitable for measuring civil aircraft noise and study shows SEL is fairly compensating the duration time of civil aircraft noise event for the evaluation of aircraft noise. Noise metric for the evaluation aircraft noise based on SEL is more appropriate than based on $L_{MAX}$ for compensating duration time of noise event either military aircraft or civil aircraft. In this reason, current formula of WECPNL based on energy average of measured $L_{MAX}$ for the evaluation of aircraft noise impact in 'Test Method of Noise and Vibration of Korea' is recommended to be amended to formula of WECPNL based on energy average of measured SEL considering compensation of noise event duration time, if WECPNL is not based on measured EPNL, a metric compensating duration time.

Implementation of Z-Factor Statistics for Performance Evaluation of Quality Innovation in the High Throughput Process (High Throughput 프로세스에서 품질혁신의 성능평가를 위한 Z-Factor의 적용방안)

  • Choi, Sung-Woon
    • Journal of the Korea Safety Management & Science
    • /
    • v.15 no.1
    • /
    • pp.293-301
    • /
    • 2013
  • The purpose of this study is to introduce the limit of previously used six sigma quality process evaluation metrics, $Z_{st}$ and $P_{pk}$, and a solution to overcome this drawback by using a metric based on performance evaluation of Z-factor quality innovation. Case analysis on projects from national six sigma contest from 2011 to 2012 is performed and literature review on new drug development HTS (High Throughput Screening) is used to propose innovative performance evaluation metrics. This research shows that experimental study on six sigma evaluation metric, $Z_{st}$ and $P_{pk}$, have no significance difference between industrial type (Manufacturing, Semi-Public Institute, Public Institute) and CTQ type (Product Technology Type CTQ, Process Technology Type CTQ). Following discovery characterize this quality improvement as fixed target type project. As newly developed moving target type of quality innovation performance metric Z-Factor is used for evaluating experimental study, hypothetical analysis suggests that $Z_{st}$ and $P_{pk}$ share different relationship or even show reciprocal relationship. Constraints of the study are relatively small sample size of only 37 projects from past 2 years and conflict on having interview and communication with six sigma quality practitioner for qualitative experimental study. Both moving target type six sigma innovation project and fixed target type improvement project or quality circle enables efficient ways for a better understanding and quality practitioner use by applying quality innovation performance metric. Downside of fixed target type quality performance evaluation metric, $Z_{st}$ and $P_{pk}$, is presented through experimental study. In contrast, advantage of this study is that high throughput requiring product technology, process technology and quantum leap typed innovation effect is evaluated based on precision and accuracy and Z-Factor that enables relative comparison between enterprises is proposed and implemented.

Risk Evaluation Based on the Hierarchical Time Delay Model in FMEA (FMEA에서 계층적 시간 지연 모형에 근거한 위험평가)

  • Jang, Hyeon Ae;Lee, Min Koo;Hong, Sung Hoon;Kwon, Hyuck Moo
    • Journal of Korean Society for Quality Management
    • /
    • v.44 no.2
    • /
    • pp.373-388
    • /
    • 2016
  • Purpose: This paper suggests a hierarchical time delay model to evaluate failure risks in FMEA(failure modes and effects analysis). In place of the conventional RPN(risk priority number), a more reasonable and objective risk metric is proposed under hierarchical failure cause structure considering time delay between a failure mode and its causes. Methods: The structure of failure modes and their corresponding causes are analyzed together with the time gaps between occurrences of causes and failures. Assuming the severity of a failure depends on the length of the delayed time for corrective action, a severity model is developed. Using the expected severity, a risk priority metric is defined. Results: For linear and quadratic types of severity, nice forms of expected severity are derived and a meaningful metric for risk evaluation is defined. Conclusion: The suggested REM(risk evaluation metric) provides a more reasonable and objective risk measure than the conventional RPN for FMEA.

Development of Seat Belt Pulling Noise Index and Evaluation System Research (시트 벨트 인출 소음 평가 기술 및 인덱스 개발 연구)

  • Cho, Hye-Young;Lee, Sang-Kwon;Kang, Hee-Su;Son, Joo-Hwan
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.23 no.2
    • /
    • pp.185-190
    • /
    • 2015
  • The purpose of this study is developing the quantify the seat belt pulling Noise index and evaluation method. This paper presents the objective method to evaluate the emotional feeling about the pulling Noise of the seat belt. The physical quantification is required to objectively evaluate the emotional feeling of the pulling Noise. This is called the "Noise metric." The Noise metric is should correlated to the subjective rating of the pulling Noise. The pulling Noise index is developed throughout the linear regression of the Noise metric and the subjective rating. The developed index is used for the objective evaluation of the emotional feeling about the pulling Noise of a seat belt throughout the modification of seat belt components.

Development of Security Metric of Network Access Control (네트워크 접근제어 시스템의 보안성 메트릭 개발)

  • Lee, Ha-Yong;Yang, Hyo-Sik
    • Journal of Digital Convergence
    • /
    • v.15 no.6
    • /
    • pp.219-227
    • /
    • 2017
  • Network access control should be able to effectively block security threats to the IT infrastructure, such as unauthorized access of unauthorized users and terminals, and illegal access of employees to internal servers. From this perspective, it is necessary to build metrics based on relevant standards to ensure that security is being met. Therefore, it is necessary to organize the method for security evaluation of NAC according to the related standards. Therefore, this study builds a model that combines the security evaluation part of ISO / IEC 15408 (CC: Common Criteria) and ISO 25000 series to develop security metric of network access control system. For this purpose, we analyzed the quality requirements of the network access control system and developed the convergence evaluation metric for security of the two international standards. It can be applied to standardization of evaluation method for network access control system in the future by constructing evaluation model of security quality level of network access control system.

A Modified Metric of FMEA for Risk Evaluation Based on ASIL of Safety System (ASIL에 기초하여 수정된 안전시스템 FMEA 위험평가척도)

  • Baek, Myoung-Sig;Jang, Hyeon Ae;Kwon, Hyuck Moo
    • Journal of Korean Society for Quality Management
    • /
    • v.42 no.4
    • /
    • pp.543-562
    • /
    • 2014
  • Purpose: The purpose of this study is to suggest a modified approach that compensates some shortcomings of RPN with relevant strength of ASIL for Safety System and suggests systematic and logical approach for FMEA. Methods: By comparing the objectives, determination procedures, and key conceptual differences of RPN and ASIL, a refined method of risk evaluation and a new risk metric are devised. Results: While the traditional FMEA provides only rough evaluation of relative risk for each failure, the proposed method compensates its shortcomings with relevant strength of ASIL and provides a more logical and practical procedure of risk evaluation. Conclusion: The new metric RPM provides not only a comparative priority rank but also the degree of physical seriousness. Besides, it may have even more benefits for various applications if the severity can be expressed as mone tary amount of losses.