• Title/Summary/Keyword: Reliability and Validity

Search Result 3,229, Processing Time 0.032 seconds

A Study on the Validity and Reliability of Performance Assessment in Home Economics (가정과 수행평가의 타당성과 신뢰성 연구 - 경남 농촌지역의 소인수 학급을 대상으로 -)

  • 윤성희;유태명
    • Journal of the Korean Home Economics Association
    • /
    • v.39 no.10
    • /
    • pp.169-186
    • /
    • 2001
  • The purpose of the study was to verify validity and reliability of performance assessment in home economics by applying performance assessment tools developed by Korean Curriculum Assessment Institute and by the researcher to a class of 17 high school female students in a rural area. For the purpose of this study, the research question was formulated and addressed:“How are the validity and reliability of performance assessment in home economics\ulcorner” The results of the study were as follows. 1. The results of testing validity a. Thirteen high school home economics teachers, whose average teaching years is ten years verified high validity in the contents of performance assessment. b. In the validity of the items that is verified being based on the scores of high school entrance examination of 2000 school year, the essay type showed its characteristics as performance assessment. c. The generalizability among assessment methods was not high. 2. The results of testing reliability Both Cronbach's $\alpha$, inter-item reliability of the assessment tools used in the research, and reliability among the raters were high. But reliability among the tasks was relatively low. This study proposed that the diverse performance methods, the increasing number of assessment, the explicit assessment criterion, and scoring criterion are needed to satisfying validity and reliability of performance assessment.

  • PDF

Reliability and validity of free software for the analysis of locomotor activity in mice

  • Hong, Yoo Rha;Moon, Eunsoo
    • Journal of Yeungnam Medical Science
    • /
    • v.35 no.1
    • /
    • pp.63-69
    • /
    • 2018
  • Background: Kinovea software that tracking semi-automatically the motion in video screen has been used to study motion-related tasks in several studies. However, the validation of this software in open field test to assess locomotor activity have not been studied yet. Therefore, this study aimed to examine the reliability and validity of this software in analyzing locomotor activities. Methods: Thirty male Institute Cancer Research mice were subjected in this study. The results examined by this software and the classical method were compared. Test-retest reliability and inter-rater reliability were analyzed with Pearson's correlation coefficient and intraclass correlation coefficient (ICC). The validity of this software was analyzed with Pearson's correlation coefficient. Results: This software showed good test-retest reliability (ICC=0.997, 95% confidence interval [CI]=0.975-0.994, p<0.001). This software also showed good inter-rater reliability (ICC=0.987, 95% CI=0.973-0.994, p<0.001). Furthermore, in three analyses for the validity of this software, there were significant correlations between two methods (Pearson's correlation coefficient=0.928-0.972, p<0.001). In addition, this software showed good reliability and validity in the analysis locomotor activity according to time interval. Conclusion: This study showed that this software in analyzing drug-induced locomotor activity has good reliability and validity. This software can be effectively used in animal study using the analysis of locomotor activity.

Reliability and Validity of Patient Self-reported Daily Questionnaire on Oral Mucositis in Acute Leukemic Patients under Chemotherapy (화학요법을 받는 급성백혈병 환자 자가보고형 구강점막염 사정도구의 신뢰도와 타당도 분석)

  • Choi, So-Eun;Kim, Hee-Seung
    • Journal of Korean Biological Nursing Science
    • /
    • v.12 no.3
    • /
    • pp.148-156
    • /
    • 2010
  • Purpose: Oral mucositis (OM) is a serious consequence of chemotherapy that cancer patients must undergo. The objectives of this study were to find out reliability and validity of patients self-reported daily questionnaires on OM, and the impact OM makes on daily functions. Method: To test the reliability of oral mucositis daily questionnaire (OMDQ), internal consistency of the instrument (Cronbach's ${\alpha}$ and correlation between items) and test-retest reliability were analyzed. Criterion validity and discriminative validity were evaluated using WHO, oral assessment guide, and Nicolatou assessment tool. Forty-eight acute leukemic patients under chemotherapy were enrolled in this study. Result: The Cronbach's ${\alpha}$ coefficient indicated sufficient internal consistency. Correlations of Mouth and throat soreness (MTS) and MTSActivity Limitations (MTS-AL) were statistically significant. MTS and MTS-AL scores on consecutive days were highly correlated (days13,14=.84-.96; test-retest reliability). OMDQ scale had high criterion validity and discriminative validity. Patients with more severe WHO OM grades had higher MTS mean scores. Conclusion: Oral mucositis in acute leukemic patients under going chemotherapy can be easily quantified by patient self-administered OMDQ with reliability and validity.

Reliability and Validity of the Korean Version of the Cancer Stigma Scale

  • So, Hyang Sook;Chae, Myeong Jeong;Kim, Hye Young
    • Journal of Korean Academy of Nursing
    • /
    • v.47 no.1
    • /
    • pp.121-132
    • /
    • 2017
  • Purpose: In this study the reliability and validity of the Korean version of the Cancer Stigma Scale (KCSS) was evaluated. Methods: The KCSS was formed through translation and modification of Cataldo Lung Cancer Stigma Scale. The KCSS, Psychological Symptom Inventory (PSI), and European Organization for Research and Treatment of Cancer Quality of Life Questionnaire - Core 30 (EORTC QLQ-C30) were administered to 247 men and women diagnosed with one of the five major cancers. Construct validity, item convergent and discriminant validity, concurrent validity, known-group validity, and internal consistency reliability of the KCSS were evaluated. Results: Exploratory factor analysis supported the construct validity with a six-factor solution; that explained 65.7% of the total variance. The six-factor model was validated by confirmatory factor analysis (Q (${\chi}^2/df$)= 2.28, GFI=.84, AGFI=.81, NFI=.80, TLI=.86, RMR=.03, and RMSEA=.07). Concurrent validity was demonstrated with the QLQ-C30 (global: r=-.44; functional: r=-.19; symptom: r=.42). The KCSS had known-group validity. Cronbach's alpha coefficient for the 24 items was .89. Conclusion: The results of this study suggest that the 24-item KCSS has relatively acceptable reliability and validity and can be used in clinical research to assess cancer stigma and its impacts on health-related quality of life in Korean cancer patients.

Study of the Reliability and Validity of the WOMAC Index in Patients with Total Knee Replacement (무릎관절 전치환술 환자에 대한 WOMAC 지수의 신뢰도와 타당성에 관한 연구 )

  • Hoon Jo;Kyoung Kim;Sang-Cheol Im
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.18 no.2
    • /
    • pp.93-101
    • /
    • 2023
  • PURPOSE: The Western Ontario and McMaster Universities Arthritis (WOMAC) index has been used to measure the outcome of total knee replacement (TKR), but studies on its reliability and validity are limited. The present study examined the reliability and validity of this index for patients with knee osteoarthritis who underwent TKR. METHODS: Seventy-one inpatients and outpatients who underwent bilateral TKR for knee osteoarthritis were included in this study. The pain assessment scale and WOMAC index were used to evaluate the participants every two weeks to examine the test-retest reliability, internal consistency, and construct validity. RESULTS: The test-retest reliability scores for pain, stiffness, and physical function were .75-.92, .85-.90, and .75-.95, respectively. The corresponding intraclass correlation coefficients were .75-.88, .76-.88, and .71-.95, respectively. The internal consistency score in the first and second examinations was .92. Furthermore, the construct validity scores for pain, stiffness, and physical function were .83, .41, and .58, respectively. CONCLUSION: The application of the WOMAC index in patients who underwent TKR showed high test-retest reliability and internal consistency with the use of the WOMAC index and good validity with the use of the pain assessment scale.

The Reliability and Validity of Korean Version of Wong and Law Emotional Intelligence Scale (K-WLEIS) (한국어판 감성지능 측정도구의 신뢰도와 타당도 검증)

  • Jeong, Harim;Choi, Heejung;Park, Myungsook
    • Journal of Korean Academy of Nursing
    • /
    • v.50 no.4
    • /
    • pp.611-620
    • /
    • 2020
  • Purpose: The aim of this study was to evaluate the reliability and validity of the Korean version of the Wong and Law Emotional Intelligence Scale (K-WLEIS). Methods: Data were collected from 360 nursing students using a self reported questionnaire. Exploratory and confirmatory factor analysis were used to test construct validity. Convergence validity was identified by correlation with communication competency. Item convergent and discriminant validity were also analyzed. Reliability was evaluated internal consistency and test-retest reliability. Results: The results of exploratory factor analysis showed that the eigen values ranged from 1.34 to 5.86 and 73.2% of the total explained variance. Confirmatory factor analysis showed adequate model fit indices (χ2/df 1.89, RMSEA .07, GFI .89, CFI .95, and TLI .93) and standardized factor loadings (.48 to .87). The average extracted variances (.71 to .79) and composite reliability (.80 to .87) validated convergence and discriminant validity of the items. Test-retest reliability of intra-class correlation coefficient was .90 and the Cronbach's alpha coefficient was .88. Conclusion: The K-WLEIS is an appropriate scale for measuring the emotional intelligence of Korean nursing students. Therefore, it is expected that the K-WLEIS will be used for nursing education programs to improve nursing students' emotional intelligence.

Development of a Knowledge Scale of Fall Risk Factors for Community-dwelling Older Adults (재가노인의 낙상위험요인 지식 측정도구 개발)

  • Hong, Chong-Min
    • Korean Journal of Adult Nursing
    • /
    • v.24 no.3
    • /
    • pp.244-252
    • /
    • 2012
  • Purpose: The purpose of the study was to develop a knowledge scale of risk factors for fall among community-dwelling older adults. Further, the validity and reliability of the scale was developed. Methods: A preliminary scale was developed through content validity by five experts and targeted subjects using the CVI (Content Validity Index). Following the establishment of content validity, the scale was used with 359 community-dwelling older adults to further establish both validity and reliability of the scale. Specifically, construct validity using known-group comparison technique, and reliability using Cronbach's ${\alpha}$ were established. Results: After content validity testing, 44 preliminary items were selected. Construct validity was established by known group-comparison, in which scores between the fall and no fall groups were compared. The Cronbach's ${\alpha}$ of the final scale was .83. Conclusion: Reliability and validity of the scale were confirmed. This tool may be used for measuring knowledge of fall risk factor for the community-dwelling older adults.

A Study on the Validity and Test-Retest Reliability of the Measurement of the Craniovertebral Angle of the Smart Phone Application 'Angles Video Goniometer'

  • Hyeon-Seong Joo;Byeong-Soo Kim;Myung-Mo Lee
    • Physical Therapy Rehabilitation Science
    • /
    • v.11 no.4
    • /
    • pp.454-463
    • /
    • 2022
  • Objective: The purpose of this study was to compare concurrent validity and test-retest reliability based on Craniovertebral angle of 'Angles video goniometer', a smart phone application for convenient range of motion measurement, and 'Image J', an analysis software with high reliability and validity. This was conducted to find out whether 'Angle video goniometer' can be used clinically. Design: Cross-sectional study Methods: Fifty subjects were imaged laterally, and the angle of the head and spine was measured using Image J and the Angles video goniometer, respectively, in a resting posture and a chin in posture. The level of concurrent validity between the two measurement methods and the level of inter-rater reliability and intra-rater reliability were analyzed. Results: For forty participants, the concurrent validity between Image J and Angles video goniometer showed very high validity with ICC of 0.997(0.995~0.999) and 0.994(0.994~0.998), CVME% 0.71~0.72%, SEM% 0.31~0.34, MDC% 0.86~0.94. The test-retest intra-rater reliability showed very high reliability ICC 0.994(0.991~0.996), CVME% 0.71%, SEM% 0.31~0.43, MDC% 0.86~1.19%. The test-retest inter-rater showed very high reliability ICC 0.995(0.992~0.997), CVME% 0.71%, SEM% 0.43~0.59%, MDC% 1.20~1.62% Conclusions: Angles video goniometer', a smartphone application, is a device with very high reliability and validity for craniovertebral angle measurement in healthy adults, and it is a device that can be easily used in clinical practice.

The Verification of the Reliability and Validity of Special Needs Education Assessment Tool (SNEAT) in Miyagi, Japan

  • HAN, Changwan;KOHARA, Aiko
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2016.05a
    • /
    • pp.383-384
    • /
    • 2016
  • The Special Needs Education Assessment Tool (SNEAT) were verified of reliability and validity. However, the reliability and validity has been verified is only Okinawa Prefecture, the national data has not been analyzed. Therefore, this study aimed to verify the reliability and construct validity of SNEAT in Miyagi Prefecture as part of the national survey. SNEAT using 55 children collected from the classes on independent activities of daily living for children with disabilities in Miyagi Prefecture between November and December 2015. Survey data were collected in a longitudinal prospective cohort study. The reliability of SNEAT was verified via the internal consistency method; the coefficient of Cronbach's ${\alpha}$ were over 0.7. The validity of SNEAT was also verified via the latent growth curve model. SNEAT is valid based on its goodness-of-fit values obtained using the latent growth curve model, where the values of comparative fit index (0.997), tucker-lewis index (0.996) and root mean square error of approximation (0.025) were within the goodness-of-fit range. These results indicate that SNEAT has high reliability and construct validity.

  • PDF

An Analysis of the Reliability and Validity of a Korean Version of the Mobility and Gait Assessment Tools for Patients with Stroke

  • Jang, Ho Young;Lee, Jeong-Hoon;Oh, Jung Lim;Lee, Hyun Soo;Lee, Suk Min
    • The Journal of Korean Physical Therapy
    • /
    • v.30 no.1
    • /
    • pp.29-34
    • /
    • 2018
  • Purpose: This study aimed to systematically analyze the reliability and validity of Korean versions of mobility and gait assessment tools for patients with stroke. Methods: Two reviewers conducted an independent literature search and systematically reviewed the literature. Literature published until June of 2017 was searched using search engines for electronic databases. The 2 reviewers reviewed the title and abstract of each article. Among the articles examined, we read the full text of those judged to be suitable for our study. We classified the selected data into research methods and results. The determination was made through mutual agreement. Results: The reviewers selected 5 articles related to the purpose of this study. The DGI was found to be moderately associated with BBS, 10MWT, and TUG in intra-rater reliability (ICC=0.92), inter-rater reliability (ICC=0.88), and concurrent validity tests. The FGA demonstrated a high level of reliability with intra-rater (ICC=0.92-0.95) and inter-rater reliability (ICC=0.91, 0.95). The intra-rater reliability of the RMI was high at ICC=0.98. Its concurrent validity showed a high association with STREAM and BI. The intra-rater reliability of the MAS was ICC=0.75-0.99. Its inter-rater reliability was very high, exceeding 0.99. The inter-rater reliability of the Tinetti-gait Scale was ICC=0.91, and its concurrent validity was moderately associated with the DGI, 10WMT, OLST, FM-L/E, and STS. Conclusion: The results of this study revealed that the reliability and validity of the Korean versions of the mobility and gait assessment tools were high.