• Title/Summary/Keyword: Inter-rater reliability

Search Result 194, Processing Time 0.027 seconds

Reliability of Navicular Drop Measurements in Standing and Sitting Positions

  • Park, Ji-Won;Chang, Jong-Sung;Nam, Ki-Seok
    • The Journal of Korean Physical Therapy
    • /
    • v.22 no.6
    • /
    • pp.29-33
    • /
    • 2010
  • Purpose: This study was designed to investigate inter-rater and intra-rater reliability of navicular drop measurements by clinicians in sitting and standing positions. Methods: Fourteen subjects with pronated foot were recruited. Two physical therapists randomly assessed the same patients on different occasions but on the same day. Almost all patients were assessed on more than one day. The intra-rater and inter-rater reliability of navicular dropwas estimated by calculation of the intraclass correlation coefficient (ICC). Results: The intra-rater reliability of navicular drop measurements ranged from 0.93 to 0.87, the inter-rater reliability from 0.98 to 0.70 with the patient in standing and sitting positions. These results showed good reliability for calculated variables. Intra-rater and inter-rater reliability of navicular drop in standing position was higher than those of sitting position. Conclusion: Although inter-rater and intra-rater reliability of navicular drop in the sitting position was lower than in the standing position, measurement of navicular drop in the sitting position showed good reliability and was acceptable for patients who could not stand alone without assistance. We recommend that having the patient in the standing position is appropriate in navicular drop measurement.

Intra and Inter-Rater Measurement Reliability of Tibialis Anterior Muscle (TA) Thickness using the Ultrasonography Spring Gauge Technique

  • Hwang, Byeong-Hun;Jang, Tae-Jin;Jeon, In-Cheol
    • The Journal of Korean Physical Therapy
    • /
    • v.33 no.4
    • /
    • pp.187-192
    • /
    • 2021
  • Purpose: The purpose of the current study was to determine the intra- and inter-rater reliability of muscle thickness measurement of the TA using ultrasonography (US) conducted at different inward pressures of approximately 0.5 kg, 1.0 kg, and no pressure control. Methods: Twenty healthy subjects were recruited for this study. Two different examiners measured the thicknesses of the dominant TA of each subject randomly to assess the intra- and inter-rater reliability. The measurement values were analyzed using the intra-class correlation coefficient (ICC) with a 95% confidence interval, standard error of measurement, minimal detectable change, and coefficient of variance. Results: All intra-rater reliability ICC values showed high reliability above 0.9. Inter-rater reliability ICC values showed high reliability above 0.9 with 0.5 and 1.0 kg of inward pressure. In contrast, Inter-rater reliability ICC values showed poor reliability (0.23) with no pressure control of inward pressure. Conclusion: The findings showed that maintaining consistent inward pressure is essential for reliable results when the muscle thickness of the TA is measured by different examiners in a clinical setting.

Reliability of Thickness Measurements of the Abductor Hallucis Muscle Using the Spring Gauge Technique in Hallux Valgus Subjects: An Ultrasonographic Study

  • Jeon, In-cheol;Kim, Moon-Hwan
    • The Journal of Korean Physical Therapy
    • /
    • v.28 no.2
    • /
    • pp.119-123
    • /
    • 2016
  • Purpose: The purpose of this study was to determine the intra- and inter-rater reliability of muscle thickness (MT) measurements of the abductor hallucis (AbdH) in subjects with hallux valgus (HV), using ultrasonography performed at different inward pressures of approximately 0.5 kg, 1.0 kg, 1.5 kg, and 2.0 kg, with no pressure control. Methods: Thirty-two subjects with HV were recruited. The thicknesses of both sides of the AbdH were measured randomly by two different examiners for assessment of the intra- and inter-rater reliability. The measurement values were analyzed using the intra-class correlation coefficient (ICC) with a 95% confidence interval (CI). ICC (2,1) was used to determine the inter-rater reliability of MT measurements of the AbdH, while ICC (3,1) was used to assess the intra-rater reliability. Results: The results showed higher ICC values for intra-rater reliability compared to inter-rater reliability, and the value for inter-rater reliability with no pressure control (ICC=0.74 [95%CI=0.53-0.87]) was smaller compared to pressures of 0.5 kg, 1.0 kg, 1.5 kg, and 2.0 kg. Other inward pressures for intra- and inter-rater reliability also showed excellent values (ICC=0.86-0.96). Conclusion: The findings showed that maintaining consistent inward pressure is essential for reliable results in measurement of the MT of the AbdH by different examiners in a clinical setting.

Intra- and Inter-Rater Reliability of Thickness Measurement of the Psoas Major Muscle Using the Spring Gauge Technique for the Consistent Inward Pressures on Healthy Subjects: An Ultrasonographic Study

  • Jeon, In-Cheol;Kim, Yong-Wook;Choung, Sung-Dae
    • Physical Therapy Korea
    • /
    • v.20 no.4
    • /
    • pp.65-72
    • /
    • 2013
  • The purpose of the current study was to determine the intra- and inter-rater reliability of muscle thickness (MT) measurement of the psoas major (PM) using ultrasonography (US) conducted at different inward pressures of approximately .5 kg, 1.0 kg, 1.5 kg, and 2.0 kg. Twelve healthy male subjects were recruited for the study. The thicknesses of both PMs of each subject were measured by two different examiners in a random manner to assess the intra- and inter-rater reliability. The measurement values were analyzed using the intra-class correlation coefficient (ICC) with a 95% confidence interval (CI). ICC (2,1) was used to determine the inter-rater reliability and ICC (3,1) was used to assess the intra-rater reliability of the MT measurement of the PM. The results indicated higher ICC values for intra-rater reliability compared to inter-rater reliability. In addition, the value for intra-rater reliability with .5 kg inward pressure [ICC=.99 (95%CI=.98~.99)] was higher compared to 1.0 kg, 1.5 kg, and 2.0 kg. Other inward pressures for intra- and inter-rater reliability in current study were also demonstrated to have excellent values (ICC=.94~.99). These findings showed that maintaining consistent inward pressure is essential for maintaining reliability of the results when the MT of the PM is measured by different examiners in a clinical setting.

The Inter-Rater Reliability of Measurements of Active Craniocervical Range of Motion With Smartphone in Patients With Stroke (뇌졸중 환자에서 스마트폰 어플리케이션을 이용한 능동적 머리목관절 가동범위 측정에 관한 측정자간 신뢰도 연구)

  • Park, Il-woo;Park, Kyue-nam;Yi, Chung-hwi;Moon, Il-young
    • Physical Therapy Korea
    • /
    • v.26 no.1
    • /
    • pp.8-18
    • /
    • 2019
  • Background: Numerous studies have used smartphone applications to measure the range of motion in different joints. In addition, studies measuring the active range of motion (AROM) of the craniocervical joint have revealed high reliability. However, the subjects in these studies were all healthy subjects. No study has yet been conducted to measure the inter-rater reliability for the AROM of the craniocervical joint in stroke patients. Objects: The purpose of this study was to investigate the inter-rater reliability of the AROM of the craniocervical joint using a smartphone. Methods: The participants included 21 subjects who had strokes (17 males and 4 females). Two raters evaluated six types of craniocervical AROM, including flexion, extension, lateral flexion to the hemiplegic side, lateral flexion to the non-hemiplegic side, rotation to the hemiplegic side, and rotation to the non-hemiplegic side, using a goniometer and a smartphone to investigate inter-rater reliability. The inter-rater reliability was analyzed by intraclass correlation coefficients (ICC). Results: The inter-rater reliability of the smartphone was good for extension, lateral flexion to the hemiplegic side, lateral flexion to the non-hemiplegic side, and rotation to the hemiplegic side [ICC(2,k)=.86~.88] and excellent for flexion [ICC(2,k)=.95]. The inter-rater reliability for rotation to the non-hemiplegic side was moderate [ICC(2,k)=.72]. Conclusion: These results suggest that the smartphone offers high inter-rater reliability for measurements of the craniocervical AROM in patients with stroke.

Reliability Study of Measuring Range of Motion Glenohumeral Joint Internal Rotation With Pressure Biofeedback Stabilization

  • Hwang, Ui-jae;Ha, Sung-min;Jeon, In-chul;Jung, Sung-hoon;Choi, Kyu-hwan;Kim, Su-jung;Kwon, Oh-yun
    • Physical Therapy Korea
    • /
    • v.22 no.4
    • /
    • pp.62-70
    • /
    • 2015
  • The aims of the current study were to assess reliability of range of motion (ROM) measurement of glenohumeral internal rotation (GIR) with a pressure biofeedback stabilization (PBS) method and to compare the reliability between manual stabilization (MS) and the PBS method. In measurement of pure glenohumeral joint motion, scapular stabilization is necessary. The MS method in GIR ROM measurement was used to restrict scapular motion by pressing the palm of the tester's hand over the subject's clavicle, coracoid process, and humeral head. The PBS method was devised to maintain consistent pressure for scapular stabilization during GIR ROM measurement by using a pressure biofeedback unit. GIR ROM was measured by 2 different stabilization methods in 32 subjects with GIR deficit using a smartphone clinometer application. Repeated measurements were performed in two test sessions by two testers to confirm inter- and intra-rater reliability. After tester A performed measurements in test session 1, tester B's measurements were conducted one hour later on the same day to assess the inter-rater reliability and then tester A performed again measurements in test session 2 for confirming the intra-rater reliability. Intra-class correlation coefficient (ICC) (2,1) was applied to assess the inter-rater reliability and ICC (3,1) was applied to determine the intra-rater reliability of the two methods. In the PBS method, the intra-rater reliability was excellent (ICC=.91) and the inter-rater reliability was good (ICC=.84). The inter-rater and intra-rater reliability of the PBS method was higher than in the MS method. The PBS method could regulate manual scapular stabilization pressure in inter- and intra-rater measuring GIR ROM. Results of the current study recommend that the PBS method can provide reliable measurement data on GIR ROM.

Reliability of the Joint Neutral Position and Measurement Methods of the Ankle Joint Complex Range of Motion (발목관절 복합체의 가동범위 측정을 위한 중립위치와 측정방법의 신뢰도)

  • Hong, Wan-Sung;Kim, Gi-Won
    • The Journal of Korean Physical Therapy
    • /
    • v.23 no.4
    • /
    • pp.45-51
    • /
    • 2011
  • Purpose: To determine the correct measurement methods of the ankle joint complex range of motion for measuring the neutral position and evaluate the rater reliability. In addition, the impact of training on the rater reliability was also assessed. Methods: The subjects were eleven healthy women, who were evaluated by two physical therapists and one physical therapist recorded the results of the study. Standard goniometer was used as the measurement tool. The ankle and subtalar joint neutral position and the active range of motion of the ankle and subtalar joint were measured. Intra-rater reliability and inter-rater reliability measures were analyzed with intraclass correlation coefficients. Results: Intra-rater reliability and inter-rater reliability ranged from high to medium for the neutral position of the ankle joint complex. Intra-rater reliability for dorsiflexion and plantarflexion measurements was medium, while the inter-rater reliability was high. The range of motion of the subtalar joint was measured, and the intra-rater reliability and inter-rater reliability were low and medium, respectively Also, the intra-rater reliability was increased with formal training of the measurement techniques. Intra-rater reliability was reduced in case the raters had not undertaken the training. Conclusion: In summary, the results obtained with the measurement tools and joint measurement of position, indicate the consistency of repeated measurements made by the same observers. Under the same circumstances along with repetition of the same measurement technique during training caused an increase in the rater reliability of formally trained raters.

The reliability of an easy measuring method for abutment convergence angle with a computer-aided design (CAD) system

  • Seo, Yong-Joon;Kwon, Taek-Ka;Han, Jung-Suk;Lee, Jai-Bong;Kim, Sung-Hun;Yeo, In-Sung
    • The Journal of Advanced Prosthodontics
    • /
    • v.6 no.3
    • /
    • pp.185-193
    • /
    • 2014
  • PURPOSE. The purpose of this study was to evaluate the intra-rater reliability and inter-rater reliability of three different methods using a drawing protractor, a digital protractor after tracing, and a CAD system. MATERIALS AND METHODS. Twenty-four artificial abutments that had been prepared by dental students were used in this study. Three dental students measured the convergence angles by each method three times. Bland-Altman plots were applied to examine the overall reliability by comparing the traditional tracing method with a new method using the CAD system. Intraclass Correlation Coefficients (ICC) evaluated intra-rater reliability and inter-rater reliability. RESULTS. All three methods exhibited high intra-rater and inter-rater reliability (ICC>0.80, P<.05). Measurements with the CAD system showed the highest intra-rater reliability. In addition, it showed improved inter-rater reliability compared with the traditional tracing methods. CONCLUSION. Based on the results of this study, the CAD system may be an easy and reliable tool for measuring the abutment convergence angle.

Inter-rater Reliability of Korean Triage and Acuity Scale (KTAS) among the Research Nurses and the Triage Nurses (한국형 응급환자 분류도구의 간호사 간 신뢰도 평가)

  • Yang, Jungeun;Lee, Eunja
    • Journal of East-West Nursing Research
    • /
    • v.26 no.1
    • /
    • pp.91-99
    • /
    • 2020
  • Purpose: The study aims to assess the inter-rater reliability of the Korean Triage and Acuity Scale between the research nurses and the triage nurses. Methods: Interrater reliability was measured on 400 adult (≧15) and 400 pediatric (<15) patients who visited the emergency medical center from January 4 to June 30, 2018. Results: The study result showed that the inter-rater reliability of the Korean Triage and Acuity Scale was substantial, with κ=.73 (95% Confidence interval= .68-.78) and 77.0 percent agreement. The inter-rater of Pediatric Korean Triage and Acuity Scale was also substantial, with κ=.76 (95% Confidence interval= .71-.82) and 83.8 percent agreement. Conclusion: Although the inter-rater reliability of the Korean Triage and Acuity Scale was acceptable, the percent agreement was lower than the desirable level (<80.0%). It was confirmed that Pediatric Korean Triage and Acuity Scale had an acceptable level of inter-rater reliability and percent agreement for clinical use. Efforts should be made to improve the reliability in the future.

Inter-Rater and Intra-Rater Reliability of the Modified Ashworth Scale and the Modified Tardieu Scale: A Comparison Study (수정된 Ashworth 척도와 수정된 Tardieu 척도의 검사자간, 검사자내 신뢰도 비교 연구)

  • Choi, Yul-Jung;Lee, Jung-Ah;Shin, Hwa-Kyung
    • The Journal of Korean Physical Therapy
    • /
    • v.22 no.4
    • /
    • pp.29-33
    • /
    • 2010
  • Purpose: The purpose of this study was to assess and compare the reliability of the Modified Tardieu Scale (MTS) with the Modified Ashworth Scale (MAS) in patients with hemiplegia. Methods: Two experienced physical therapists examined twenty six patients (17 male and 9 female) with an age range of 19-83 years (mean=51.9 SD=15.2). They assessed the elbow flexor/extensor muscle spasticity in the affected side. Interand intra-rater reliability of the MAS and the MTS were calculated using kappa statistics. Intraclass correlation coefficient (ICC) was calculated to determine the inter- and intra-rater reliability of the angle of muscle reactions (R2-R1). Results: The intra-rater reliability of the MAS (K=0.39-0.55) and MTS (K=0.33-0.55) was fair to moderate. The inter-rater reliability was significantly higheras measured with MTS (K=0.54-0.66) in comparison with MAS (K=0.52). Intra-rater reliability of R2-R1 was moderate to almost perfect (ICC=0.52-0.86), and inter-rater reliability was substantial (ICC=0.74-0.76). Conclusion: The MTS provides higher inter-rater reliability compared with the MAS in hemiplegia patient analysis, but intra-rater reliability of both scales was not significantly different. Thus further research is needed to examine not only reliability, but also validity of these measurement systems.