• Title/Summary/Keyword: accuracy of peer assessment

Search Result 7, Processing Time 0.027 seconds

Student Discussion or Expert Example? How to Enhance Peer Assessment Accuracy (동료평가 정확도 향상 방안의 비교: 평가 기준에 대한 학생들 간 토론 대 전문가 평가 사례 제시)

  • Park, Jung Ae;Park, Jooyong
    • Korean Journal of Cognitive Science
    • /
    • v.30 no.4
    • /
    • pp.175-197
    • /
    • 2019
  • Writing is an activity known to enhance higher level thinking. It allows the writer to utilize, apply, and actively expand the acquired knowledge. One way to increase writing activity in classroom setting is to use peer assessment. In this study, we sought to increase the accuracy of peer assessment by having students discuss about the scoring rubric or by referring to an expert's assessment. One hundred and fifty college students participated in the experiment. In the group that referred to the expert's assessment, the accuracy of peer assessment increased when the same piece of writing was evaluated; however, no such increase was observed when another piece of writing was assessed. On the other hand, in the group that discussed about the scoring rubric, the accuracy of peer assessment remained the same when the same piece of writing was evaluated, but increased when another piece of writing was assessed. Also, in the discussion group, the accuracy increased in proportion to the number of comments during the discussion. The results suggest that active and voluntary participation of students increase the accuracy of peer assessment.

Delivery of Therapist's Intervention to the Education of Ayres Sensory Integration$^{(R)}$ (ASI$^{(R)}$) (Ayres Sensory Integration (ASI$^{(R)}$) 중재 교육에 따른 치료사의 치료 수행도 변화)

  • Shin, Ye-Na;Hong, Eunkyoung
    • The Journal of Korean Academy of Sensory Integration
    • /
    • v.12 no.1
    • /
    • pp.13-23
    • /
    • 2014
  • Objective : This study was to perform the education of the ASI$^{(R)}$ intervention for six occupational therapists and to know the delivery of ASI$^{(R)}$ core principle through a self-assessment, a peer-assessment, an expert-assessment. Methods : The study performed from November 2013 to June 2014 for six occupational therapists without completion of the education of ASI$^{(R)}$ intervention. The participants were educated about the ASI$^{(R)}$ intervention during 8 weeks and took and assessed films before and after education. The assessment was the self-assessment, the peer-assessment, the expert-assessment and the data of assessment was analyzed by Mann-Whitney and ICC. Results : The result of process factors before and after education according to methods of assessment, the self-assessment was significant in 'self-regulation,' 'collaboration,' 'ensures success,' 'play,' 'alliance,' and 'total item'. The peer-assessment was significant in all item exception 'safety'. The expert-assessment was significant in all items exception 'sensory opportunities'. The results of self-assessment and expert-assessment before and after the education of ASI$^{(R)}$ intervention were significant in 'safety'. Conclusion : The results of this study provide to need the education of ASI$^{(R)}$ intervention for accuracy sensory integrative intervention. The occupational therapists need to check the style of intervention.

Impact of Student Assessment Activities on Claim and Evidence Formation in High School Argument-Based Inquiry (고등학교 논의기반 탐구 과학수업에서 학생 평가활동이 주장과 증거 형성에 미치는 영향)

  • Lee, Seonwoo;Nam, Jeonghee
    • Journal of the Korean Chemical Society
    • /
    • v.62 no.3
    • /
    • pp.203-213
    • /
    • 2018
  • The purpose of this study was to investigate the impact of student assessment activities on claim and evidence formation in argument-based inquiry (ABI) for high school students. The participants of the study were 166 grade 10 students from six different classes in the same high school. The experimental group (84 students) was taught Argument-Based Inquiry with students' self and peer assessment activities. The comparative group (82 students) was taught without the activities. Over one semester students participated in five ABI programs that we developed. According to the analysis of the claim and evidence from groups, the experimental group had a significantly higher mean score than the comparative group. The result of analysis of students' assessment in the experimental group, the frequency about accurate and sufficient evidence revealed to be high and students assessed whether peers' claims fit with the evidence and whether peers' explanations of the evidence's validity was sufficient. Students' answers in the survey and interviews showed that the students though they could improve the accuracy of their ideas, appropriateness of their evidence, and the method of presenting evidence based on the assessment results.

Accuracy of c-KIT in lung cancer prognosis; a systematic review protocol" instead of c-KIT Expression in Lung Cancer Prognostic Evaluation - a Systematic Review Protocol

  • Roudi, Raheleh;Kalantari, Elham;Keshtkar, Abbas;Madjd, Zahra
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.17 no.2
    • /
    • pp.863-866
    • /
    • 2016
  • Background: Extensive efforts have been made to investigate c-KIT expression in lung cancer specimens and its correlation with clinical outcomes, but the issue remains unresolved. Thus, this study will be conducted to clarify the prognostic value of c-KIT expression in lung cancer patients. Materials and Methods: We will search Pubmed, SCOPUS, and ISI web of sciences with no restriction of language. Studies with any design (except case reports or case series) evaluating correlations of c-KIT expression with survival or outcome in patients with lung cancer will be included. The outcome measures will include all types of survival indexes, including overall survival rate and disease free survival using Kaplan-Meier analysis and hazard ratios. Study selection and data extraction will be performed by two independent researchers. Quality assessment (assessment of risk of bias) and data synthesis will be implemented using Stata software version 11.1. Results: No ethical issues are predicted. These findings will be published in a peer-reviewed journal and presented at national and international conferences. Conclusions: This systematic review protocol is registered in the PROSPERO International Prospective Register of Systematic Reviews, registration number = CRD42015023391.

Accuracy and robustness of hysteresis loop analysis in the identification and monitoring of plastic stiffness for highly nonlinear pinching structures

  • Hamish Tomlinson;Geoffrey W. Rodgers;Chao Xu;Virginie Avot;Cong Zhou;J. Geoffrey Chase
    • Smart Structures and Systems
    • /
    • v.31 no.2
    • /
    • pp.101-111
    • /
    • 2023
  • Structural health monitoring (SHM) covers a range of damage detection strategies for buildings. In real-time, SHM provides a basis for rapid decision making to optimise the speed and economic efficiency of post-event response. Previous work introduced an SHM method based on identifying structural nonlinear hysteretic parameters and their evolution from structural force-deformation hysteresis loops in real-time. This research extends and generalises this method to investigate the impact of a wide range of flag-shaped or pinching shape nonlinear hysteretic response and its impact on the SHM accuracy. A particular focus is plastic stiffness (Kp), where accurate identification of this parameter enables accurate identification of net and total plastic deformation and plastic energy dissipated, all of which are directly related to damage and infrequently assessed in SHM. A sensitivity study using a realistic seismic case study with known ground truth values investigates the impact of hysteresis loop shape, as well as added noise, on SHM accuracy using a suite of 20 ground motions from the PEER database. Monte Carlo analysis over 22,000 simulations with different hysteresis loops and added noise resulted in absolute percentage identification error (median, (IQR)) in Kp of 1.88% (0.79, 4.94)%. Errors were larger where five events (Earthquakes #1, 6, 9, 14) have very large errors over 100% for resulted Kp as an almost entirely linear response yielded only negligible plastic response, increasing identification error. The sensitivity analysis shows accuracy is reduces to within 3% when plastic drift is induced. This method shows clear potential to provide accurate, real-time metrics of non-linear stiffness and deformation to assist rapid damage assessment and decision making, utilising algorithms significantly simpler than previous non-linear structural model-based parameter identification SHM methods.

A Study of Six Sigma and Total Error Allowable in Chematology Laboratory (6 시그마와 총 오차 허용범위의 개발에 대한 연구)

  • Chang, Sang-Wu;Kim, Nam-Yong;Choi, Ho-Sung;Kim, Yong-Whan;Chu, Kyung-Bok;Jung, Hae-Jin;Park, Byong-Ok
    • Korean Journal of Clinical Laboratory Science
    • /
    • v.37 no.2
    • /
    • pp.65-70
    • /
    • 2005
  • Those specifications of the CLIA analytical tolerance limits are consistent with the performance goals in Six Sigma Quality Management. Six sigma analysis determines performance quality from bias and precision statistics. It also shows if the method meets the criteria for the six sigma performance. Performance standards calculates allowable total error from several different criteria. Six sigma means six standard deviations from the target value or mean value and about 3.4 failures per million opportunities for failure. Sigma Quality Level is an indicator of process centering and process variation total error allowable. Tolerance specification is replaced by a Total Error specification, which is a common form of a quality specification for a laboratory test. The CLIA criteria for acceptable performance in proficiency testing events are given in the form of an allowable total error, TEa. Thus there is a published list of TEa specifications for regulated analytes. In terms of TEa, Six Sigma Quality Management sets a precision goal of TEa/6 and an accuracy goal of 1.5 (TEa/6). This concept is based on the proficiency testing specification of target value +/-3s, TEa from reference intervals, biological variation, and peer group median mean surveys. We have found rules to calculate as a fraction of a reference interval and peer group median mean surveys. We studied to develop total error allowable from peer group survey results and CLIA 88 rules in US on 19 items TP, ALB, T.B, ALP, AST, ALT, CL, LD, K, Na, CRE, BUN, T.C, GLU, GGT, CA, phosphorus, UA, TG tests in chematology were follows. Sigma level versus TEa from peer group median mean CV of each item by group mean were assessed by process performance, fitting within six sigma tolerance limits were TP ($6.1{\delta}$/9.3%), ALB ($6.9{\delta}$/11.3%), T.B ($3.4{\delta}$/25.6%), ALP ($6.8{\delta}$/31.5%), AST ($4.5{\delta}$/16.8%), ALT ($1.6{\delta}$/19.3%), CL ($4.6{\delta}$/8.4%), LD ($11.5{\delta}$/20.07%), K ($2.5{\delta}$/0.39mmol/L), Na ($3.6{\delta}$/6.87mmol/L), CRE ($9.9{\delta}$/21.8%), BUN ($4.3{\delta}$/13.3%), UA ($5.9{\delta}$/11.5%), T.C ($2.2{\delta}$/10.7%), GLU ($4.8{\delta}$/10.2%), GGT ($7.5{\delta}$/27.3%), CA ($5.5{\delta}$/0.87mmol/L), IP ($8.5{\delta}$/13.17%), TG ($9.6{\delta}$/17.7%). Peer group survey median CV in Korean External Assessment greater than CLIA criteria were CL (8.45%/5%), BUN (13.3%/9%), CRE (21.8%/15%), T.B (25.6%/20%), and Na (6.87mmol/L/4mmol/L). Peer group survey median CV less than it were as TP (9.3%/10%), AST (16.8%/20%), ALT (19.3%/20%), K (0.39mmol/L/0.5mmol/L), UA (11.5%/17%), Ca (0.87mg/dL1mg/L), TG (17.7%/25%). TEa in 17 items were same one in 14 items with 82.35%. We found out the truth on increasing sigma level due to increased total error allowable, and were sure that the goal of setting total error allowable would affect the evaluation of sigma metrics in the process, if sustaining the same process.

  • PDF

MODFLOW or FEFLOW: A Case Study of Groundwater Model Selection for the Upper Waikato Catchment, New Zealand

  • Weir, Julian;Moore, Dr Catherine;Hadfield, John
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2011.05a
    • /
    • pp.14-14
    • /
    • 2011
  • Groundwater in the Waikatoregion is a valuable resource for agriculture, water supply, forestry and industries. The 434,000 ha study area comprises the upper Waikato River catchment from the outflow of Lake Taupo (New Zealand's largest lake) through to Lake Karapiro (a man-made hydro lake with high recreational value) (Figure 1). Water quality in the area is naturally high. However, there are indications that this quality is deteriorating as a result of land use intensification and deforestation. Compounding this concern for decision makers is the lag time between land use changes and the realisation of effects on groundwater and surface water quality. It is expected that the effects of land use changes have not yet fully manifested, and additional intensification may take decadesto fully develop, further compounding the deterioration. Consequently, Environment Waikato (EW) have proposed a programme of work to develop a groundwater model to assist managing water quality and appropriate policy development within the catchment. One of the most important and critical decisions of any modelling exercise is the choice of the modelling platform to be used. It must not inhibit future decision making and scenario exploration and needs to allow as accurate representation of reality as feasible. With this in mind, EW requested that two modelling platforms, MODFLOW/MT3DMS and FEFLOW, be assessed for their ability to deliver the long-term modelling objectives for this project. The two platforms were compared alongside various selection criteria including complexity of model set-up and development, computational burden, ease and accuracy of representing surface water-groundwater interactions, precision in predictive scenarios and ease with which the model input and output files could be interrogated. This latter criteria is essential for the thorough assessment of predictive uncertainty with third-party software, such as PEST. This paper will focus on the attributes of each modelling platform and the comparison of the two approaches against the key criteria in the selection process. Primarily due to the ease of handling and developing input files and interrogating output files, MODFLOW/MT3DMS was selected as the preferred platform. Other advantages and disadvantages of the two modelling platforms were somewhat balanced. A preliminary regional groundwater numerical model of the study area was subsequently constructed. The model simulates steady state groundwater and surface water flows using MODFLOW and transient contaminant transport with MT3DMS, focussing on nitrate nitrogen (as a conservative solute). Geological information for this project was provided by GNS Science. Professional peer review was completed by Dr. Vince Bidwell (of Lincoln Environmental).

  • PDF