• Proceedings of the Technology Innovation Conference
• /
• 1998.06a
• /
• pp.131-163
• /
• 1998

The interest in the evaluation of government-sponsored research institutes (GRIs) has increased markedly in Korea in 1990s; this is mainly because of the increasing needs 1) to improve the quality of R&D at GRIs, and 2) to reorient the GRIs' strategic position in Korean national innovation systems due to the enhancement of R&D capabilities of private companies and universities during last decade. As a first attempt to diagnose the managerial and strategic issues of GRIs, a Multi-Ministerial Evaluation Committee was established as an ad hoc task force under the Prime Minister's Office in 1991. According to the recommendations of the committee, the Ministry of Science and Technology (MOST) to which most of GRIs were affiliated, made it a rule to evaluate the annual performance of GRIs since 1992. This paper examines the recent experience of MOST's evaluation of Government-sponsored Research Institute in Korea. After several years'efforts of Science & Technology Policy Institute(STEPI) to build prospective evaluation systenL MOST decided to apply two supplementary approaches for the evaluation of GRIs; one is summative annual evaluation and the other is formative 3-year evaluation. The annual evaluation system that is designed as a temporary measure is to monitor and to guide the self-evaluation activities of GRIs. In the process of annual evaluation, MOST tries to minimize its direct involvement, and allows each GRI to develop self-evaluation system that is most appropriate for the unique characteristics of the institute. If there exist urgent issues under scrutiny, however, it can be incorporated and examined by a group of external experts as special issues in the annual evaluation system. The aim of 3-year evaluation is both to examine the past performance of each GRI and to investigate whether the strategic role of each GRI is viable in the future. Its major focus, however, lies not on auditing past performance but on strengthening future strategic position of each GRI. The MOST designates a group of evaluation experts with appropriate knowledge and competence as members of the General Evaluation Committee for one year. With the help of STEPI, a specialized research institute for R&D evaluation, the General Evaluation Committee develops methodology and procedures for the actual evaluation of GRIs. Based on the evaluation reports and recommendations from the General Evaluation Committee, the MOST develops various policy measures for strengthening GRIs.

• Korean Medical Education Review
• /
• v.24 no.3
• /
• pp.250-260
• /
• 2022

Evaluating the effectiveness of educational programs involves measuring learning processes as well as outcomes. It is essential to study cohorts of students and graduates to evaluate the long-term effects of educational programs with data generated both during education and after graduation. The purpose of this study was to establish cohorts of students and graduates to evaluate their performance, thereby providing a basis for evaluating the social accountability of medical education. In this study, student and graduate cohorts were built for both students currently enrolled and graduates at Inje University College of Medicine (IUCM). A model involving the process of cohort establishment and an evaluation indicator framework was developed. In the process of cohort establishment, the following steps were conducted: defining the goals and objectives of the student and graduate cohorts, organizing a cohort committee, developing regulations, registering cohorts, acquiring consent, and building a database. A framework of evaluation indicators according to the graduate roles of IUCM was developed by adapting Kirkpatrick's evaluation model. Next, items to be collected in student and graduate cohorts were selected, and the current status of existing data was analyzed. Moreover, a preliminary analysis was conducted, including analyses of the evaluation indicators and graduates' performance. This study suggests that it is necessary to include additional evaluation indicators considering students' learning environment and well-being in student cohorts and to develop strategies or methods for graduates to continue participating in data collection for a long-term study.

• Knowledge Management Research
• /
• v.10 no.1
• /
• pp.71-100
• /
• 2009

Recently, many of organizations build up their performance measurement system (PMS) to measure their knowledge management performance. However, the system that doesn't well reflect the organization's strategies as well as surroundings could obstruct their performance improvement, instead. Therefore, It is really important to establish the PMS to reflect organization's surroundings and strategies. The purpose of this study is to make a diagnosis of a performance measurement practice of a domestic university's knowledge management. To serve this research purpose, we examine the uptight performance index and PMS from existing references. And we diagnose the specific practices and maturity rates of measuring performances, and the recognition of the performance index at "D" university recently adopting balanced scorecard to performance evaluation through the survey on academic affairs committee members, performance evaluation committee members, and administration members. The method analyzing data from the survey is a gap analysis which includes alignment analysis, congruence analysis, consensus analysis, and confusion analysis. We make a diagnosis of performance measurement practices at "D" university, raise several points of this performance measurement system, and present the improvement plans from these problems.

• Korean Medical Education Review
• /
• v.25 no.2
• /
• pp.126-131
• /
• 2023

The aim of this study was to systematically collect data for evaluating short- and long-term outcomes using Kirkpatrick's four-level evaluation model, Chonnam National Medical School has established plans for developing and managing a database of student and graduate cohorts. The Education Evaluation Committee, with assistance from the Medical Education Office, manages the development and maintenance of cohort data. Data collection began in the 2022 academic year with first- through fourth-year medical students and graduates of the year 2022. The collected data include sociodemographic characteristics, admission information, psychological test results, academic performance data, extracurricular activity data, scholarship records, national medical licensing exam results, and post-graduation career paths. The Education Evaluation Committee and the Medical Education Office analyze the annually updated student and graduate cohort data and report the results to the dean and relevant committees. These results are used for admissions processes, curriculum improvement, and the development of educational programs. Applicants interested in using the student and graduate cohort data to evaluate the curriculum or conduct academic research must undergo review by the Educational Evaluation Committee before being granted access to the data. It is expected that the collected data from student and graduate cohorts will provide a sound and scientific basis for evaluating short- and long-term achievements based on student, school, and other characteristics, thereby supporting medical education policies, innovation, and implementation.

• Convergence Security Journal
• /
• v.16 no.1
• /
• pp.13-21
• /
• 2016

At the present moment when around 60 years have passed after the introduction of private security, there are security instructor and protection specialist guard as government official recognition qualification. This study discussed problems of secondary performance test system among qualification certification items which have been implement ed as government official recognition qualification since 2013. Current qualification certification for protection specialist guard is composed of primary academic test and secondary performance test. Since it is estimated that it is high time to increase clients' satisfaction and public reliability through strict qualification certification for protection specialist guard. Following improvement plans are intended to suggest. First, it is a plan to divide and diversify difficulties of performance test evaluation events. Second, it is a plan to diversify evaluation criteria of performance test. Third, it is a plan to make criteria for selecting specialized performance test evaluation committee. Fourth, it is a new plan of exclusion system to avoid any relation between performance test evaluation committee and applicants. In this respect, institutional improvement should be followed in order to improve specialty of qualification certification of performance test system for protection specialist guard.

• Proceedings of the Korea Committee for Ocean Resources and Engineering Conference
• /
• 2001.10a
• /
• pp.86-90
• /
• 2001

Demand of good seakeeping perfomace is increasing for sea going vessels such as cruisers, naval ships and container ships. Especillay roll motion is one of major concerns in evaluation of seakeeping performance due to its large resonace motion. Since large roll resonance motion is mainly arised from inherent small damping. use of additional mechnism to provide roll damping can significantly reduce roll motion. In this paper, a reliable performace evaluation method of fin stabilizer, which is very useful for stabilizing roll motion of mid and high speed vessls, is described. Model test and time domain simulation methods are adopted for performance evaluation in which real operating situation of fin stabilizer can be exactly modelled. Model test and simulation results show good correlations between model test and simulation results.

• Korean Medical Education Review
• /
• v.25 no.2
• /
• pp.114-118
• /
• 2023

Multiple cohorts (e.g., current students and graduates) were formed to collect information on the entire educational process from admission to graduation regarding students' educational performances at Kosin University College of Medicine. Data that had already been collected and analyzed by different committees for different purposes were grouped into a more systematic and comprehensive system called the cohort system, enabling the necessary data to be collected promptly and analyzed in accordance with the purpose of providing meaningful information in each area of the educational process. Therefore, comprehensive cohort data that can be used for mission statement revision, curriculum development and improvement, student counseling, and student selection were established and utilized. The cohort data were collected from performance evaluation indicators including self-evaluation surveys, evaluation tools for learning outcomes, academic achievement, results of the Korean Medical Licensing Examination, and career placement. Based on the results obtained by analyzing cohort data, a comprehensive cohort report has been published. The data analyzed through the cohort were reported to each committee and used in various ways. Currently, however, only some data have been analyzed and used. In the future, after complete data collection, the cohort data can be used as meaningful basic data for achieving the institution's mission and educational goals, developing and improving the curriculum, counseling students, and selecting students through the analysis of learning performance data from student admission to graduation and after graduation.

• Korean Medical Education Review
• /
• v.15 no.3
• /
• pp.112-119
• /
• 2013

Most medical colleges in Korea have been shifting from traditional education to outcome-based education, which is the general trend in medical education. The purpose of this study was to make some suggestions in light of the reality and challenges of student assessment in medical education from the perspective of outcome- based education. First, those who are responsible for student assessment should be diversified to include faculty, residents, students, and evaluation committee members. They need separate roles in educational evaluation, so evaluation competencies are required for them. Second, various methods for evaluation and score interpretation can be used for effective evaluation. We can adopt diagnostic, formative, and summative evaluation functionally, and the norm-referenced, criterion-referenced, growth-referenced, and ability-referenced evaluation based on criteria for score interpretation. Finally, various evaluation domains and test forms can be administered together in the common lectures in the medical school. We can test not only knowledge but also skills and attitudes, with diverse test forms such as supply and performance types.

• Proceedings of the Korea Committee for Ocean Resources and Engineering Conference
• /
• 2006.11a
• /
• pp.277-280
• /
• 2006

Most real world design evaluation and risk-based decision support combine quantitative and qualitative (linguistic) variables. Decision-making based on conventional mathematics that combines qualitative and quantitative concepts always exhibit difficulty in modelling actual problems. The successful selection process for choosing a design/procurement proposal is based on a high degree of technical integrity, safety levels and low costs in construction, corrective measures, maintenance, operation, inspection and preventive measures. However, the objectives of maximising the degree of technical performance, maximising the safety levels and minimising the costs incurred are usually in conflict, and the evaluation of the technical performance, safety and costs is always associated with uncertainties, especially for a novel system at the initial concept design stage. In this paper, a design-decision support framework using a composite structure methodology grounded in approximate reasoning approach and evidential reasoning method is suggested for design evaluation of machinery space of a ship engine room at the initial stages. It is a Multiple Attribute Decision-Making (MADM) or Multiple Criteria Decision Making (MCDM) framework, which provides a juxtaposition of cost, safety and technical performance of a system during evaluation to assist decision makers in selecting the winning design/procurement proposal that best satisfies the requirement in hand. An illustrative example is used to demonstrate the application of the proposed framework.

• Journal of Korean Society of Water and Wastewater
• /
• v.24 no.5
• /
• pp.617-628
• /
• 2010

The operation performance of sewer rehabilitation projects conducted with Build-Transfer- Lease contract in Korea will be evaluated using the index of infiltration and inflow (I/I). Though I/I obtained at the fourth year should be initially evaluated based on the I/I values observed for the previous three years after the completion of sewer construction, the concrete methodology have not been proposed to rely on the so called 'performance evaluation committee'. This study suggests two statistical methodology to evaluate the I/I performance; the confidence interval method and the hypothesis-testing method. Assumed ten I/I values in each year for 20 years are used in this study. Two cases are analyzed and compared; case I to use as control data all I/I values for all years obtained before the evaluation year and case II to use I/I values for only 3 years before the evaluation year. As a result, case II tends to have relatively higher scores than case I, reflecting the low mean I/I values at the initial years.