• English Language & Literature Teaching
• /
• v.13 no.1
• /
• pp.235-259
• /
• 2007

The purpose of the present study is to develop a prototype automated scoring system for English writing. The system was developed for scoring writings of Korean middle school students. In order to develop the automated scoring system, following procedures have been applied. First, review and analysis of established automated essay scoring systems in other countries have been accomplished. By doing so, we could get the guidance for development of a new sentence-level automated scoring system for Korean EFL students. Second, knowledge base such as lexicon, grammar and WordNet for natural language processing and error corpus of English writing of Korean middle school students were established. Error corpus was established through the paper and pencil test with 589 third year middle school students. This study provided suggestions for the successful introduction of an automated scoring system in Korea. The automated scoring system developed in this study should be continuously upgraded to improve the accuracy of the scoring system. Also, it is suggested to develop an automated scoring system being able to carry out evaluation of English essay, not only sentence-level evaluation. The system needs to be upgraded for the improved precision, but, it was a successful introduction of an sentence-level automated scoring system for English writing in Korea.

• The Journal of Korean Association of Computer Education
• /
• v.10 no.2
• /
• pp.89-100
• /
• 2007

Scoring the constructed responses in large-scale assessments needs great efforts and time to reduce the various types of error in Paper-based training and scoring. For the purpose of eliminating the complexities and problems in Paper and pencil based training and scoring, many of countries including U.S.A and England already have applied online scoring system. There, however, has been few studies to develop the scoring system for the constructed responses items in Korea. The purpose of this study is to develop the basic design of the Internet-based scoring system for the constructed responses. This study suggested the algorithms for assigning scorers to constructed responses, employing methods for monitoring reliability, etc. This system can ensure reliable, quick scoring such as monitor scorer consistency through ongoing reliability checks and assess the quality of scorer decision making through frequent various checking procedures.

• The Korean Journal of Applied Statistics
• /
• v.18 no.3
• /
• pp.521-532
• /
• 2005

In the current College Scholastic Aptitude Test (CSAT), the standardized scoring system is being adopted to adjust te differences of degrees of difficulty between the optional subjects. But it becomes clear that the system has several weak points, some of which are considered to be very serious. In this paper we propose an alternative method, so-called the additive scoring system. It determines the additional points per each subjects, according to the subject mean scores. The proposed method has been simulated using the data of 2005' CSAT, and it turns out that the additive scoring system reduces or remove the troubles caused by the standardized scoring system.

• KIPS Transactions on Software and Data Engineering
• /
• v.5 no.11
• /
• pp.527-534
• /
• 2016

The emergent information society requires the talent for creative thinking based on problem-solving skills and comprehensive thinking rather than simple memorization. Therefore, the Korean curriculum has also changed into the direction of the creative thinking through increasing short-answer questions that can determine the overall thinking of the students. However, their scoring results are a little bit inconsistency because scoring short-answer questions depends on the subjective scoring of human raters. In order to alleviate this point, an automated scoring system using a machine learning has been used as a scoring tool in overseas. Linguistically, Korean and English is totally different in the structure of the sentences. Thus, the automated scoring system used in English cannot be applied to Korean. In this paper, we introduce an automated scoring system for Korean short-answer questions using predictability and unanimity. We also verify the practicality of the automatic scoring system through the correlation coefficient between the results of the automated scoring system and those of human raters. In the experiment of this paper, the proposed system is evaluated for constructed-response items of Korean language, social studies, and science in the National Assessment of Educational Achievement. The analysis was used Pearson correlation coefficients and Kappa coefficient. Results of the experiment had showed a strong positive correlation with all the correlation coefficients at 0.7 or higher. Thus, the scoring results of the proposed scoring system are similar to those of human raters. Therefore, the automated scoring system should be found to be useful as a scoring tool.

• Journal of the Korea Institute of Information Security & Cryptology
• /
• v.25 no.4
• /
• pp.921-932
• /
• 2015

We proposed a new scoring system on software vulnerabilities, which calculates quantitatively the severity of software vulnerabilities. The proposed scoring system consists of metrics for vulnerability severity and scoring equations; the metrics are designed to measure the severity of a software vulnerability considering the prevalence of the vulnerability, the risk level of the vulnerability, the domestic market share of the software and the frequency of the software. We applied the proposed scoring system to domestically reported software vulnerabilities, and discussed the effectiveness of the scoring system, comparing it with CVSS and CWSS. We also suggested the prospective utilization areas of the proposed scoring system.

• The Journal of Korean Medicine
• /
• v.23 no.4
• /
• pp.15-26
• /
• 2002

There is much confusion in the field of atopic dermatitis (AD) regarding how to best measuredisease severity objectively. Therefore, we aimed to establish a new adequate scoring system for AD, that should be based on comparisonand analysis of various scoring systems. We report as follows. Methods: We searched for data relating to severity scoring systems for atopic dermatitis in Entrez PubMed From 1990 to 2001 Results and Conclusions: 1. Properties of severity scoring systems were validity, reliability, sensitivity of change and ease of use. 2. The essential items of severity scoring systems were extent. intensity and subjective symptoms. 3. The surface extent of the lesion was evaluated by the percentage of involvement of each of 10 areas. 4. The criteria of severity were divided into intensity and subjective symptoms. Intensity items are erythema, papulation, lichenification, oozing, dryness, excoriations, and pigmentation. The subjective symptom is pruritus, evaluated according to sleep loss. 5. The significant items of severity scoring system were symptomsrather than areas. As it were, we assumed extent accounted for around 30% of each total score, with intensity and subjective symptoms representing 70%.

• The Mathematical Education
• /
• v.43 no.3
• /
• pp.309-314
• /
• 2004

A standardized scoring system for college interview entrance examination means we standardize the score of examination to adjust the degree of difficulty among questions and difference of panel's disposition. A standardized scoring system were newly enforced at college interview entrance examination from 2001. Colleges want to choose the most suitably qualified students, taking full advantage of interview examination. Also they should always prepare for questions, plan the answers and a standardized scoring system so that all candidates get a fair shake. The main purpose of this paper is to provide a standardized scoring system for interview examination. The results of interview examination are ranked from highest to lowest and each candidate have different rank from several panels. So some unit scores from panels are given for each candidate using standard normal distribution. Then we calculate the mean unit score for each candidate and final interview entrance examination scores are given using the mean unit score for each candidate.

• Journal of Power System Engineering
• /
• v.13 no.6
• /
• pp.102-109
• /
• 2009

A retarder, as a supplementary brake system that is not friction-based, is frequently used in heavy-duty vehicles generally to slow the vehicles down on inclines. The electric retarder mainly used in a heavy-duty bus is generally placed between the transmission and the axle. The rotor inside the retarder system is attached to the axle. The operation of the retarder within a driven vehicle generates reverse torque due to coast driving force on hypoid gears in the differential gear system. By the reverse torque, scoring or scuffing on the hypoid gear teeth may directly occur. The scoring may be generated due to excessive contact stresses on the tooth surface. In this study, tooth contact stresses and contact patterns were analysed in order to investigate on the tooth scoring phenomenon using a finite element analysis program T900 in which the Hertzian contact stress formula was taken. Backlash, wear and surface finish were considered in the finite element simulation on the scoring.

• International Journal of Quality Innovation
• /
• v.5 no.2
• /
• pp.1-16
• /
• 2004

Credit scoring is widely used to make credit decisions, to reduce the cost of credit analysis and enable faster decisions. However, traditional credit scoring models do not account for the influence of noises. This study proposes a robust credit scoring system based on Mahalanobis-Taguchi System (MTS). The MTS, primary proposed by Taguchi, is a diagnostic and forecasting method using multivariate data. The proposed approach's effectiveness is demonstrated by using real case data from a large Taiwanese bank. The results reveal that the robust credit scoring system can be successfully implemented using MTS technique.

• KIISE Transactions on Computing Practices
• /
• v.22 no.5
• /
• pp.218-224
• /
• 2016

This paper proposes a computer-based practical automatic scoring system for Korean short answers through student answer analysis and natural language processing techniques. The proposed system reduces the overall scoring time and budget, while improving the ease-of-use to write answer templates from student answers as well as the accuracy and reliability of automatic scoring system. To evaluate the application of the automatic scoring system and compare to the human scoring process, we performed an experiment using the student answers of social science subject in 2014 National Assessment of Educational Achievement.