• The Mathematical Education
• /
• v.57 no.1
• /
• pp.55-74
• /
• 2018

The purpose of this study is first to examine the relative influence of each error source and to investigate the optimal measurement conditions to ensure satisfactory multiple reliability coefficients based on the teaching aptitude and personality test for pre-service teachers. Participants were 33 students enrolled in mathematics education in a graduate school of education located in the Seoul metropolitan area from 2013 to 2017. The main results were as follows. First, the estimated variance due to residual was highest, followed by nesting of items within domains, graduate students, interactions of graduate students with domains, and domains. Second, total 96 items, with 12 domains containing 8 items in each domain, with cut score of 598, and original 210 items, with 14 domains containing 15 items in each domain, with cut scores of 615 or 716 were optimal measurement conditions to reach acceptable reliability levels based on the joint consideration of dependability coefficients, cut score dependability coefficients, adjusted dependability coefficients, and standard errors of measurement. Third, larger deviations between the arithmetic mean and the cut score indicated higher reliability coefficients of the test results. Finally, this study suggests ways for practitioners to consider how to apply generalizability theory for criterion-referenced tests and how to develop future research based on limitations.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.19 no.5
• /
• pp.323-330
• /
• 2018

This study examined the fairness of the teaching aptitude and personality test assigned to pre-service engineering teachers in a graduate school of education based on measurement traits. For this study, we analyzed the teaching aptitude and personality test scores of 99 students enrolled in engineering education in a graduate school of education located in the Seoul metropolitan area from 2013 to 2017. The main results were as follows. First, the estimated variance due to residual was generally the highest, followed by nesting of items within domains, pre-service engineering teachers, interactions of pre-service engineering teachers with domains, domains, and occasions. Second, dependability coefficients were better indicators than Cronbach's because the latter may have been overestimated by applying the traditional reliability coefficient in inappropriate manners. Third, the teaching aptitude and personality test can be applied to pre-service engineering teachers in a graduate school of education based on empirical evidence considering dependability coefficients. Fourth, a total of 96 items from the original 210 items, with 2 occasions and 12 domains containing 8 items in each domain, were optimal measurement conditions to reach adequate degrees of reliability based on the total number of items. Finally, the results were discussed, the study limitations described and future research directions proposed.

• The Mathematical Education
• /
• v.57 no.2
• /
• pp.179-196
• /
• 2018

The purpose of this study was to investigate the measurement equivalence and to suggest application ways in teaching aptitude and personality test results for pre-service mathematics teachers between a graduate school of education and a college of education. This study analyzed the scores of the teaching aptitude and personality test of 36 pre-service mathematics teachers enrolled in a graduate school of education and 111 pre-service mathematics teachers in a college of education by performing a multivariate generalizability analysis. The main results were as follows. First, graduate's pre-service mathematics teachers had a higher level of teaching aptitude and personality than that of college's pre-service mathematics teachers based on the total scores. In addition, graduate's pre-service mathematics teachers had higher levels of teaching aptitude and personality than those of college's pre-service mathematics teachers except for a creativity application domain based on the sub-domain scores. Second, cognitive domains were measured more precisely but affective domains were measured less precisely for graduate's pre-service mathematics teachers than for college's pre-service mathematics teachers. Third, regardless of school levels, Cronbach's ${\alpha}$ values, which might be overestimated by applying the classical test theory, were higher than dependability coefficients. Fourth, this study showed a somewhat negative result in ensuring the measurement equivalence for a problem solving exploration domain. However, regardless of school levels, this study indicated that the overall measurement was generally reliable on composite scores. Based on these results, it was confirmed that multivariate generalizability methodologies' approach can be useful for exploring the measurement equivalence issues. Finally, this study suggests how to utilize the results of the test, how to apply a multivariate generalizability analysis for detecting the measurement equivalence, and how to develop future research based on limitations.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.32 no.5B
• /
• pp.295-300
• /
• 2012

Reflection coefficients of wave due to the types of a submerged breakwater on the inclined incident wave are numerically computed by using boundary element method. The analysis method is based on the wave pressure function with the continuity in the analytical region including fluid and structures. When compared with the existing results on the inclined incident wave, the results of this study show good agreement. It is found that both maximum and minimum values of the reflection coefficient are appeared frequently, as the width of a submerged breakwater becomes wider, and the reflection coefficient increase, as the wave period is longer. In addition, the effect on the reflection coefficient due to the change of submerged breakwater hight is lager than that due to the change of submerged breakwater width. The results indicate that dissipating characteristics of wave due to the types of a submerged breakwater own high dependability regarding the change of inclined incident waves. Therefore, the results of this study is estimated to be applied as an accurate numerical analysis referring to inclined incident waves in real sea.

• Journal of Gifted/Talented Education
• /
• v.23 no.5
• /
• pp.671-695
• /
• 2013

This study provides an illustrative example of using the multivariate generalizability theory. Specifically, it investigates relative effects of each error source, and finds optimal measurement conditions for the number of items within each content domain that maximizes the reliability-like coefficients, such as a generalizability coefficient and an index of dependability. The method is based on teacher recommendation letters and self-introduction letters, using an analytic scoring method in the context of selection of mathematically gifted students by observation and nomination. This study analyzed data from the 2011 academic year in the science education institute for the gifted, which is attached to the university located in the Seoul metropolitan area. It should be noted that the optimal scoring structures of this study are not generalizable to other selection instruments. However, the methodology applied in this study can be utilized to find optimal measurement conditions for the number of raters, the number of content domains, and the number of items in other selection instruments self-developed by many institutions including: the education institutes for the gifted at provincial offices of education, gifted classes, and the science education institutes for the gifted attached to universities in general. In addition, the methodology will provide bases for making informed decisions in selection instruments of the gifted based on measurement traits.