Fair Assessment Method Reflecting Individual Ability in Capstone Design Course

캡스톤 디자인 수업에서 개인 능력을 반영하는 공정한 평가 방법

  • Kim, Jongwan (Division of Computer and Information Engineering, Daegu University)
  • 김종완 (대구대학교 컴퓨터정보공학부)
  • Received : 2019.01.03
  • Accepted : 2019.02.16
  • Published : 2019.03.31

Abstract

Capstone design is a subject taught in a setting where students gather in a team, decide on their own selected topic, and collaborate with one another to perform a project. A fair assessment is very important in a team project-based capstone design course for students. Many instructors agree that harmonizing creative evaluation and outcome assessment is hard in capstone design class. In also, it is not easy to assess students' individual efforts and achievements fairly in accordance with team-based assessment practices. To resolve this issue in this paper, we have surveyed various engineering design education methodologies, and have modelled existing evaluating elements into a modified creative process and outcome assessment framework for team project assessment. In particular, we focused on a method of fairly assigning credits by combining team based and individual-level assessments. Analyzing students' achievement and grade evaluation and verifying the validity of the proposed method was performed.

KHKOCH_2019_v22n2_36_f0001.png 이미지

Fig. 1 Modified creative process and outcome assessment framework in engineering design course

KHKOCH_2019_v22n2_36_f0002.png 이미지

Fig. 2 Key features of completed prototype and attachment to vehicle

Table 1 Assessment traits and decision criteria in the brainstorming phase

KHKOCH_2019_v22n2_36_t0001.png 이미지

Table 2 Assessment traits and decision criteria in the building phase

KHKOCH_2019_v22n2_36_t0002.png 이미지

Table 3 Assessment traits and decision criteria in the demonstration phase

KHKOCH_2019_v22n2_36_t0003.png 이미지

Table 4 Individual assessment traits and decision criteria

KHKOCH_2019_v22n2_36_t0004.png 이미지

Table 5 Statistics for the survey taken after final presentation

KHKOCH_2019_v22n2_36_t0005.png 이미지

Table 6 Statistical comparison of survey in 2014 and 2016

KHKOCH_2019_v22n2_36_t0006.png 이미지

Table 7 Correlation matrix for 3 grading components in 2014 class

KHKOCH_2019_v22n2_36_t0007.png 이미지

Table 8 Correlation matrix for 3 grading components in 2015 class

KHKOCH_2019_v22n2_36_t0008.png 이미지

Table 9 Correlation matrix for 3 grading components in 2016 class

KHKOCH_2019_v22n2_36_t0009.png 이미지

Table 10 Individual grading for each team in 2016 class

KHKOCH_2019_v22n2_36_t0010.png 이미지

Acknowledgement

Supported by : Daegu University

References

  1. Horowitz, R. (2001). From TRIZ to ASIT in 4 steps. https://triz-journal.com/triz-asit-4-steps/
  2. Hwang, S. (2016). Relationship between Peer- and Self-Evaluation in Team Based Learning Class for Engineering Students. Journal of Engineering Education Research. 19 (5), pp. 3-12.
  3. Kilpatrick, D.J. et al. (2001). Procedural justice and the development and use of peer evaluations in business and accounting classes. Journal of Accounting Education. 19 (3), pp. 225-246. https://doi.org/10.1016/S0748-5751(01)00021-5
  4. Kim, J. (2014). An assessment method to evaluate team project based engineering design. Proc. of Int'l Conf. on Computer Science & Education, pp.257-260.
  5. Kim, J. (2016). A Team Project Based Assessment Method for Engineering Design Course. International Journal of Multimedia and Ubiquitous Engineering. 11 (6), pp. 159-170. https://doi.org/10.14257/ijmue.2016.11.10.15 https://doi.org/10.14257/ijmue.2016.11.10.15
  6. Kim, J. (2018). Fair Assessment for Team Project Engineering Design Course. Convergence Research Letter. 4 (4), pp. 201-204.
  7. Kim, J.H. (2018). A Mathematical Model for Balanced Team Formation in Capstone Design Class. Journal of Engineering Education Research. 21 (4), pp. 28-34.
  8. Lee, H. W., Kim, S. H., Park, K. & Kim, J. Y. (2010). A Study on the Assessment of Program Outcomes Based on Capstone Design Course. Journal of Engineering Education Research. 13 (6), pp. 143-151. https://doi.org/10.18108/jeer.2010.13.6.143
  9. Mourtous, N. (2012). Defining, teaching, and assessing engineering design skills. Int'l Journal for Quality Assurance in Engineering and Technology Education. 2 (1), pp. 14-30. https://doi.org/10.4018/ijqaete.2012010102 https://doi.org/10.4018/ijqaete.2012010102
  10. Ogot, M. & Okudan, G. E. (2006). Integrating systematic creativity into first-year engineering design curriculum. International Journal of Engineering Education. 22 (1), pp. 109-115. https://www.ijee.ie/articles/Vol22-1/IJEE1618.pdf
  11. Park, Y. (2016). Creative Thinking Theory. Korea Standards Association Media, Seoul, Korea.
  12. Platanitis, G. & Pop-Iliev, R. (2010). Establishing fair objectives and grading criteria for undergraduate design engineering project work: an ongoing experiment. International Journal of Research and Reviews in Applied Sciences. 5 (3), pp. 271-288. http://www.arpapress.com/Volumes/Vol5Issue3/IJRRAS_5_3_09.pdf
  13. Schwab, K. (2017). The Fourth Industrial Revolution. Penguin Books, Limited.
  14. Walvoord, B. E. & Anderson, V. J. (1998). Effective Grading: A Tool for Learning and Assessment. Jossey-Bass Inc., San Francisco, CA.
  15. Young, S. F. & Wilson, R. J. (2000). Assessment and Learning: The ICE Approach. Portage & Main Press, Winnipeg, Canada.