Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

Multisensory based AR System for Education of Cultural Heritage

  • Jeong, Eunsol (Dept. of Cultural Heritage industry, Korea National University of Cultural Heritage) ;
  • Oh, Jeong-eun (Dept. of Cultural Heritage industry, Korea National University of Cultural Heritage) ;
  • Won, Haeyeon (Dept. of Cultural Heritage industry, Korea National University of Cultural Heritage) ;
  • Yu, Jeongmin (Dept. of Cultural Heritage industry, Korea National University of Cultural Heritage)
  • Received : 2019.10.25
  • Accepted : 2019.11.20
  • Published : 2019.11.29
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a multisensory(i.e., visual-auditory-tactile) based AR system for the education of cultural heritage. The proposed system provides a multisensory interaction by designing a user to experience with a 3D printed artifact which is mapped by a virtual 3D content of digital heritage. Compared with the existing systems of cultural heritage education based on augmented reality(AR) technology, this system focused on not only providing learning experience via a sense of visual and auditory, but also a sense of tactile. Furthermore, since this systems mainly provided the direct interactions using a 3D printed model, it gives a higher degree of realism than existing system that use touch or click motions on a 2D display of mobile phones and tablets. According to a result of user testing, we concluded that the proposed system delivered the excellent presence and learning flow to users. Particularly, from the usability evaluation, a 3D printed target artifact which is similar in shape to original heritage artifact, achieved the highest scores among the various tested targets.

본 연구에서는 문화유산 교육을 위한 다중 감각 (시각 청각 촉각) 지원 기반 증강현실 시스템을 제안한다. 제안된 시스템에서는 3D프린트 된 유사유물 모델을 AR 타깃으로 활용하고, 증강하는 가상객체에는 실제유물 기반으로 구현된 3D그래픽을 매핑한다. 사용자는 3D프린트 된 모델의 촉감을 느끼면서 AR유물학습을 진행할 수 있어 다중 감각을 통한 상호작용을 경험하게 된다. 기존 문화유산 교육 시스템과 비교했을 때 본 시스템은 시각 및 청각뿐만 아니라 촉각을 제공하는데 중점을 두고 설계되었다. 또한 이 시스템은 3D모델을 사용하여 직접적인 상호작용을 제공하여, 주로 휴대전화와 태블릿의 2D 디스플레이에 터치 또는 클릭 모션으로 상호작용하는 기존 시스템보다 훨씬 사실적인 경험을 주도록 구성되었다. 사용자 테스트 결과에 따르면 본 유물교육시스템은 사용자에게 우수한 현존감 및 학습 몰입감을 제공하였으며, 타깃의 사용성 평가에서는 본래 유물과 모양이 유사한 3D 프린트 된 타깃의 사용성이 가장 좋게 평가되었다.

Keywords

References

  1. Jiyeon Yang, "Collections Use and the Educational Roles of Open Storage", Korean journal of culture and arts education studies, Vol. 9, No. 4, pp. 1-23, August 2014. DOI: 10.15815/kjcaes.2014.9.4.1
  2. Jeongeun Lee, and Goun Choi, "A critical review of object-based learning and generic learning outcomes in museum education in Korea", Korean journal of culture and arts education studies, Vol. 9, No. 5, pp. 41-58, December 2014. DOI: 10.15815/kjcaes.2014.9.5.41
  3. SoYoung Jeong, "Analysis of Augmented Reality-Based Museum APP Contents Types", Korean Society of Basic Design & Art, Vol.20, No. 2, pp.386-396, March 2019.
  4. Sunae Oh, and Jiyeon Gong, "The Study on the Environmental Elements of Exhibitions Applied the Flow Theory in the Museum - Focused on Visitors of the Experience Exhibitions", Journal of Digital Design, Vol. 11, No. 3, pp.143-152, November 2011. DOI: 10.1728 0/jdd.2011.11.3.014 https://doi.org/10.17280/jdd.2011.11.3.014
  5. Deokman Kim, and Junhong Park, "Vibration Feedback at Virtual Position in a Beam using Wave Propagation Approach", The Korean Society of Mechanical Engineers, pp. 1474-1475, December 2018.
  6. WooSang Kim, and Ken Nah, "A Study on Contents Design of Virtual and Augmented Reality Reflecting Presence", JOURNAL OF THE KOREAN SOCIETY DESIGN CULTURE, Vol. 23, No. 3, pp.139-153, September 2017. DOI: 10.18208/ksdc.2017.23.3.139
  7. Nayeong Jung, Wonjoo Hwang, Siwoo Kang, Jeongsep Lee, Minho Kyung, "Haptic Intonation learning system for learning Chinese", EXTENDED ABSTRACTS OF HCI KOREA 2016, pp.277-279, January 2016.
  8. Jong-Mun Jeon, and Hyung-Jeong Yang, "Multi-modal Sense based Interface for Augmented Reality in Table Top Display", JOURNAL OF KOREA MULTIMEDIA SOCIETY, Vol.12, No.5, May 2009.
  9. Junhun Lee, and Taejin Ha, and Jeha Ryu, and Woontack Woo, "Development of Pen-type Haptic User Interface and Haptic Effect Design for Digilog Book Authoring", Proceedings of HCI KOREA 2019, pp.402-405, February 2009.
  10. Jin-Ok Park, "Subjectivity study on the from of the virtual reality contents user experience", Journal of Digital Contents Society, Vol. 20, No. 2, pp.395-403 February 2019. DOI: 10.9728/dcs.2019.20 .2.395
  11. Jenifer Tidwell, "Designing Interfaces: Patterns for Effective Interaction Design", O'Reilly book, 2005.
  12. Taejin Ha, and Yeongmi Kim, and Jeha Ryu, and Woontack Woo, "Methodologies for Enhancing Immersiveness in AR-based Product Design", Journal of the Institute of Electronic Engineers of Korea-CI, Vol. 44, No. 2, pp.37-46, March 2007.
  13. Miheon Jo, Jeonghye Han, Eunja Hyun "The Development of Robot and Augmented Riality Based Contents and Instructional Model Supporting Childrens' Dramatic Play", Journal of The Korean Association of Information Education Vol. 17, No. 4, December 2013, pp. 421-432. DOI: 10.14352/jkaie.2013.17.4.421
  14. Junghoon Leem, and Byungro Lim, and Eunmo Sung, "Developmental Study on the Quality Certification Standards of Smart Education Contents", The Journal of Educational Information and Media, Vol 20, No 3, pp.327-353, September 2014. DOI: 10.15833 /KAFEIAM. 20.3.327
  15. National Research Institute of Maritime Cultural Heritage, "Taean Mado Shipwreck No.2 Underwater Excavation", National Research Institute of Maritime Cultural Heritage, 2011.
  16. Hyon-jeong An. "A Study on Aesthetics of 'Flower Pattern' in Korean Ceramic History -Focusing on Korean National Treasures", Korea Society of Floral Art & Design, Vol. 30, pp. 133-157, June 2014.
  17. Sunhee Kim, "A study on the making celadon flower vase-Focused on the celadon design excavated in Gangjin area", DankookUniversity, 2006.
  18. Goryeo Celadon Museum, http://www.celadon.go.kr/dorok/boardList.do?menuId=celadon0404010000
  19. Seoul Historiography Institute, https://history.seoul.go.kr/nuri/bbs/bbs.php?sub_type=view&b_idx=336&didx=125
  20. Eunju Lee, and Sungsil Park. "A Case Study on the Change of Names for Important Folklore Materials and Remains - Based on the Material No. 37, the Excavated Costume from Ihyujeong's Collection in Ulsan-", Journal of the Korean Society of Costume, Vol. 55, No. 6s, pp.107-120, December 2005.
  21. K-Heritage tv, http://www.k-heritage.tv/brd/board/229/L/CATEGORY/2378/menu/372?brdCodeField=CATEGORY&brdCodeValue=2378&bbIdx=12564&brdType=R
  22. Csikszentmihalyi, M, "Flow: The Psychology of Optimal Experience", Harper and Row, Harper Perennial Modern Classics, 2008.
  23. Heejeon Seo, "Relationships among Presence, Learning Flow, Attitude toward Usability, and Learning Achievement in an Augmented Reality Interactive Learning Environment", Korean Association For Educational Information and Media, Vol.14, No.3, September 2008.