Learning System for Scientific Experiments with Multi-touch Screen and Tangible User Interface

멀티 터치스크린과 실감형 인터페이스를 적용한 과학 실험 학습 시스템

  • 김준우 (한국기술교육대학교 산업경영학부) ;
  • 맹준희 (한국과학기술원 과학영재교육연구원) ;
  • 주지영 (한국과학기술원 과학영재교육연구원) ;
  • 임광혁 (배재대학교 전자상거래학과)
  • Received : 2010.06.01
  • Accepted : 2010.08.11
  • Published : 2010.08.28


Recently, Augmented Reality(AR) technologies have been emerged, which shows the types of digital contents integrating real and virtual worlds. To maximize the effect of AR technology, tangible user interface, which enables users to interact with the contents in the same way in which they manipulate objects in real world, is applied. In particular, we expect that the technologies are able to enhance learners' interests and degree of immersion, and produce new learning contents in order to maximize the effect of learning. In this paper, we propose a learning system for scientific experiments with multi-touch screen and tangible user interface. The system consists of an experiment table equipped with a large multi-touch screen and a realistic learning device that can detect the user's simple gestures. In real world, some scientific experiments involve high cost, long time or dangerous objects, but this system will overcome such hindrance and provide learners with a variety of experiment experience in realistic ways.


Tangible User Interface;Digital Learning Contents;E-Learning;Augmented Reality


  1. C. O'Malley and C. Fraser, Literature Review in Learning with Tangible Technologies, Technical report, NESTA Futurelab, 2004.
  2. 교육인적자원부, 한국교육학술정보원, 증강현실 기반 차세대 체험형 학습모형 연구, 연구보고 CR2006-18, 2006.
  3. 김용훈, 이수웅, 이준석, 노경희, “혼합현실기반 이러닝 기술동향", 전자통신동향분석, 제24권, 제1호, pp.90-100, 2009.
  4. B. Ullmer and H. Ishii, "Emerging Frameworks for Tangible User Interfaces," IBM Systems Journal, Vol.39, No.3-4, pp.915-931, 2000.
  5. 장상현, 계보현, “증강현실 콘텐츠의 교육적 적용”, 한국콘텐츠학회지, 제5권, 제2호, pp.79-85, 2007.
  6. O. Shaer and E. Hornecker, "Tangible User Interfaces: Past, Present and Future Directions," Foundations and Trends${\circledR}$ in Human-Computer Interaction, Vol.3, No.1-2, pp.1-137, 2009.
  7. M. Weiser, "The Computer for The 21st Century," Scientific American, Vol.265, No.3, pp.94-104, 1995.
  8. H. Ishii and B. Ullmer, "Tangible Bits: Towards Seamless Interfaces Between People, Bits, and Atoms," Proceedings of the ACM SIGCHI conference on Human factors in computing. pp.234-241, 1997.
  9. P. Milgram and F. Kishino, "A Taxonomy of Mixed Reality Visual Display," IEICE Transactions on Information and Systems, Vol.E77-D, No.12, pp.1321-1329, 1994.
  10. 한은정, 김기락, 정기철, “e-learning 환경을 위한 실감형 교육 컨텐츠 시스템”, 한국정보과학회 가을 학술발표논문집, 제31권, 제2호, pp.268-270, 2004.
  11. S. Price, Y. Rogers, M. Scaife, D. Stanton, and H. Neale, "Using 'Tangibles' to Promote Novel Forms of Playful Learning," Interacting with Computers, Vol.15, No.2, pp.169-185, 2003.
  12. H. Kaufmann and D. Schmalstieg, "Mathematics and Geometry Education with Collaborative Augmented Reality," Computers & Graphics, Vol.27, No.3, pp.339-345, 2003.
  13. M. Billinghurst, H. Kato, and I. Poupyrev, "The MagicBook: A Transitional AR Interface," Computers & Graphics, Vol.25, No.5, pp.745-753, 2001.
  14. Z. Zhou, A. Cheok, J. Pan, and Y. Li, "Magic Story Cube: An Interactive Tangible Interface for Storytelling," Proceedings of the 2004 ACM SIGCHI International conference on Advances in computer entertainment technology, pp.364-365, 2004.
  15. M. Billinghurst, R. Grasset, R. Green, and M. Haller, "Inventing the Future Down Under: The Human Interface Technology Laboratory New Zealand (HIT Lab NZ)," ACM SIGGRAPH Computer Graphics, Vol.39, No.2, pp.18-23, 2005.
  16. M. Fjeld, J. Fredriksson, M. Ejdestig, F. Duca, K. Botschi, B. Voegtli, and P. Juchli, "Tangible User Interface for Chemistry Education: Comparative Evaluation and Re-design," Proceedings of the SIGCHI conference on Human factors in computing, pp.805-808, 2007.
  17. 홍동표, 우운택, “제스처 기반 사용자 인터페이스에 대한 연구 동향", Telecommunications Review, 제18권, 제3호, pp.403-413, 2008.
  18. A. Wilson, and S. Shafer, "XWand: UI for Intelligence Spaces," Proceedings of the ACM conference on Human Factors in Computing Systems, pp.545-552, 2003.
  19. 김윤상, 소병석, 이상국, “A New Wearable Input Device: SCURRY," IEEE Transactions on Industrial Electronics, Vol.52, No.6, pp.1490-1499, 2005.
  20. K. Yatani, K. Tamura, K. Hiroki, M. Sugimoto, and H. Hashizume, "Toss-It: Intuitive Information Transfer Techniques for Mobile Devices," Proceedings of the ACM conference on Human Factors in Computing Systems, pp.1881-1884, 2005.
  21. 유종운, 정요원, 송용, 이주평, 임승호, 박기웅, 박규호, “iThrow: A New Gesture-Based Wearable Input Device with Target Selection Algorithm," Proceedings of the International conference on Machine Learning and Cybernetics, pp.2083-2088, 2007.
  22. IEEE 802.15.1 Specification, Wireless Medium Access Control and Physical Layer Specifications for Wireless Personal Area Networks, 2002.
  23. IEEE 802.15.4 Specification, Wireless Medium Access Control and Physical Layer Specification for Low Rate Wireless Personal Area Networks, 2003.
  24. 김수민, 정조운, 정병훈, 강민숙, 성단근, “Energy-Aware Communication Module Selection through ZigBee Paging for Ubiquitous Wearable Computers with Multiple Radio Interfaces," International Symposium on Wireless Pervasive Computing, pp.37-41, 2007.
  25. P. Baronti, P. Pillai, V. Chook, S. Chessa, A. Gotta, and Y. Hu, "Wireless Sensor Networks: a Survey on the State of the Art and the 802.15.4 and ZigBee Standards," Computer Communications, Vol.30, No.7, pp.1655-1695, 2007.
  26. 김진태, 권영미, “RFID와 ZigBee를 이용한 유비 쿼터스 u-Health 시스템 구현”, 전자공학회 논문지, 제43권, 제1호, pp.79-88, 2006.
  27. 최성철, 정우정, 김태호, 정규석, 김종헌, 이인성, “ZigBee 기반 네트워크의 확장을 위한 어드레스 방식과 라우팅 방법”, 한국콘텐츠학회논문지, 제9권, 제7호, pp.57-66, 2009.