DOI QR코드

DOI QR Code

Development of Dance Learning System Using Human Depth Information

인체 깊이 정보를 이용한 댄스 학습 시스템 개발

  • Received : 2017.12.10
  • Accepted : 2017.12.28
  • Published : 2017.12.31

Abstract

Human dance is difficult to learn since there is no effective way to imitate an expert's motion, a sequence of complicated body movements, without taking an actual class. In this paper, we propose a dance learning system using human depth information. In the proposed system, a set of example motions are captured from various expert dancers through a marker-free motion capture and archived into a motion database server for online dance lessons. Given the end-user devices such as tablet and kiosk PCs, a student can learn a desired motion selected from the database and send one's own motion to an instructor for online feedback. During this learning process, our system provides a posture-based motion search and multi-mode views to support the efficient exchange of motion data between the student and instructor under a networked environment. The experimental results demonstrate that our system is capable to improve the student's dance skills over a given period of time.

인체의 댄스 학습은 실제로 수업을 참여하지 않고는 복잡하고 연속적인 신체 움직임으로 이루어진 전문가의 동작을 효과적으로 따라 하기는 어렵다. 본 논문에서는 인체 깊이 정보를 이용한 댄스 학습 시스템을 제안하고 있다. 제안한 시스템에서는 마커 프리 동작 갭쳐를 활용하여 댄스 전문가들로부터 다양한 예제 동작들을 갭쳐하고, 온라인 댄스 레슨에 사용하기 위해 동작 데이터베이스에 저장한다. 학생은 타블렛이나 키오스크 PC와 같은 사용자 단말기를 통해 데이터베이스에서 원하는 동작을 선택하고, 학습한 후 자신의 동작을 온라인 피드백을 받기 위해 강사에게 전송할 수 있다. 이 학습 과정에서 본 시스템은 네트워크 환경에서 학생과 강사가 효율적으로 동작 데이터를 교환하기 위해 빠르게 동작을 검색할 수 있는 방법과 다중 모드 화면을 제공한다. 실험 결과에 따르면 본 시스템은 학생들의 댄스 스킬을 주어진 시간 안에 향상시킬 수 있다.

Keywords

References

  1. United Namtions Educational, Scientific and Cultural Organization (UNESCO). Intangible cultural heritage [Internet]. Available: https://ich.unesco.org/en/home/.
  2. S.-H. Lee and A.-R. Mo, "A Study on the Use of Sound Source in Music Education for Children," Journal of Digital Contents Society, Vol. 18, No. 3, pp. 509-516, June 2017. https://doi.org/10.9728/DCS.2017.18.3.509
  3. Dance Notation Bureau. Labanotation [Internet]. Available: http://www.dancenotation.org/.
  4. The Noa Eshkol Foundation for Movement Notation. Eshkol-Wachman Movement Notation (EWMN) [Internet]. http://noaeshkol.org/.
  5. TroikaTronicx. Isadora [Internet]. Available: https://troikatronix.com/.
  6. Credo Interactive. DanceForms 2 [Internet]. Available: http://charactermotion.com/products/danceforms/.
  7. Harmonix. Dance Central Spotlight [Internet]. Available: http://www.harmonixmusic.com/games/dance-central/.
  8. Ubisoft Entertainment. Just Dance Now [Internet]. Available: https://just-dance.ubisoft.com/en-us/home/.
  9. Microsoft. Kinect Camera Sensor [Internet]. Available: https://developer.microsoft.com/en-us/windows/kinect/.
  10. J. Chan, H. Leung, J. Tang, and T. Komura, "A Virtual Reality Dance Training System Using Motion Capture Technology," IEEE Transactions on Learning Technologies, Vol. 4, No. 2, pp. 187-195, April-June 2011. https://doi.org/10.1109/TLT.2010.27
  11. Y. Kim, S. Baek, and B.-C. Bae, "Motion Capture of the Human Body," ETRI Journal, Vol. 39, No. 2, pp. 181-190, April 2017. https://doi.org/10.4218/etrij.17.2816.0045
  12. A. Kitsikidis, K. Dimitropoulos, S. Douka, and N. Grammalidis, "Dance analysis using multiple kinect sensors," in Proceedings of the international conference on computer vision theory and applications, Lisbon, pp. 789-795.
  13. S. Hong and M. Kim, "A Framework for Human Body Parts Detection in RGB-D Image," Journal of Korea Multimedia Society, Vol. 19, No. 12, pp. 1927-1935, December 2016. https://doi.org/10.9717/kmms.2016.19.12.1927