DOI QR코드

DOI QR Code

원격협업 시스템에서 협력자 눈 시점 공유

Sharing Eye Gaze in Mixed Reality Remote Collaboration System

  • 정재준 (전남대학교 소프트웨어공학과) ;
  • 김승원 (전남대학교 인공지능학부)
  • 투고 : 2022.07.12
  • 심사 : 2022.08.01
  • 발행 : 2022.07.31

초록

본 논문은 원격협업 시스템에서 시각적 의사소통 도구인 눈 시점 포인터 공유의 장점을 알아보았다. 특히 원격 협력자의 손동작이 가상 손으로 공유될 때, 추가로 공유된 원격 협력자의 시점 포인터가 미치는 영향을 조사하였다. 24명의 피실험자가 참여한 사용자 실험에서, 추가된 원격 협력자의 눈 시점 포인터는 현지 협력자와 원격 협력자 모두의 작업 부하를 줄여주었으며 두 협력자 간 co-presence를 높여주었다.

This paper explored the effect of using eye gaze pointer in addition to the hand gesture visual communication cue in remote collaboration. We recruited 24 participants and conducted a user study comparing two conditions: (1) only hand gesture visual communication cue, and (2) eye gaze pointer with hand gesture visual cue. The results showed that the added eye gaze pointer cue reduced the workload and increased the co-presence when using it together with hand gesture cue.

키워드

과제정보

이 논문은 2022년도 정부(과학기술정보통신부)의 재원으로 정보통신기획평가원의 지원(No. 2022-0-00874)과 2022년도 정부(교육과학기술부)의 재원으로 한국연구재단의 지원을 받아 수행된 연구임 (NRF-2020R1A4A1019191)

참고문헌

  1. 방준성 외, "가상현실/증강현실 원격 협업 기술 동향," 전자통신동향분석, 제32권, 제6호, 96-104쪽, 2017년 12월
  2. Kim, S., Billinghurst, M., and Kim, K., "Multimodal interfaces and communication cues for remote collaboration," Journal on Multimodal User Interfaces, Vol. 14, No. 4, pp. 313-319. Oct. 2020. https://doi.org/10.1007/s12193-020-00346-8
  3. Kim, S., Jing, A., Park, H., Lee, G. A., Huang, W., and Billinghurst, M., "Hand-in-air (hia) and hand-on-target (hot) style gesture cues for mixed reality collaboration," IEEE Access, Vol. 8, pp. 224145-224161, Dec. 2020. https://doi.org/10.1109/ACCESS.2020.3043783
  4. S. Kasahara and J. Rekimoto, "JackIn: Integrating First-Person View with Out-Of-Body Vision Generation for Human-Human Augmentation," Proc. 5th Augmented Human International Conference, pp. 1-8, Kobe, Japan, Mar. 2014.
  5. G. A. Lee, T. Teo, S. Kim and M. Billinghurst, "A user study on MR remote collaboration using live 360 video," Proc. 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 153-164, Munich, Germany, Oct. 2018.
  6. S. Kim, G. A. Lee and N. Sakata, "Comparing pointing and drawing for remote collaboration," Proc. 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 1-6, Adelaide, SA, Australia, Oct. 2013.
  7. S. Kim, M. Billinghurst, C. Lee and G. Lee, "Using freeze frame and visual notifications in an annotation drawing interface for remote collaboration," KSII Transactions on Internet and Information Systems (TIIS), Vol. 12, No. 12, pp. 6034-6056, Dec. 2018. https://doi.org/10.3837/tiis.2018.12.023
  8. S. Kim, G. Lee, M. Billinghurst and W. Huang, "The combination of visual communication cues in mixed reality remote collaboration," Journal on Multimodal User Interfaces, Vol. 14, No. 4, pp. 321-335, Jul. 2020. https://doi.org/10.1007/s12193-020-00335-x
  9. S. Kim, G. Lee, N. Sakata and M. Billinghurst, "Improving co-presence with augmented visual communication cues for sharing experience through video conference," Proc. 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 83-92, Munich, Germany, Nov. 2014.
  10. G. Lee, S. Kim, Y. Lee, A. Dey, T. Piumsomboon et al., "Improving Collaboration in Augmented Video Conference using Mutually Shared Gaze," Proc. ICAT-EGVE '17: Proceedings of the 27th International Conference on Artificial Reality and Telexistence and 22nd Eurographics Symposium on Virtual Environments, pp. 197-204, Adelaide, Australia, Nov. 2017.
  11. S. Kim, G. Lee, W. Huang, H. Kim, W. Woo, & M. Billinghurst, "Evaluating the combination of visual communication cues for HMD-based mixed reality remote collaboration," In Proceedings of the 2019 CHI conference on human factors in computing systems, pp. 1-13, May. 2019.
  12. H. Bai, P. Sasikumar, J. Yang, & M. Billinghurst,, "A user study on mixed reality remote collaboration with eye gaze and hand gesture sharing," In Proceedings of the 2020 CHI conference on human factors in computing systems, pp. 1-13, Apr. 2020.
  13. Hart, S. G., and Staveland, L. E., "Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research," Advances in psychology, Vol. 52, pp. 139-183, 1988. https://doi.org/10.1016/S0166-4115(08)62386-9
  14. Harms, C., & Biocca, F., "Internal consistency and reliability of the networked minds measure of social presence," Seventh annual international workshop: Presence, Vol. 2004. Universidad Politecnica de Valencia, Valencia, Spain, 2004.