Journal of Convergence for Information Technology (융합정보논문지)

Convergence Society for SMB (중소기업융합학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on the Analysis of Background Object Using Deep Learning in Augmented Reality Game

증강현실 게임에서 딥러닝을 활용한 배경객체 분석에 관한 연구

  • 김한호 (공주대학교 게임디자인학과) ;
  • 이동열 (공주대학교 게임디자인학과)
  • Received : 2021.10.07
  • Accepted : 2021.11.20
  • Published : 2021.11.28
Download PDF
⟨ Previous Next ⟩

Abstract

As the number of augmented reality games using augmented reality technology increases, the demands of users are also increasing. Game technologies used in augmented reality games are mainly games using MARKER, MARKERLESS, GPS, etc. Games using this technology can augment the background and other objects. To solve this problem, we want to help develop augmented reality games by analyzing objects in the background, which is an important element of augmented reality. To analyze the background in the augmented reality game, the background object was analyzed by applying a deep learning model using TensorFlow Lite in the UNITY engine. Using this result, we obtained the result that augmented objects can be placed in the game according to the types of objects analyzed in the background. By utilizing this research, it will be possible to develop advanced augmented reality games by augmenting objects that fit the background.

증강현실기술을 사용하는 증강현실 게임이 늘어남에 따라 사용자들의 요구도 많아지고 있다. 증강현실 게임에서 사용되는 게임 기술에는 MARKER, MARKERLESS, GPS등을 활용한 게임이 주를 이루고 있다. 이러한 기술을 활용한 게임은 배경과 다른 오브젝트를 증강할 수가 있다. 이 문제를 해결하기 위해 증강현실의 중요한 요소인 배경에서 객체를 분석하여 증강현실 게임을 개발하는데 도움을 주고자 한다. 증강현실 게임에서 배경을 분석하기 위해 UNITY엔진에서 TensorFlow Lite를 활용하여 딥러닝 모델을 적용하여 배경 객체를 분석하였다. 이 결과를 활용하여 배경에서 분석된 객체의 종류에 맞춰 게임에 증강되는 오브젝트를 배치 할 수 있다는 결과를 얻었다. 이 연구를 활용하여 배경에 맞는 오브젝트를 증강하여 향상된 증강현실 게임을 개발 할 수 있을 것이다.

Keywords

References

  1. J. E. Hwang, S. H. Lee, H. E. Kim, J. Seo & J.Min. (2012). A Preliminary Study on an User Created Content Framework for Mobile Augmented Reality. Proceeding of 2012 Confernce on the HCI Soriety of Koreal, 921-923.
  2. K. S. Won. (2010). Application Method of Image Restoration based on Augmented Reality to Museum Education. Journal Of The Korea Contents Association, 10(6), 205-212. https://doi.org/10.5392/JKCA.2010.10.6.205
  3. R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier & B. MacIntyre. (2001). Recent advances in augmented reality, IEEE Computer Graphics and Applications, 21(6), 33-47
  4. J. Han & S. Lee. (2017). Fake GPS Detection for the Online Game Service on Server-Side. Journal of the Korea Institute of Information Security & Cryptology, 27(5), 1069-1076. https://doi.org/10.13089/JKIISC.2017.27.5.1069
  5. W. Liu, B. Leibe, J. Matas, N. Sebe & M. Welling. (2016). SSD: Single Shot MultiBox Detector. In European conference on computer vision. (pp. 21-37). Springer, Cham.
  6. S. Park, U. N. Yoon & G. S. Jo. (2020). The Cut Transition Detection Model Using the SSD Method. Journal of KIISE, 47(7), 655-664. https://doi.org/10.5626/jok.2020.47.7.655
  7. J. Redmon, S. Divvala, R. Girshick & A. Farhadi. (2016). You only look once: Unified, real-time object detection, IEEE Conference on Computer Vision and Pattern Recognition(CVPR), (pp. 779-788)
  8. S. Ren, K. He, R. Girshick & J. Sun. (2016). Faster R-CNN: towards real-time object detection with region proposal networks. IEEE transactions on pattern analysis and machine intelligence, 39(6), 1137-1149. https://doi.org/10.1109/TPAMI.2016.2577031
  9. Google Inc. (n. d.). Tensorflow Lite. (Online) https://www.tensorflow.org/lite
  10. H. Y. Jo. (2020). A Development of Efficient RoadCrack Detection Model under Mobile Environment, Graduate School of Management of TechnologyPukyong National University. Busan.