Journal of the Korea Institute of Information and Communication Engineering (한국정보통신학회논문지)

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Real-time transmission of 3G point cloud data based on cGANs

cGANs 기반 3D 포인트 클라우드 데이터의 실시간 전송 기법

  • Shin, Kwang-Seong (Department of Digital Contents Engineering, Wonkwang University) ;
  • Shin, Seong-Yoon (Department of Computer Information Engineering, Kunsan National University)
  • Received : 2019.09.30
  • Accepted : 2019.10.10
  • Published : 2019.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

We present a method for transmitting 3D object information in real time in a telepresence system. Three-dimensional object information consists of a large amount of point cloud data, which requires high performance computing power and ultra-wideband network transmission environment to process and transmit such a large amount of data in real time. In this paper, multiple users can transmit object motion and facial expression information in real time even in small network bands by using GANs (Generative Adversarial Networks), a non-supervised learning machine learning algorithm, for real-time transmission of 3D point cloud data. In particular, we propose the creation of an object similar to the original using only the feature information of 3D objects using conditional GANs.

Keywords

Acknowledgement

This work was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT). (No. NRF- 2019R1G1A1087290)

References

  1. Computer Hope-telepresence [Internet]. Available: https://www.computerhope.com/jargon/t/telepresence.htm.
  2. Medium Medium : new farmer - 3D points clouds for immersive real estate and telepresence experiences [Internet]. Available: https://medium.com/new-farmer/3dpoints-clouds-for-immersive-real-estate-and-telepresence-experiences-5cbdb03898b.
  3. R. B. Rusu, and S. Cousins, (2011, May). "Point cloud library (pcl)," In 2011 IEEE International Conference on Robotics and Automation (pp. 1-4).
  4. Y. H. Seo, H. J. Choi, and D. W. Kim, (2006). "Lossy coding technique for digital holographic signal," Optical Engineering, 45(6), 065802. https://doi.org/10.1117/1.2215387
  5. Peixeiro, J. P. Kim, C. Brites, J. Ascenso, and F. Pereira, (2018). "Holographic data coding: Benchmarking and extending hevc with adapted transforms," IEEE Transactions on Multimedia, 20(2), 282-297. https://doi.org/10.1109/TMM.2017.2742701
  6. E. Darakis, and T. J. Naughton, (2009, May). "Compression of digital hologram sequences using MPEG-4," In Holography Advances and Modern Trend, International Society for Optics and Photonics.s (vol. 7358, pp. 735811).
  7. P. Isola, J. Y. Zhu, T. Zhou, and A. A. Efros, "Image-to-Image Translation with Conditional Adversarial Networks," Berkeley AI Research (BAIR) Laboratory University of California, Berkeley, 2016.
  8. K. S. Shin, and D. S. Jo, "Exploring the Effects of the Virtual Human with Physicality on Co-presence and Emotional Response," Journal of the Korea Society of Computer and Information, 24.1 (2019): 67-71. https://doi.org/10.9708/JKSCI.2019.24.01.067