The Journal of the Korea institute of electronic communication sciences (한국전자통신학회논문지)

Korea Institute of Electronic Communication Science (한국전자통신학회)
권호 표지
DOI QR코드

DOI QR Code

A Study on Immersive Audio Improvement of FTV using an effective noise

유효 잡음을 활용한 FTV 입체음향 개선방안 연구

  • 김종운 (서울과학기술대학교 NID융합기술대학원) ;
  • 조현석 (서울과학기술대학교 미디어IT공학과 대학원) ;
  • 이윤배 (서울과학기술대학교 NID융합기술대학원) ;
  • 여성대 (서울과학기술대학교 NID융합기술대학원) ;
  • 김성권 (서울과학기술대학교 전자IT미디어공학과)
  • Received : 2014.12.02
  • Accepted : 2015.02.09
  • Published : 2015.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we proposed that immersive audio effect method using the effective noise to improve engagement in free-viewpoint TV(FTV) service. In the basketball court, we monitored the frequency spectrums by acquiring continuous audio data of players and referee using shotgun and wireless microphone. By analyzing this spectrum, in case that users zoomed in, we determined whether it is effective frequency or not. Therefore when users using FTV service zoom in toward the object, it is proposed that we need to utilize unnecessary noise instead of removing that. it will be able to be useful for an immersive audio implementation of FTV.

본 논문에서는 FTV(Free-viewpoint TV) 서비스에서, 몰입도를 향상시킬 수 있는 유효 잡음 이용 입체 음향효과 방법을 제안한다. 농구장에서 초지향성 마이크 및 무선 마이크를 사용하여 선수와 심판의 연속적인 음향 정보를 획득함으로써 주파수 스펙트럼을 관찰하였으며, 스펙트럼을 분석하여 시청자가 Zoom-in을 할 경우, 유효 주파수 여부를 판단하였다. 따라서 FTV 서비스에서 시청자가 피사체를 향해 Zoom-in 시, 제거대상이었던 잡음을 활용할 필요가 있음을 제시하였다. 본 연구는 향후 FTV의 입체 음향 연구에 활용될 것으로 기대된다.

Keywords

References

  1. S. Park, "UHD and beyond," The Korean Society of Broadcast Engineers, vol. 19, no. 2, Apr. 2014, 90-92.
  2. C. Kwak, W. Ko, T. Park, J. Park and W. Park, "A Study of TV Video Quality Assesment for the Adaption of Terrestrial Multi Mode Service," JKIECS, vol. 9, no. 9, Sept. 2014, 1063-1070. https://doi.org/10.13067/JKIECS.2014.9.9.1063
  3. B. Kim, "The study of IPTV standardization trend from the aspect of the quality of experience (QoE) and its implication," JKIECS, vol. 8, no. 12, Dec. 2013, 1811-1817.
  4. C. Lee, "The effects of a temporal masking on the sound laterlization," JKIECS, vol. 5, no. 4, Aug. 2010, 352-356.
  5. M. Tanimoto, M. P. Tehrani, T Fujii and T. Yendo, "FTV for 3-D Spatial Communication," Proc. of the IEEE, vol. 100, no. 4, Feb. 2012, 905-917. https://doi.org/10.1109/JPROC.2011.2182101
  6. M. Tanimoto, M. P. Tehrani, T Fujii and T. Yendo, "Free-Viewpoint TV," IEEE Signal Processing Mag., vol. 28, no. 1, Jan. 2011, 67-76. https://doi.org/10.1109/MSP.2010.939077
  7. Q. Yao, K. Takahashi and T. Fujii, "Compressed Sensing of Ray Space for Free Viewpoint Image (FVI) Generation," ITE Trans. on MTA, vol. 2, no. 1, 2014, pp. 23-32.
  8. S. Beack, J. Seo and K. Kang "Overview of MPEG-H 3D Audio Standard Activities," ISCE 2013, vol. 36, no. 1, July. 2013, pp. 1928-1931.

Cited by

  1. Compensation of audio data with a high frequency components for realistic media FTV vol.76, pp.9, 2017, https://doi.org/10.1007/s11042-016-3713-7