DOI QR코드

DOI QR Code

Effective MCTF based on Correlation Improvement of Motion Vector Field

움직임 벡터 필드의 상관도 향상을 통한 효과적인 MCTF 방법

  • Kim, Jongho (Department of Multimedia Engineering, Sunchon National University)
  • Received : 2014.02.17
  • Accepted : 2014.03.21
  • Published : 2014.05.31

Abstract

This paper presents an effective motion estimation to improve the performance of the motion compensated temporal filtering (MCTF) which is a core part of the wavelet-based scalable video coding. The proposed scheme makes the motion vector field uniform by the modified median operation and the search strategies using adjacent motion vectors, in order to enhance the pixel connectivity which is significantly relevant to the performance of the MCTF. Moreover, the motion estimation with variable block sizes that reflects the features of frames is introduced for further correlation improvement of the motion vector field. Experimental results illustrate that the proposed method reduces the decomposed energy on the temporal high frequency subband frame up to 30.33% in terms of variance compared to the case of the full search with fixed block sizes.

본 논문에서는 웨이블릿 변환 기반의 스케일러블 비디오 부호화의 핵심 요소인 움직임 보상 시간적 필터링 (motion compensated temporal filtering; MCTF)의 성능향상을 위한 효과적인 움직임 예측 기법을 제안한다. MCTF의 성능향상과 밀접한 관련이 있는 픽셀 연결성을 개선하기 위하여 변형 중간값 연산 및 주변 블록의 움직임 벡터를 이용한 움직임 예측 방법으로 움직임 벡터 필드를 평탄화한다. 또한 영상의 복잡도 등의 특성에 따라 가변 블록크기로 움직임 예측을 수행하여 움직임 벡터 필드의 상관도를 더욱 향상시킨다. 제안하는 방법은 시간적 필터링 과정에서 고주파 프레임으로 분해되는 에너지를 줄여 MCTF 및 전체 스케일러블 부호기의 성능을 향상시킨다. 실험결과 기존의 고정 블록크기 전역탐색 방법과 비교하여 제안하는 방법이 시간적 고주파 부대역 프레임에 포함된 에너지를 최대 30.33%까지 감소시키는 것을 확인하였다.

Keywords

References

  1. H. Schwarz, D. Marpe, and T. Wiegand, "Overview of the scalable video coding extension of the H.264/AVC standard," IEEE Trans. Circuits and Systems for Video Technology, vol. 17, no. 9, pp. 1103-1120, Sep. 2007. https://doi.org/10.1109/TCSVT.2007.905532
  2. J.-R. Ohm, "Three-dimensional subband coding with motion compensation," IEEE Trans. Image Processing, vol. 3, no. 5, pp. 559-571, Sep. 1994. https://doi.org/10.1109/83.334985
  3. P. Chen and J. W. Woods, "Bidirectional MC-EZBC with lifting implementation," IEEE Trans. Circuits and Systems for Video Technology, vol. 14, no. 10, pp. 1183-1194, Oct. 2004. https://doi.org/10.1109/TCSVT.2004.833165
  4. Y. Wang, "Fully scalable video coding using redundantwavelet multihypothesis and motion-compensated temporal filtering," Ph. D. dissertation, Mississippi State University, Starkville, MS, 2003.
  5. Motion-Compensated Embedded Zeroblock Coding (MCEZBC) software package [Online]. Available: http://www.cipr.rpi.edu/ftp_pub/personal/chen/.
  6. S.-J. Choi and J. W. Woods, "Motion-compensated 3-D subband coding of video," IEEE Trans. Image Processing, vol. 8, no. 2, pp. 155-167, Feb. 1999. https://doi.org/10.1109/83.743851
  7. P. Chen, "Fully scalable subband/wavelet coding," Ph. D. dissertation, Rensselaer Polytechnic Institute, Troy, NY, 2003.
  8. I. Daubechies, "Orthonormal bases of compacly supported wavelets," Communications on Pure and Applied mathematics, vol. XLI, no. 7, pp. 909-996, Jul. 1998.
  9. ISO/IEC 14496-10, Information Technology-Coding of Audio-Visual Objects: Advanced Video Coding, ISO/IEC JTC1, New York, NY, 2003.
  10. M. Tourapis, O. C. Au, and M. L. Liou, "Predictive motion vector field adaptive search technique (PMVFAST)-enhancing block-based motion estimation," in Proceedings of SPIE Conference on Visual Communication and Image Processing, San Jose: CA, pp. 883-892, 2001.