Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Fast Frame Selection Method for Multi-Reference and Variable Block Motion Estimation

다중참조 및 가변블록 움직임 추정을 위한 고속 참조영상 선택 방법

  • Kim, Sung-Dae (School of Electrical and Computer Engineering, Ajou University) ;
  • SunWoo, Myung-Hoon (School of Electrical and Computer Engineering, Ajou University)
  • 김성대 (아주대학교 정보통신대학 전자공학부 SOC 연구실) ;
  • 선우명훈 (아주대학교 정보통신대학 전자공학부 SOC 연구실)
  • Published : 2008.11.25
Download PDF
⟨ Previous Next ⟩

Abstract

This paper introduces three efficient frame selection schemes to reduce the computation complexity for the multi-reference and variable block size Motion Estimation (ME). The proposed RSP (Reference Selection Pass) scheme can minimize the overhead of frame selection. The MFS (Modified Frame Selection) scheme can reduce the number of search points about 18% compared with existing schemes considering the motion of image during the reference frame selection process. In addition, the TPRFS (Two Pass Reference frame Selection) scheme can minimize the frame selection operation for the variable block size ME in H.264/AVC using the character of selected reference frame according to the block size. The simulation results show the proposed schemes can save up to 50% of the ME computation without degradation of image Qualify. Because the proposed schemes can be separated from the block matching process, they can be used with any existing single reference fast search algorithms.

이 논문은 다중참조 및 가변블록 움직임 추정의 연산량을 효율적으로 줄이기 위해 세 가지 참조영상 선택 방법들을 소개한다. 제안된 RSP (Reference Selection Pass) 방법은 참조영상 선택의 부가적인 연산을 최소화 할 수 있고 MFS (Modified Frame Selection) 방법은 참조영상 선택 과정 중 영상의 움직임을 고려하여 참조영상 선택 시 연산 횟수를 기존 방식에 비해 17% 감소시킨다. 또한 TPRFS (Two Pass Reference frame Selection) 방법은 H.264/AVC에서 요구하는 가변블록 움직임 추정을 지원하기 위한 부가적인 연산을 블록 크기에 따라 선택되는 참조영상의 특성을 이용하여 최소화 한다. 실험 결과 제안한 방식은 기존의 방식에 비해 화질의 열화 없이 50% 이상의 움직임 추정의 연산량을 감소시킬 수 있다. 또한 제안한 참조영상 선택 방법은 움직임 추정의 주된 연산인 블록정합 단계와 별개로 수행이 되기 때문에 기존의 어떠한 단일참조 고속 움직임 탐색 방법과도 같이 사용되어 효율적으로 다중참조 및 가변블록 움직임 추정 연산을 지원 할 수 있다.

Keywords

References

  1. Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H.264/ISO/IEC 14496-10 (E) AVC). July 2004
  2. J. Ostermann, T. Wedi, et al., "Video coding with H.264/AVC: tools, performance, and complexity," IEEE Circuits and Systems Magazine, vol. 4, pp.7-28, 2004 https://doi.org/10.1109/MCAS.2004.1286980
  3. Chi-Wang Ting, Wing-Hong Lam, and Lai-Man Po, "Fast block-matching motion estimation by recent-biased search for multiple reference frames," in Proc. IEEE Int.. Conf., On Image Processing, Oct. 2004, pp. 1445-1448
  4. Chen-Kuo Chiang and Shang-Hong Lai, "Fats multi-reference frame motion estimation via downhill simplex search," in Proc.IEEE Int. conf., On Multimedia and Expo, July 2006, pp.121-124
  5. M.-J. Chen, Y.-Y. Chiang, H.-J. Li, and M.-C. Chi, "Efficient multi-frame motion estimation algorithms for MPEG-4/AVC/JVT/H.264," in Proc. IEEE Int. Symp. on Circuits and Systems, May 2004, pp.737-740
  6. M. -J. Chen, G.-L. Li, Yi-Yen Chiang, and Ching-Ting Hsu, "Fast multiframe motion estimation algorithms by motion vector composition for the MPEG-4/AVC/H.264 standard," IEEE Trans. Multimedia, vol. 8, issue 3, pp.478-487, June 2006 https://doi.org/10.1109/TMM.2006.870739
  7. Chi-Wang Ting, Lai-Man Po, and Chun-Ho Cheung, "Center-biased frame selection algorithms for fast multi-frame motion estimation in H.264," in Proc. IEEE Int. Conf. Neural Networks & Signal Processing, Dec. 2003
  8. Huang, Y.-W., Hsieh, B.-Y., Chien, S, -Y., Ma, S.-Y., and Chen, L.-G, "Analysis and complexity reduction of multiple reference frames motion estimation in H.264/AVC", IEEE Trans, Circuits Syst., Video Technol., vol. 16, issue 4, pp.507-522, April 2006 https://doi.org/10.1109/TCSVT.2006.872783
  9. Saponara, S., Casula, M., Rovati, F., Alfonso, D., and Fanucci, L., "Dynamic control of motion estimation search parameters for low complex H.264 video coding," IEEE Trans. Consum. Electron., vol. 52, issue 1, pp.232-239, Feb. 2006
  10. Liquan Shen, Zhi Liu, Zhaoyang Zhang, and Guozhong Wang, "An adaptive and fast multiframe selection algorithm for H.264 video coding," IEEE Signal Processing Letters, vol. 14, no. 11, pp.836-839, Nov. 2007 https://doi.org/10.1109/LSP.2007.898343
  11. Iain E. G. Richardson, Video Codec Design: Developing Image and Video Compression Systems, Wiley, 2002
  12. Choong Jin Hyun, and Myung H. Sunwoo, "Efficient memory reuse and sub-pixel interpolation algorithms for ME/MC of H.264/AVC," IEEE Int. Workshop on signal Proc. Syst., Oct. 2006, pp.377-382
  13. JM Reference Software version 12.2 (current version: 14.2) http://iphome.hhi.de/suehring/tml/download/