Recovering Corrupted Motion Vectors using Discontinuity Features of an Image

영상의 불연속 특성을 이용한 손상된 움직임 벡터 복원 기법

  • Published : 2004.06.01

Abstract

In transmitting a compressed video bit-stream over Internet, a packet loss causes an error propagation in both spatial and temporal domain, which in turn leads to a severe degradation in image quality. In this paper, a new error concealment algorithm is proposed to repair damaged portions of the video frames in the receiver. Conventional BMA(Boundary Matching Algorithm) assumes that the pixels on the boundary of the missing block and its neighboring blocks are very similar, but has no consideration of edges t)r discontinuity across the boundary. In our approach, the edges are detected across the boundary of the lost or erroneous block. Once the edges are detected and the orientation of each edge is found, only the pixel difference along the expected edges across the boundary is measured instead of calculating differences between all adjacent pixels on the boundary. Therefore, the proposed approach needs very few computations and the experiment shows an improvement of the performance over the conventional BMA in terms of both subjective and objective quality of video sequences.

이동 통신 채널과 같은 저대역 통신망에서는 비디오 전송을 위해서는 높은 압축율을 갖는 부호화 방법들이 사용된다. 본 논문에서는 저대역폭 통신을 위한 비디오 부호화 표준인 H.263 부호화를 기반으로 전송도중 손상된 움직임 벡터의 복원기법을 제안하고 실험하였다. 공간적으로 인접한 블록간에는 움직임 벡터의 상관성이 높기 때문에 손실블록 또한 이 블록들과 움직임이 비슷할 가능성이 높다. 이러한 특성을 이용하여 손실블록의 주변블록 중에서 같은 방향으로 움직임을 갖는 블록들로 구성된 동일 움직임 영역을 추출하고, 이 블록들을 이용하여 손실블록의 움직임벡터를 복구한다. 본 논문에서 제안한 알고리즘은 정확한 손실블록의 움직임 벡터를 찾아 거의 완벽하게 복원하기도 하지만 정확한 움직임벡터를 찾지 못한 경우에는 주변블록과 가장 비슷한 움직임벡터를 찾아서 에러를 복원하는 효과가 있다. 제안한 방법으로 복원한 영상은 전체적으로 눈에 거슬리는 오류가 생기지 않으므로 주관적인 화질이 좋았다. 또한 객관적인 척도인 PSNR 측면에서는 영상의 움직임 정도에 따라 기존 BMA 방법보다 약 0.5㏈∼1㏈ 정도 향상이 있었다.

Keywords

References

  1. ISO/IEC13818-2:Information Technology Generic Coding of Moving Pictures and Associated Audio, Draft International Standard, March, 1994
  2. ITU-T Recommendation H.236 Version 2, ITU-T SG-16, Video Coding for Low Bitrate Communication, Sept. 1997
  3. Jong Work Park, Jong Won Kim and Sang Uk Lee, DCT Coefficient Recovery Based Error Concealment Technique and its Application to the MPEG-2 Bit Stream Error, IEEE Trans, Circuits Syst. Video Tech., Vol.7, pp.845-854, Dec. 1997 https://doi.org/10.1109/76.644064
  4. W.M. Lam, A.R. Reibman and B.Lin, Recovery of Lost or Erroneously Received Motion Vectors, In Proc. ICASSP, 1993, Vol.5, pp.417-420 https://doi.org/10.1109/ICASSP.1993.319836
  5. Jian Feng, Kwork-Tung Lo and Hanssna Mehrpour, Error Concealment for MEPG Video Trans missions, IEEE Trans. Consumer Electronics, Vol. 43, No. 2, pp.183-187, 1997 https://doi.org/10.1109/30.585539
  6. Y.Wang, Qin-Fan Shu and Leonard Shaw, Maximally Smoothness Image Recovery in Transform Coding, IEEE Trans. Commn., Vol.41, pp.1544-1551, Oct. 1993 https://doi.org/10.1109/26.237889
  7. J.S.Hwang, D.K.Park, C.S.Won, J.C.Jung, and S.Y.Kim, A Concealment Algorithm Based on the Analysis of Transmission Errors or H.263 Bitstream, in Proceeding of the 1997 Korean Signal Processing conference Vol.10, No.1,pp.555-558, 1997
  8. H.C.Shyu and J.J.Leou, Detection and Concealment of Transmission Rrrors in MPEG-2 Images A Genetic Algorithm Approach, IEEE Trans. Circuits Syst. Video Technol., Vol.9, No.6, pp.937-948, Sept, 1999 https://doi.org/10.1109/76.785732
  9. SungChan Park, NamRey Son, JungHyun Kim and GueeSang Lee 'Recovery of Motion Vectors by Detecting Homogeneous Movements for H.263 Video Communications,' IEEE ICME2001, Tokyo, Japan, pp.33-36, 2001 https://doi.org/10.1109/ICME.2001.1237648