Journal of the Korea Institute of Information and Communication Engineering (한국정보통신학회논문지)

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

MRBR-based JPEG2000 Codec for Stereoscopic Image Compression of 3-Dimensional Digital Cinema

3차원 디지털 시네마의 스테레오 영상 압축을 위한 MRBR기반의 JPEG2000 코덱

  • 서영호 (광운대학교 교양학부) ;
  • 신완수 (광운대학교 전자재료공학과 Digital Design & Test Lab.) ;
  • 최현준 (광운대학교 전자재료공학과 Digital Design & Test Lab.) ;
  • 유지상 (광운대학교 전자공학과) ;
  • 김동욱 (광운대학교 전자재료공학과 Digital Design & Test Lab.)
  • Published : 2008.12.30
Download PDF
⟨ Previous Next ⟩

Abstract

In In this paper, we proposed a new JPEG2000 codec using multiresolution-based rendering (MRBR) technique for video compression of 3-dimensional digital cinema. We introduced discrete wavelet transform (DWT) for stereoscopic image and stereo matching technique in the wavelet domain. The disparity was extracted using stereo matching and transmitted with the reference (left) image. Since the generated right image was degraded by the occlusion lesion, the residual image which is generated from difference between the original right image and the generated one was transmitted at the same tine. The disparity data was extracted using the dynamic programming method in the disparity domain. There is high correlation between the higher and lower subbands. Therefore we decreased the calculation amount and enhanced accuracy by restricting the search window and applying the disparity information generated from higher subband.

본 논문에서는 3차원 디지털 시네마 영상의 압축을 위하여 다해상도 기반 렌더링(MultiResolution-based Rendering, MRBR) 기법을 이용한 JPEG2000 압축코덱 구조에 대하여 제안하였다. 스테레오 영상에 이산 웨이블릿 변환(discrete wavelet transform, DWT)과 다해상도의 웨이블릿 영역에서 스테레오 정합(stereo matching)기법을 적용하여 변이정보를 추출하고 기준영상과 같이 전송한다. 또한 추출된 다른 시점의 영상은 비폐색영역으로 인한 화질열화가 발생하므로 이를 보상하기 위하여 비폐색영역이 포함된 원 주파수정보와 대상 시점에서 주파수정보의 차이를 같이 전송한다. 변이정보는 변이공간에서의 동적계획법(dynamic programming)을 이용하여 추출하였다. DWT의 특성상 상위 부대역은 하위 부대역과 높은 상관성을 갖는다. 따라서 coarse-to-fine 방법을 이용하여 상위 부대역에서 얻어진 변이정보를 하위 부대역에 적용하여 탐색영역을 제한함으로써 일반적인 동적계획법에 비하여 연산량을 단축시켰으며 정확도를 향상시켰다.

Keywords

References

  1. 이상법, 김성열, 호요성, "깊이 영상으로부터 다시점 영상 생성 방법," 대한전자공학회, 전자공학회지 제33권 제8호, pp.950-959, September. 2006
  2. P. Kauff, N. Atzpadin, C. Fehn, M. Müller, O. Schreer, A. Smolic, R. Tanger, "Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability," Signal Processing: Image Communication, Volume 22, Issue 2, pp. 217-234, 2007 https://doi.org/10.1016/j.image.2006.11.013
  3. Scharstein, D., Szeliski, R., Zabih, R., "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," Stereo and Multi-Baseline Vision, 2001. (SMBV 2001). Proceedings. IEEE Workshop , pp. 131-140, December, 2001
  4. [1] JPEG2000 Final Committee Draft (FCD). JPEG2000 Committee Drafts.[Online]. Available: http://www.jpeg.org/CDs15444.htm
  5. [1] Y. Ohta and T.Kanade, "Stereo by intra- and inter-scanline search using dynamic programming," Pattern Analysis and Machine Intelligence, IEEE Transactions on Volume PAMI7, 1985
  6. [1] Chun-Jen Tsai, Katsaggelos, A.K., "Dense disparity estimation with a divide-and-conquer disparity space image technique," Multimedia, IEEE Transactions on Volume 1, issue 1, pp. 18-29, 1999 https://doi.org/10.1109/6046.748168
  7. [1] Birchfield, S., Tomasi, C., "Depth discontinuities by pixel-to-pixel stereo," IEEE Computer Vision, 1998. Sixth International Conference on 4-7, pp.1073-1080, 1998
  8. [1] Liang Zhang, Tam, W.J., "Stereoscopic image generation based on depth images for 3D TV," Broadcasting, IEEE Transactions on Volume 51, Issue 2, pp. 191-199, June, 2005
  9. [1] Young-Ho Seo, Dong-Wook Kim, "VLSI Architecture of Line-based Lifting Wavelet Transform for Motion JPEG2000," IEEE Journal of Solid-State Circuits on Volume 42, Number 2, pp. 431-440, 2007 https://doi.org/10.1109/JSSC.2006.889368
  10. [1] Binaghi, E., Gallo, I., Marino, G., Raspanti, M., "Neural adaptive stereo matching," Pattern Recognition Letters volume 25, pp. 1743-1758, 2004 https://doi.org/10.1016/j.patrec.2004.07.001
  11. [1] Brown, M.Z., Burschka, D., Hager, G.D., "Advances in computational stereo," Pattern Analysis and Machine Intelligence, IEEE Transactions on Volume 25, Issue 8, pp. 993-1008, August, 2003