Journal of the Korea Institute of Information and Communication Engineering (한국정보통신학회논문지)

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Hybrid Blending for Video Composition

동영상 합성을 위한 혼합 블랜딩

  • Kim, Jihong (Department of Electronic Engineering, Dong-Eui University) ;
  • Heo, Gyeongyong (Department of Electronic Engineering, Dong-Eui University)
  • Received : 2019.12.09
  • Accepted : 2019.12.27
  • Published : 2020.02.29
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we provide an efficient hybrid video blending scheme to improve the naturalness of composite video in Poisson equation-based composite methods. In image blending process, various blending methods are used depending on the purpose of image composition. The hybrid blending method proposed in this paper has the characteristics that there is no seam in the composite video and the color distortion of the object is reduced by properly utilizing the advantages of Poisson blending and alpha blending. First, after blending the source object by the Poisson blending method, the color difference between the blended object and the original object is compared. If the color difference is equal to or greater than the threshold value, the object of source video is alpha blended and is added together with the Poisson blended object. Simulation results show that the proposed method has not only better naturalness than Poisson blending and alpha blending, but also requires a relatively small amount of computation.

본 논문에서는 포아송 방정식을 기반으로 하는 영상 합성에 있어서 합성된 영상의 자연성을 향상시키기 위한 효율적인 동영상 혼합 블랜딩 기법을 제안한다. 영상 블랜딩 과정에서는 영상 합성의 목적에 따라 포아송 블랜딩과 알파 브랜딩 등 다양한 방법이 사용되고 있다. 본 논문에서 제안하는 혼합 블랜딩 방식은 포아송 블랜딩과 알파 블랜딩의 장점들을 조합함으로써 합성 영상에서 이음매가 없고 또한 객체의 색상 왜곡이 감소되는 특징을 갖는다. 먼저 소스 영상의 객체를 포아송 블랜딩 방법으로 합성한 후, 블랜딩 된 객체와 원래의 객체의 색차를 비교한다. 그리고 색차값이 임계값 이상인 경우, 소스 영상의 객체에 대해 알파 블랜딩을 수행하고 이를 포아송 블랜딩 된 객체와 가중치를 부여하여 합산한다. 모의실험과 분석을 통해 제안된 방법이 포아송 블랜딩과 알파 블랜딩에 비해 합성 영역의 자연성이 우수할 뿐 아니라 요구되는 계산량도 비교적 적다는 것을 볼 수 있다.

Keywords

References

  1. P. Perez, M. Gangnet, and A. Blake, "Poisson Image Editing," ACM Transaction on Graphics, vol. 22, no. 3, pp.313-318, Jul. 2003. https://doi.org/10.1145/882262.882269
  2. T. Chen, J. Y. Zhu, A. Shamir, and S.M. Hu, "MotionAware Gradient Domain Video Composition," IEEE Transactions on Image Processing, vol. 22, no. 7, pp. 2532-2544, Jul. 2013. https://doi.org/10.1109/TIP.2013.2251642
  3. G. Heo, H. Choi, and J. Kim, "Poisson Video Composition Using Shape Matching," Journal of the Korea Institute of Information and Communication Engineering, vol.22, no.4, pp.617-623, 2018. https://doi.org/10.6109/JKIICE.2018.22.4.617
  4. Richard J. Radke, Computer Vision for Visual Effects, Cambridge university press, 2013.
  5. K. F. Hussain, and R. M. Kamel, "Efficient Poisson Image Editing," Electronic Letters on Computer Vision and Image Analysis, 14(2), pp. 45-57, 2015.
  6. M. Afifi, K. F. Hussain, H. M. Ibrahim, and N. M. Omar, "Video Face Replacement System Using a Modified Poisson Blending Technique," International Symposium on Intelligent Signal Processing and Communication Systems, pp.1-5, 2015.
  7. I. S. Sevcenco, and P. Agathoklis, "Video Editing in Gradient Domain Using a Wavelet based 3-D Reconstruction Algorithm and an Iterative Poisson Solver," IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, pp. 205-209, 2015.
  8. W.S. Mokrzycki, and M. Tatol, "Colour difference ΔE - A survey," Machine Graphics and Vision, vol.20, pp.383-411, Apr. 2011.
  9. M. Afifi, and K. F. Hussain, "MPB: A modified Poisson blewnding technique," Computational Visual Media, vol.1, no.4, pp.331-341, Dec. 2015. https://doi.org/10.1007/s41095-015-0027-z
  10. X. Bai, J. Wang, D. Simons, and G. Sapiro, "Video Snapcut: Robust Video Object Cutout Using Localized Classifiers," ACM Transactions on Graphics, vol. 28, no. 3, pp. 1-11, 2009.