Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

Consecutive-Frame Super-Resolution considering Moving Object Region

  • Received : 2017.02.02
  • Accepted : 2017.03.19
  • Published : 2017.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a consecutive-frame super-resolution method to tackle a moving object problem. The super-resolution is a method restoring a high resolution image from a low resolution image. The super-resolution is classified into two types, briefly, single-frame super-resolution and consecutive-frame super-resolution. Typically, the consecutive-frame super-resolution recovers a better than the single-frame super-resolution, because it use more information from consecutive frames. However, the consecutive-frame super-resolution failed to recover the moving object. Therefore, we proposed an improved method via moving object detection. Experimental results showed that the proposed method restored both the moving object and the background properly.

Keywords

References

  1. S. Farsiu, M. D. Robinson, M. Elad, and P. Milanfar, "Fast and Robust Super-Resolution," IEEE Transactions on Image Processing, Vol. 13, No. 10, pp. 1327-1344, Oct. 2004 https://doi.org/10.1109/TIP.2004.834669
  2. L. Zhang and X. Wu, "An Edge-Guided Image Interpolation Algorithm via Directional Filtering and Data Fusion," IEEE Transactions on Image Processing, Vol. 15, No. 8, pp. 2226-2238, Aug. 2006 https://doi.org/10.1109/TIP.2006.877407
  3. A. Giachetti and N. Asuni, "Real-Time Artifact-Free Image Upscaling," IEEE Transactions on Image Processing, Vol. 20, No. 10, pp. 2760-2768, Oct. 2011 https://doi.org/10.1109/TIP.2011.2136352
  4. D. Zhou, X. Shen, and W. Dong, "Image zooming using directional cubic convolution interpolation," IET Image Processing, Vol. 6, No. 6, pp. 627-634, Feb. 2012 https://doi.org/10.1049/iet-ipr.2011.0534
  5. G. Anbarjafari and H. Demirel, "Image Super Resolution Based on Interpolation of Wavelet Domain High Frequency Subbands and the Spatial Domain Input Image," ETRI journal, Vol. 32, No. 3, pp. 390-394, June 2010 https://doi.org/10.4218/etrij.10.0109.0303
  6. J. M. Lee and Y. S. Shik, "Super-resolution Image Reconstruction by High-frequency Components Estimation Based on Self-reference," Ph. D. Thesis, Hanyang University, Republic of Korea, 2015
  7. W. T. Freeman, T. R. Jones, and E. C. Pasztor, "Example-Based Super-Resolution," IEEE Computer Graphics and Applications, Vol. 22, No. 2, pp. 56-65, Mar. 2002 https://doi.org/10.1109/38.988747
  8. H. Shin, D. Chung, B. Ku, and H. Ko, "Local Block Learning based Super resolution for license plate," KCSI journal, Vol. 16, No. 6, pp. 71-77, June 2011
  9. C. Dong, C. C. Loy, K. He, and X. Tang, "Learning a Deep Convolutional Network for Image Super-Resolution," European Conference on Computer Vision, pp. 184-199, Sep. 2014
  10. H. Shen, L. Zhang, B. Huang, and P. Li, "A MAP Approach for Joint Motion Estimation, Segmentation, and Super Resolution," IEEE Transactions on Image Processing, Vol. 16, No. 2, pp. 479-490, Feb. 2007 https://doi.org/10.1109/TIP.2006.888334
  11. D. Mitzel, T. Pock, T. Schoenemann, and D. Cremers, "Video Super Resolution using Duality Based $TV-L^1$ Optical Flow," Joint Pattern Recognition Symposium, pp. 432-441, Sep. 2009
  12. X. Li, Y. Hu, X. Gao, D. Tao, and B. Ning, "A multi-frame image super-resolution method," Signal Processing, Vol. 90, No. 2, pp. 405-414, Feb. 2010 https://doi.org/10.1016/j.sigpro.2009.05.028
  13. M. M. Islam, N. K. Asari, M. N. Islam, and M. A. Karim, "Super-Resolution Enhancement Technique for Low Resolution Video," IEEE Transactions on Consumer Electronics, Vol. 56, No. 2, pp.919-924, May 2010 https://doi.org/10.1109/TCE.2010.5506020
  14. T. Song, Y. Lee, M. Kim, B. Ku, and H. Ko, "Fusion Methods of License Plate Detection and Super Resolution for Improving License Plate Recognition," KCSI journal, Vol. 16, No. 4, pp. 53-60, April 2011
  15. C. Liu and D. Sun, "A Bayesian Approach to Adaptive Video Super Resolution," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 209-216, 2011
  16. Z. Ma, R. Liao, X. Tao, L. Xu, J. Jia, and E. Wu, "Handling motion blur in multi-frame super-resolution," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5224-5232, June 2015
  17. W. Shi, J. Caballero, F. Huszár, J. Totz, A. P. Aitken, R. Bishop, D. Rueckert, and Z. Wang, "Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1874-1883, June 2016
  18. B. D. Lucas and T. Kanade, "An iterative image registration technique with and application to stereo vision," International Joint Conference on Artificial Intelligence, Vol. 81, No. 1, pp. 674-694, Aug. 1981