KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Hierarchical Regression for Single Image Super Resolution via Clustering and Sparse Representation

  • Qiu, Kang (School of Electronic Information, Wuhan University) ;
  • Yi, Benshun (School of Electronic Information, Wuhan University) ;
  • Li, Weizhong (School of Electronic Information, Wuhan University) ;
  • Huang, Taiqi (School of Electronic Information, Wuhan University)
  • Received : 2016.10.29
  • Accepted : 2017.02.26
  • Published : 2017.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

Regression-based image super resolution (SR) methods have shown great advantage in time consumption while maintaining similar or improved quality performance compared to other learning-based methods. In this paper, we propose a novel single image SR method based on hierarchical regression to further improve the quality performance. As an improvement to other regression-based methods, we introduce a hierarchical scheme into the process of learning multiple regressors. First, training samples are grouped into different clusters according to their geometry similarity, which generates the structure layer. Then in each cluster, a compact dictionary can be learned by Sparse Coding (SC) method and the training samples can be further grouped by dictionary atoms to form the detail layer. Last, a series of projection matrixes, which anchored to dictionary atoms, can be learned by linear regression. Experiment results show that hierarchical scheme can lead to regression that is more precise. Our method achieves superior high quality results compared with several state-of-the-art methods.

Keywords

References

  1. H. Chang, D.-Y. Yeung and Y. Xiong, "Super-resolution through neighbor embedding," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, pp.275-282, June 27- July 2, 2004.
  2. M. Bevilacqua, A. Roumy, C. Guillemot and M.-L. Alberi Morel, "Low-complexity single-image super-resolution based on nonnegative neighbor embedding," in Proc. of British Machine Vision Conference, pp.135.1-135.10, September 3-7, 2012.
  3. J. Yang, J. Wright, T. Huang and Y. Ma, "Image super-resolution as sparse representation of raw image patches," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, pp.1-8, June 23-28, 2008.
  4. J. Yang, Z. Wang, Z. Lin, S. Cohen and T. Huang, "Coupled dictionary training for image super-resolution," IEEE Transactions on Image Processing, vol. 21, no. 8, pp.3467-3478, August, 2012. https://doi.org/10.1109/TIP.2012.2192127
  5. R. Zeyde, M. Elad and M. Protter, "On single image scale-up using sparse-representations," in Proc. of 7th Int. Conference on Curves and Surfaces, pp.711-730, June 24-30, 2010.
  6. L. He, H. Qi and R. Zaretzki, "Beta process joint dictionary learning for coupled feature spaces with application to single image super resolution," in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, pp.345-352, June 23-28, 2013.
  7. W. Yang, Y. Tian and F. Zhou, "Consistent coding scheme for single-image super-resolution via independent dictionaries," IEEE Transactions on Multimedia, vol. 18, no. 3, pp.312-325, March, 2016.
  8. C.-Y. Yang and M.-H. Yang, "Fast direct super-resolution by simple functions," in Proc. of IEEE International Conference on Computer Vision, pp.561-568, Dec 1-8, 2013.
  9. Y. Zhang, Y. Zhang and J. Zhang, "CCR-Clustering and collaborative representation for fast single image super-resolution," IEEE Transactions on Multimedia, vol. 18, no. 3, pp.405-417, March, 2016. https://doi.org/10.1109/TMM.2015.2512046
  10. K. Zhang, D. Tao, X. Gao, X. Li and Z. Xiong, "Learning multiple linear mappings for efficient single image super-resolution," IEEE Transactions on Image Processing, vol. 24, no. 3, pp.846-861, March, 2015. https://doi.org/10.1109/TIP.2015.2389629
  11. R. Timofte, V. D. Smet and L.V. Gool, "Anchored neighborhood regression for fast example-based super-resolution," in Proc. of IEEE International Conference on Computer Vision, pp.1920-1927, December 1-8, 2013.
  12. R. Timofte, V. D. Smet and L. V. Gool, "A+: Adjusted anchored neighborhood regression for fast super-resolution," in Proc. of 12th Asian Conference on Computer Vision, pp.111-126, November 1-5, 2014.
  13. K.-W. Hung and W.-C. Siu, "Fast image interpolation using bilateral filter," IET Image Processing, vol. 6, no. 7, pp.877-890, October, 2012. https://doi.org/10.1049/iet-ipr.2011.0050
  14. K.-W. Hung and W.-C. Siu, "Robust soft-decision interpolation using weighted least squares," IEEE Transactions on Image Processing, vol. 21, no. 3, pp.1061-1069, March, 2012. https://doi.org/10.1109/TIP.2011.2168416
  15. W.-S. Tam, C.-W. Kok and W.-C. Siu, "A modified edge directed interpolation for images," Journal of Electronic Imaging, vol. 19, no. 1, pp.013011-013011-20, March 2010. https://doi.org/10.1117/1.3358372
  16. J. Sun, J. Sun, Z. Xu and H.-Y. Shum, "Gradient profile prior and its applications in image super-resolution and enhancement," IEEE Transactions on Image Processing, vol. 20, no. 6, pp.1529-1542, June, 2011. https://doi.org/10.1109/TIP.2010.2095871
  17. A. Marquina and S.J. Osher, "Image super-resolution by TV-regularization and Bregman iteration," Journal of Scientific Computing, vol. 37, no. 3, pp.367-382, December, 2008. https://doi.org/10.1007/s10915-008-9214-8
  18. K. Zhang, X. Gao, D. Tao and X. Li, "Single image super-resolution with non-local means and steering kernel regression," IEEE Transactions on Image Processing, vol. 21, no. 11, pp.4544-4556, November, 2012. https://doi.org/10.1109/TIP.2012.2208977
  19. D. L. Donoho, "For most large underdetermined systems of linear equations the minimal $l_1$-norm solution is also the sparsest solution," Communications on Pure and Applied Mathematics, vol. 59, no. 6, pp.797-829, March, 2006. https://doi.org/10.1002/cpa.20132
  20. E. J. Candes, J. K. Romberg and T. Tao, "Stable signal recovery from incomplete and inaccurate measurements," Communications on Pure and Applied Mathematics, vol. 59, no. 8, pp.1207-1223, March, 2006. https://doi.org/10.1002/cpa.20124
  21. E. J. Candes and T. Tao, "Near-optimal signal recovery from random projections: Universal encoding strategies?," IEEE Transactions on Information Theory, vol. 52, no. 12, pp.5406-5425, December, 2006. https://doi.org/10.1109/TIT.2006.885507
  22. M. Aharon, M. Elad and A. Bruckstein, "K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation," IEEE Transactions on Signal Processing, vol. 54, no. 11, pp.4311-4322, November, 2006. https://doi.org/10.1109/TSP.2006.881199
  23. L. Zhang, M. Yang and X. Feng, "Sparse representation or collaborative representation: Which helps face recognition?," in Proc. of IEEE International Conference on Computer Vision, pp.471-478, November, 6-13, 2011.
  24. W. Dong, D. Zhang, G. Shi and X. Wu, "Image deblurring and super resolution by adaptive sparse domain selection and adaptive regularization," IEEE Transactions on Image Processing, vol. 20, no. 7, pp.1838-1857, July, 2011. https://doi.org/10.1109/TIP.2011.2108306
  25. J. Yang, J. Wright, T. Huang and Y. Ma., "Image super resolution via sparse representation," IEEE Transactions on Image Processing, vol. 19, no. 11, pp.2861-2873, November, 2010. https://doi.org/10.1109/TIP.2010.2050625
  26. Z. Wang, A. Bovik, H. Sheikh and E. Simoncelli, "Image quality assessment: from error visibility to structural similarity," IEEE Transactions on Image Processing, vol. 13, no. 4, pp.600-612, April, 2004. https://doi.org/10.1109/TIP.2003.819861
  27. C. Dong, C. Loy, K. He and X. Tang, "Image super-resolution using deep convolutional networks," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 2, pp.295-307, February, 2016. https://doi.org/10.1109/TPAMI.2015.2439281
  28. Z. Li and J. Tang, "Unsupervised feature selection via nonnegative spectral analysis and redundancy control," IEEE Transactions on Image Processing, vol. 24, no. 12, pp.5343-5355, December, 2015. https://doi.org/10.1109/TIP.2015.2479560
  29. Z. Li, J. Liu, J. Tang and H. Lu, "Robust structured subspace learning for data representation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, no. 10, pp.2085-2098, October, 2015. https://doi.org/10.1109/TPAMI.2015.2400461
  30. F. Cao, M. Cai, Y. Tan and J. Zhao, "Image super-resolution via adaptive lp(0 < p < 1) regularization and sparse representation," IEEE Transactions on Neural Networks and Learning Systems, vol. 27, no. 7, pp.1550-1561, July, 2016. https://doi.org/10.1109/TNNLS.2015.2512563