DOI QR코드

DOI QR Code

Content Based Dynamic Texture Analysis and Synthesis Based on SPIHT with GPU

  • Ghadekar, Premanand P. (Dept. of Computer Engineering, VIT) ;
  • Chopade, Nilkanth B. (Dept. of E & TC Engineering, PCCOE)
  • Received : 2013.08.26
  • Accepted : 2013.12.24
  • Published : 2016.03.31

Abstract

Dynamic textures are videos that exhibit a stationary property with respect to time (i.e., they have patterns that repeat themselves over a large number of frames). These patterns can easily be tracked by a linear dynamic system. In this paper, a model that identifies the underlying linear dynamic system using wavelet coefficients, rather than a raw sequence, is proposed. Content based threshold filtering based on Set Partitioning in a Hierarchical Tree (SPIHT) helps to get another representation of the same frames that only have low frequency components. The main idea of this paper is to apply SPIHT based threshold filtering on different bands of wavelet transform so as to have more significant information in fewer parameters for singular value decomposition (SVD). In this case, more flexibility is given for the component selection, as SVD is independently applied to the different bands of frames of a dynamic texture. To minimize the time complexity, the proposed model is implemented on a graphics processing unit (GPU). Test results show that the proposed dynamic system, along with a discrete wavelet and SPIHT, achieve a highly compact model with better visual quality, than the available LDS, Fourier descriptor model, and higher-order SVD (HOSVD).

Keywords

References

  1. G. Doretto, A. Chiuso, S. Soatto, and Y. N. Wu, "Dynamic textures," International Journal of Computer Vision, vol. 51, no. 2, pp. 91-109, 2003. https://doi.org/10.1023/A:1021669406132
  2. B. Abraham, O. I. Camps, and M. Sznaier, "Dynamic texture with Fourier descriptors," in Proceedings of the 4th International Workshop on Texture Analysis and Synthesis, Beijing, China, pp. 53-58, 2005.
  3. S. G. Mallat, "Multifrequency channel decomposition of images and wavelet models," IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 37, no. 12, pp. 2091-2110, Dec. 1989. https://doi.org/10.1109/29.45554
  4. S. Jayaraman, S. Esakkirajan, and T. Veerakumar, Digital Image Processing. New Delhi: Tata McGraw Hill Education, 2009.
  5. S. Soatto, G. Doretto, and Y. N. Wu, "Dynamic textures," in Proceedings of the 8th IEEE International Conference on Computer Vision (ICCV2001), Vancouver, Canada, pp. 439-446, 2001.
  6. J. Filip, M. Haindl, and D. Chetverikov, "Fast synthesis of dynamic colour textures," in Proceedings of the 18th International Conference on Pattern Recognition (ICPR2006), Hong Kong, China, pp. 25-28, 2006.
  7. R. Costantini, L. Sbaiz, and S. Susstrunk. "Higher order SVD analysis for dynamic texture synthesis," IEEE Transactions on Image Processing, vol. 17, no. 1, pp. 42-52, 2008. https://doi.org/10.1109/TIP.2007.910956
  8. C. Li, J. Wang, L. Ye, and H. Wang, "A novel method of dynamic textures analysis and synthesis," in Proceedings of the IEEE International Joint Conference on Computational Sciences and Optimization (CSO2009), Hainan, China, pp. 328-332, 2009.
  9. A. Ford and A. Roberts, "Colour space conversions," Westminster University, London, 1998.
  10. P. N. Topiwala, Wavelet Image and Video Compression. Boston, MA: Kluwer Academic Publishers, 1998.
  11. J. R. Ding and J. F. Yang, "A simplified SPIHT algorithm," Journal of the Chinese Institute of Engineers, vol. 31, no. 4, pp. 715-719, 2008. https://doi.org/10.1080/02533839.2008.9671425
  12. W. A. Pearlman and A. Said, "Set partition coding: part I of set partition coding and image wavelet coding system," Foundations and Trends in Signal Processing, vol. 2, no. 2, pp. 95-180, 2008. https://doi.org/10.1561/2000000013
  13. Y. Itoh and T. Ono, "Up-sampling of YCbCr 4:2:0 image exploiting inter-color correlation in RGB domain," IEEE Transactions on Consumer Electronics, vol. 55, no. 4, pp. 2204-2210, Nov. 2009. https://doi.org/10.1109/TCE.2009.5373789
  14. W. Smith, "Matlab's parallel computation toolbox and the parallel interpolation of commodity futures curves," Mar. 2010; http://commoditymodels.files.wordpress.com/2010/03/matlab-parallel-computing-toolbox-andinterpolating- futures-curves.pdf.
  15. NVIDIA, "Accelerating MATLAB with CUDA using MEX files," WP-03495-001_v01, Sep. 2007; https://www.ljll. math.upmc.fr/groupes/gpgpu/tutorial/Accelerating_Matlab_with_CUDA.pdf.
  16. NVIDIA, "What is GPU computing?" http://www.nvidia.com/object/what-is-gpu-computing.html.
  17. The DynTex Database, http://projects.cwi.nl/dyntex/database.html.