Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

A Method for Tree Image Segmentation Combined Adaptive Mean Shifting with Image Abstraction

  • Received : 2018.12.07
  • Accepted : 2019.09.26
  • Published : 2020.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Although huge progress has been made in current image segmentation work, there are still no efficient segmentation strategies for tree image which is taken from natural environment and contains complex background. To improve those problems, we propose a method for tree image segmentation combining adaptive mean shifting with image abstraction. Our approach perform better than others because it focuses mainly on the background of image and characteristics of the tree itself. First, we abstract the original tree image using bilateral filtering and image pyramid from multiple perspectives, which can reduce the influence of the background and tree canopy gaps on clustering. Spatial location and gray scale features are obtained by step detection and the insertion rule method, respectively. Bandwidths calculated by spatial location and gray scale features are then used to determine the size of the Gaussian kernel function and in the mean shift clustering. Furthermore, the flood fill method is employed to fill the results of clustering and highlight the region of interest. To prove the effectiveness of tree image abstractions on image clustering, we compared different abstraction levels and achieved the optimal clustering results. For our algorithm, the average segmentation accuracy (SA), over-segmentation rate (OR), and under-segmentation rate (UR) of the crown are 91.21%, 3.54%, and 9.85%, respectively. The average values of the trunk are 92.78%, 8.16%, and 7.93%, respectively. Comparing the results of our method experimentally with other popular tree image segmentation methods, our segmentation method get rid of human interaction and shows higher SA. Meanwhile, this work shows a promising application prospect on visual reconstruction and factors measurement of tree.

Keywords

Acknowledgement

This work was supported by the National Natural Science Foundation of China (No. 31670641), Zhejiang Science and Technology Key R&D Program Funded Project (No. 2018C02013) and Zhejiang Public Welfare Project (No. LGN21C160004).

References

  1. Y. Boykov and M. P. Jolly, "Interactive organ segmentation using graph cuts," in Medical Image Computing and Computer-Assisted Intervention - MICCI 2000. Heidelberg, Germany: Springer, 2000, pp. 276-286.
  2. Q. Zeng, Y. Miao, C. Liu, and S. Wang, "Algorithm based on marker-controlled watershed transform for overlapping plant fruit segmentation," Optical Engineering, vol. 48 no. 2, article no. 027201, 2009.
  3. H. T. Zhang, H. P. Mao, and D. Y. Qiu, "Feature extraction for the stored-grain insect detection system based on image recognition technology," Transactions of the Chinese Society of Agricultural Engineering, vol. 25 no. 2, pp. 126-130, 2009.
  4. C. S. Sharp, O. Shakernia, and S. S. Sastry, "A vision system for landing an unmanned aerial vehicle," in Proceedings of IEEE International Conference on Robotics and Automation (Cat. No. 01CH37164), Seoul, South Korea, pp. 1720-1727, 2001.
  5. D. K Isenor and S. G. Zaky, "Fingerprint identification using graph matching," Pattern Recognition, vol. 19 no. 2, pp. 113-122, 1986. https://doi.org/10.1016/0031-3203(86)90017-8
  6. B. Wang, L. L. Chen, and J. Cheng, "New result on maximum entropy threshold image segmentation based on P system," Optik, vol. 163, pp. 81-85, 2018. https://doi.org/10.1016/j.ijleo.2018.02.062
  7. N. Otsu, "A threshold selection method from gray-level histograms," IEEE Transactions on Systems, Man, and Cybernetics, vol. 9, no. 1, pp. 62-66, 1979. https://doi.org/10.1109/TSMC.1979.4310076
  8. Y. Xu, W. Yao, L. Hoegner, and U. Stilla, "Segmentation of building roofs from airborne LiDAR point clouds using robust voxel-based region growing," Remote Sensing Letters, vol. 8 no. 11, pp. 1062-1071, 2017. https://doi.org/10.1080/2150704X.2017.1349961
  9. D. Zhou and Y. Shao, "Region growing for image segmentation using an extended PCNN model," IET Image Processing, vol. 12 no. 5, pp. 729-737, 2018. https://doi.org/10.1049/iet-ipr.2016.0990
  10. L. Ding and A. Goshtasby, "On the Canny edge detector," Pattern Recognition, vol. 34 no. 3, pp. 721-725, 2001. https://doi.org/10.1016/S0031-3203(00)00023-6
  11. Y. M. Luo and R. Duraiswami, "Canny edge detection on NVIDIA CUDA," in Proceedings of 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Anchorage, AK, 2008.
  12. A. K. Cherri and M. A. Karim, "Optical symbolic substitution: edge detection using Prewitt, Sobel, and Roberts operators," Applied Optics, vol. 28 no. 21, pp. 4644-4648, 1989. https://doi.org/10.1364/AO.28.004644
  13. S. Vicente, V. Kolmogorov, and C. Rother, "Graph cut based image segmentation with connectivity priors," in Proceedings of 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, 2008.
  14. C. Rother, V. Kolmogorov, and A. Blake, "GrabCut: interactive foreground extraction using iterated graph cuts," ACM Transactions on Graphics, vol. 23, no. 3, pp. 309-314, 2004. https://doi.org/10.1145/1015706.1015720
  15. K. He, G. Gkioxari, P. Dollar, and R. Girshick, "Mask R-CNN," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 1, pp. 386-397, 2020. https://doi.org/10.1109/TPAMI.2018.2844175
  16. L. C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, "DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 40, no. 4, pp. 834-848, 2017. https://doi.org/10.1109/TPAMI.2017.2699184
  17. X. Li, H. Chen, X. Qi, Q. Dou, C. W. Fu, and P. A. Heng, "H-DenseUNet: hybrid densely connected UNet for liver and tumor segmentation from CT volumes," IEEE Transactions on Medical Imaging, vol. 37, no. 12, pp. 2663-2674, 2018. https://doi.org/10.1109/TMI.2018.2845918
  18. S. Loutridis, E. Douka, L. J. Hadjileontiadis, and A. Trochidis, "A two-dimensional wavelet transform for detection of cracks in plates," Engineering Structures, vol. 27, no. 9, pp. 1327-1338, 2005. https://doi.org/10.1016/j.engstruct.2005.03.006
  19. S. Balla-Arabe, X. Gao, D. Ginhac, V. Brost, and F. Yang, "Architecture-driven level set optimization: From clustering to subpixel image segmentation," IEEE Transactions on Cybernetics, vol. 46 no. 12, pp. 3181-3194, 2016. https://doi.org/10.1109/TCYB.2015.2499206
  20. Z. Zhuge, M. Xu, and Y. Liu, "Fabric image segmentation algorithm based on Mean Shift," Journal of Textile Research, vol. 28, no. 10, pp. 108-111, 2007. https://doi.org/10.3321/j.issn:0253-9721.2007.10.028
  21. L. Lin, D. Garcia-Lorenzo, C. Li, T. Jiang, and C. Barillot, "Adaptive pixon represented segmentation (APRS) for 3D MR brain images based on mean shift and Markov random fields," Pattern Recognition Letters, vol. 32 no. 7, pp. 1036-1043, 2011. https://doi.org/10.1016/j.patrec.2011.02.016
  22. J. Sun, "A fast MEANSHIFT algorithm-based target tracking system," Sensors, vol. 12, no. 6, pp. 8218-8235, 2012. https://doi.org/10.3390/s120608218
  23. Y. Liu, S. Z. Li, W. Wu, and R. Huang, "Dynamics of a mean-shift-like algorithm and its applications on clustering," Information Processing Letters, vol. 113 no. 1-2, pp. 8-16, 2013. https://doi.org/10.1016/j.ipl.2012.10.002
  24. M. H. Jeong, B. J. You, Y. Oh, S. R. Oh, and S. H. Han, "Adaptive mean-shift tracking with novel color model," in Proceedings of IEEE International Conference Mechatronics and Automation, Niagara Falls, Canada, 2005, pp. 1329-1333.
  25. H. Cho, S. J. Kang, S. I. Cho, and Y. H. Kim, "Image segmentation using linked mean-shift vectors and its implementation on GPU," IEEE Transactions on Consumer Electronics, vol. 60 no. 4, pp. 719-727, 2014. https://doi.org/10.1109/TCE.2014.7027348
  26. K. Du, Y. Ju, Y. Jin, G. Li, Y. Li, and S. Qian, "Object tracking based on improved MeanShift and SIFT," in Proceedings of 2012 2nd International Conference on Consumer Electronics, Communications and Networks (CECNet), Yichang, China, 2012, pp. 2716-2719.
  27. G. B. Li and H. F. Wu, "Weighted fragments-based mean-shift tracking using color-texture histogram," Journal of Computer-Aided Design & Computer Graphics, vol. 23, no. 12, pp. 2059-2066, 2011.
  28. C. Liu, A. Zhou, Q. Zhang, and G. Zhang, "Adaptive image segmentation by using mean-shift and evolutionary optimization," IET Image Processing, vol. 8, no. 6, pp. 327-333, 2014. https://doi.org/10.1049/iet-ipr.2013.0195
  29. A. Mayer and H. Greenspan, "An adaptive mean-shift framework for MRI brain segmentation," IEEE Transactions on Medical Imaging, vol. 28, no. 8, pp. 1238-1250, 2009. https://doi.org/10.1109/TMI.2009.2013850
  30. J. Zhou, J. Zhu, X. Mei, and H. Ma, "An adaptive MeanShift segmentation method of remote sensing images based on multi-dimension features," Geomatics & Information Science of Wuhan University, vol. 37 no. 4, pp. 419-418, 2012.
  31. Y. Wang and Y. Sun, "Adaptive Mean Shift based image smoothing and segmentation," Acta Automatica Sinica, vol. 36 no. 12, pp. 1637-1644, 2012. https://doi.org/10.3724/SP.J.1004.2010.01637
  32. Y. F. Ge, H. P. Zhou, J. Q. Zheng, and H. C. Zhang, "A tree image segmentation algorithm based on relative color indices," Journal of Nanjing Forestry University (Natural Science Edition), vol. 2 no. 4, pp. 19-22, 2012.
  33. M. Zhao, J. Qiang, X. Lin, and X. Feng, "Tree image Segmentation method based on the fractional dimension," Transactions of the Chinese Society for Agricultural Machinery, vol. 35, no. 2,pp. 72-75, 2004. https://doi.org/10.3969/j.issn.1000-1298.2004.02.021
  34. S. H. Jiang, "Research segmentation methods of stumpage image based on Android System," M.S. thesis, Northeast Forestry University, Harbin, China, 2015.
  35. W. Ding, S. Zhao, S. Zhao, J. Gu, W. Qui, and B. Guo, "Measurement methods of fruit tree canopy volume based on machine vision," Transactions of the Chinese Society for Agricultural Machinery, vol. 47, no. 6, pp. 1-10, 2016.
  36. T. Yang, F. Guan, and A. Xu, "Multiple trees contour extraction method based on Graph Cut algorithm," Journal of Nanjing Forestry University (Natural Sciences Edition), vol. 42, no. 6, pp. 91-98, 2018.