Image-Based Maritime Obstacle Detection Using Global Sparsity Potentials



Mou, Xiaozheng;Wang, Han

  • 투고 : 2016.04.13
  • 심사 : 2016.04.30
  • 발행 : 2016.06.30


In this paper, we present a novel algorithm for image-based maritime obstacle detection using global sparsity potentials (GSPs), in which "global" refers to the entire sea area. The horizon line is detected first to segment the sea area as the region of interest (ROI). Considering the geometric relationship between the camera and the sea surface, variable-size image windows are adopted to sample patches in the ROI. Then, each patch is represented by its texture feature, and its average distance to all the other patches is taken as the value of its GSP. Thereafter, patches with a smaller GSP are clustered as the sea surface, and patches with a higher GSP are taken as the obstacle candidates. Finally, the candidates far from the mean feature of the sea surface are selected and aggregated as the obstacles. Experimental results verify that the proposed approach is highly accurate as compared to other methods, such as the traditional feature space reclustering method and a state-of-the-art saliency detection method.


Global sparsity potentials;Horizon detection;Maritime images;Obstacle detection


  1. T. Huntsberger, H. Aghazarian, A. Howard, and D. C. Trotz, “Stereo vision-based navigation for autonomous surface vessels,” Journal of Field Robotics, vol. 28, no. 1, pp. 3-18, 2011.
  2. D. Bloisi, L. Iocchi, M. Fiorini, and G. Graziano, "Camera based target recognition for maritime awareness," in Proceeding of 15th International Conference of Information Fusion, Singapore, pp. 1982-1987, 2012.
  3. S. Fefilatyev, and D. Goldgof, "Detection and tracking of marine vehicles in video," in Proceeding of 19th International Conference on Pattern Recognition (ICPR), Tampa, FL, pp. 1-4, 2008.
  4. H. Wang, Z. Wei, S. Wang, C. S. Ow, K. T. Ho, and B. Feng, "A vision-based obstacle detection system for unmanned surface vehicle," in Proceeding of IEEE 5th Conference on Robotics, Automation and Mechatronics (RAM), Qingdao, China, pp. 364-369, 2011.
  5. H. Wang, and Z. Wei, "Stereovision based obstacle detection system for unmanned surface vehicle," in Proceeding of IEEE International Conference on Robotics and Biomimetics (ROBIO),Shenzhen, China, pp. 917-921, 2013.
  6. H. Wang, X. Mou, W. Mou, S. Yuan, S. Ulun, S. Yang, and B. S. Shin, "Vision based long range object detection and tracking for unmanned surface vehicle," in Proceeding of IEEE 7th International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM), Siem Reap, Cambodia, pp. 101-105, 2015.
  7. M. Kristan, V. Sulic Kent, S. Kovacic, and J. Pers, “Fast image-based obstacle detection from unmanned surface vehicles,” IEEE Transactions on Cybernetics, vol. 43, no. 3, pp. 641-654, 2015.
  8. N. Razavi, N. S. Alvar, J. Gall, and L. J. Van Gool, "Sparsity potentials for detecting objects with the Hough transform," in Proceeding of the British Machine Vision Conference (BMVC), Surrey, UK, pp. 1-10, 2012.
  9. P. Voles, A. A. W. Smith, and M. K. Teal, "Nautical scene segmentation using variable size image windows and feature space reclustering," in Proceeding of the 6th European Conference on Computer Vision (ECCV), Dublin, Ireland, pp. 324-335, 2000.
  10. S. Frintrop, T. Werner, and G. M. Garcia, "Traditional saliency reloaded: a good old model in new shape," in Proceeding of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, pp. 82-90, 2015.
  11. B. S. Shin, J. Tao, and R. Klette, “A superparticle filter for lane detection,” Pattern Recognition, vol. 48, no. 11, pp. 3333-3345, 2015.
  12. Y. Yan, B. S. Shin, X. Mou, W. Mou, and H. Wang, “Efficient horizon detection on complex sea for sea surveillance,” International Journal of Electrical, Electronics and Data Communication, vol. 3, no. 12, pp. 49-52, 2015.
  13. R. M. Haralick, K. Shanmugam, and I. H. Dinstein, “Textural features for image classification,” IEEE Transactions on Systems, Man and Cybernetics, vol. 3, no. 6, pp. 610-621, 1973.
  14. T. Deselaers and V. Ferrari, "Global and efficient self-similarity for object classification and detection," in Proceeding of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, pp. 1633-1640, 2010.