3D Building Detection and Reconstruction from Aerial Images Using Perceptual Organization and Fast Graph Search

Woo, Dong-Min;Nguyen, Quoc-Dat

  • Published : 2008.09.30


This paper presents a new method for building detection and reconstruction from aerial images. In our approach, we extract useful building location information from the generated disparity map to segment the interested objects and consequently reduce unnecessary line segments extracted in the low level feature extraction step. Hypothesis selection is carried out by using an undirected graph, in which close cycles represent complete rooftops hypotheses. We test the proposed method with the synthetic images generated from Avenches dataset of Ascona aerial images. The experiment result shows that the extracted 3D line segments of the reconstructed buildings have an average error of 1.69m and our method can be efficiently used for the task of building detection and reconstruction from aerial images.


Aaerial images;Building detection;Building reconstruction;Perceptual grouping


  1. S. Noronha and R. Nevatia, "Detection and modeling of buildings from multiple aerial images," IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 23, no. 5, pp. 501-518, 2001
  2. A. Huertas and R. Nevatia, "Detecting Buildings in Aerial Images," Computer Vision, Graphics and Image Processing, vol. 41, no. 2, 1988, pp.131-152
  3. C. A. Lin and R. Nevatia, "Building detection and description from a single intensity image," Computer Vision and Image Understanding, vol.72, no.2, pp.101-121, 1998
  4. R. Collins, C. Jaynes, Y. Q. Cheng, X. Wang, F. Stolle, E. Riseman, and A. Hanson, "The ascender system: automated site modeling from multiple aerial images," Computer Vision and Image Understanding, vol. 72, no. 2, pp. 143-162, 1998
  5. R. Mohan and R. Nevatia, "Using perceptual organization to extract 3D Structure," Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 11, pp. 1121-1139, 1989
  6. A. Huertas, Z. Kim, and R. Nevatia, "Use of cues from range data for building modeling," Proc. DARPA Image Understanding Workshop, 1998, pp. 577-582
  7. M. Boldt, R. Weiss, and E. Riseman, "Token-based Extraction of Straight Lines," IEEE Trans. Systems Man Cybernetics, vol. 19, 1989, pp.1581-1594
  8. H. Schultz, "Terrain Reconstruction from Widely Separated Images," in Proceedings of SPIE, vol. 2486, 1995, pp. 113-122
  9. J. Banks, M. Bennamoun, and P. Corke "Nonparametric technique for fast and robust stereo matching", in Proceedings of IEEE TENCON - Speech and Image Technologies for Computing and Telecommunication, 1997, pp. 365-368
  10. C. Jaynes, F. Stolle, and R. Collin, "Task driven perceptual organization for extraction of rooftop polygons," IEEE Workshop on Application of Computer Vision, pp. 152-159, 1994
  11. R. Zabih and J. Woodfill, "A non-parametric approach to visual correspondence," Submitted to IEEE Transactions on Pattern Analysis and Machine Intelligence
  12. Z. Kim and R. Nevatia, "Automatic description of complex buildings from multiple images," Computer Vision and Image Understanding, vol. 96, pp. 60-95, 2004
  13. A. Fischer, T. Kolbe, F. Lang, A. Cremers, W. Forstner, L. Plumer, and V. Steinhage, "Extracting buildings from aerial images using hierarchical aggregation in 2D and 3D," Computer Vision and Image Understanding, vol. 72, no. 2, pp. 185-203, 1998

Cited by

  1. Context-aware Video Surveillance System vol.7, pp.1, 2012,