ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Precise Geometric Registration of Aerial Imagery and LIDAR Data

  • Received : 2010.12.31
  • Accepted : 2011.05.03
  • Published : 2011.08.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we develop a registration method to eliminate the geometric inconsistency between the stereo-images and light detection and ranging (LIDAR) data obtained by an airborne multisensor system. This method consists of three steps: registration primitive extraction, correspondence establishment, and exterior orientation parameter (EOP) adjustment. As the primitives, we employ object points and linked edges from the stereo-images and planar patches and intersection edges from the LIDAR data. After extracting these primitives, we establish the correspondence between them, being classified into vertical and horizontal groups. These corresponding pairs are simultaneously incorporated as stochastic constraints into aerial triangulation based on the bundle block adjustment. Finally, the EOPs of the images are adjusted to minimize the inconsistency. The results from the application of our method to real data demonstrate that the inconsistency between both data sets is significantly reduced from the range of 0.5 m to 2 m to less than 0.05 m. Hence, the results show that the proposed method is useful for the data fusion of aerial images and LIDAR data.

Keywords

References

  1. K. Choi and I. Lee, "Image Georeferencing Using AT without GCPs for a UAV-based Low-Cost Multisensor System," Korean J. Geomatics, vol. 27, no. 2, Apr. 2009, pp. 249-260.
  2. K. Choi et al., "Developing a UAV-Based Rapid Mapping System for Emergency Response," Proc. SPIE, vol. 7332, 2009, pp. 733209-733209-12.
  3. K. Choi et al, "A Project Overview for the Development of a Light and Flexible Rapid Mapping System for Emergency Response," Proc. 21st ISPRS Congress, 2008, pp. 915-920.
  4. A. Habib, M. Ghanma, and E.-M. Kim, "LIDAR Data for Photogrammetric Georeferencing," Proc. FIG Working Week and GSDI-8, 2005.
  5. S.W. Shin et al., "Algorithms for Multi-sensor and Multi-primitive Photogrammetric Triangulation," ETRI J., vol. 29, no. 4, Aug. 2007, pp. 411-420. https://doi.org/10.4218/etrij.07.0106.0268
  6. T. Schenk and C. Bea, "Fusion of LIDAR Data and Aerial Imagery for a Complete Surface Description," Int. Archives Photogrammetry Remote Sens., 2002, pp. 310-317.
  7. R. Ma, Building Model Reconstruction from LIDAR Data and Aerial Photographs, PhD Dissertation, Ohio State University, 2004.
  8. L. Chen et al., "Building Reconstruction from LIDAR Data and Aerial Imagery," Proc. IEEE Int. Geosci. Remote Sens. Symp., 2005, pp. 2846-2849.
  9. D. Lee, K. Lee, and S. Lee, "Fusion of LIDAR and Imagery for Reliable Building Extraction," Photogrammetric Eng. Remote Sens., vol. 74, no. 2, Feb. 2008, pp. 215-225. https://doi.org/10.14358/PERS.74.2.215
  10. D. Satale and M. Kulkami, "LIDAR in Mapping," Map India Conf. GIS Development, 2003. http://www.gisdevelopment.net/ technology/gis/mio03129.htm (Laser accessed March 28, 2006)
  11. L. Chen, T. Teo, Y. Shao, Y. Lai, and J. Rau, "Fusion of LIDAR Data and Optical Imagery for Building Modeling," Int. Archives Photogrammetry Remote Sens., vol. 35, no. B4, 2004, pp. 732- 737.
  12. A. Habib and T. Schenk, "A New Approach for Matching Surfaces from Laser Scanners and Optical Sensors," Int. Archives Photogrammetry Remote Sens., vol. 35, no. 3W14, 1999, pp. 55-61.
  13. P. Ronnholm et al., "Registration of Airborne Laser Scanning Point Clouds with Aerial Images through Terrestrial Image Blocks," ISPRS J., vol. 37, part B1, Dec. 2008, pp. 473-479.
  14. W. Zhao, D. Nister, and S. Hsu, "Alignment of Continuous Video onto 3D Point Cloud," Proc. CVPR, 2004, pp. 1305-1318.
  15. C. Dold and C. Brenner, "Registration of Terrestrial Laser Scanning Data Using Planar Patches and Image Data," IAPRS J., vol. 36, no. 5, Sept. 2006, pp. 78-83.
  16. K. Al-Manasir and C.S. Fraser, "Automatic Registration of Terrestrial Laser Scanner Data via Imagery," " IAPRS J., vol. 36, no. 5, Sept. 2006, pp. 26-31.
  17. E. Heinrich and O. Timm, "Utilization of Ground Control Points for Image Orientation without Point Identification in Image Space," Proc. SPIE, 1994, pp. 206-211.
  18. J. Kilian, N. Haala, and M. Englich, "Capture and Evaluation of Airborne Laser Scanner Data," Int. Archives Photogrammetry Remote Sens., 1996, pp. 383-388.
  19. T.S. Kwak et al., "Registration of Aerial Imagery and Aerial LiDAR Data Using Centroids of Plane Roof Surfaces as Control Information," KSCE J. Civil Eng., vol. 10, no. 5, Sept. 2006, pp. 365-370. https://doi.org/10.1007/BF02830090
  20. I. Lee, S.J. Kim, and Y. Choi, "Surface-Based Geometric Registration of Aerial Images and LIDAR Data," Korean J. Geomatics, vol. 5, no. 1, Dec. 2005, pp. 35-42.
  21. A. Habib et al., "Photogrammetric and LIDAR Data Registration Using Linear Features," Photogrammetric Eng. Remote Sens., vol. 71, no. 6, June 2005, pp. 699-707. https://doi.org/10.14358/PERS.71.6.699
  22. L. Wang and U. Neumann, "A Robust Approach for Automatic Registration of Aerial Images with Untextured Aerial LiDAR Data," IEEE Conf. Computer Vision Pattern Recognition, June 2009, pp. 2623-2630.
  23. L. Liu and I. Stamon, "A Systematic Approach for 2D-Image to 3D-Range Registration in Urban Environments," Proc. Workshop Virtual Representations Modeling Large-Scale Environments, 2007.
  24. A. Habib, M. Ghanma, and E. Mitishita, "Photogrammetric Georeferencing Using LIDAR Linear and Aerial Features," Korean J. Geomatics, vol. 5, no. 1, Dec. 2005, pp. 7-19.
  25. J.B. Lee and K.Y. Yu, "Co-Registrarion of Aerial Photos, ALS Data and Digital Maps Using Linear Features," KOGSIS J., vol. 14, no. 4, Dec. 2006, pp. 37-44.
  26. A. Habib, Y. Lee, and M. Morgan, "Bundle Adjustment with Self- Calibration of Line Cameras Using Straight Lines," Proc. Joint Workshop of ISPRS WG I/2, I/5 and IV/7, 2001, unpaginated CD-ROM.
  27. I. Lee, K. Choi, and Y. Choi, "Geometric Registration of Aerial Images with LIDAR Data Using Planar Surface Patches as Control Information," Proc. ASPRS Annual Conf., 2007.
  28. I. Lee, Perceptual Organization of Surfaces, PhD Dissertation, Ohio State University, 2002.

Cited by

  1. Automated Georegistration of High-Resolution Satellite Imagery using a RPC Model with Airborne Lidar Information vol.78, pp.10, 2011, https://doi.org/10.14358/pers.78.10.1045
  2. Registration of Optical Images with Lidar Data and Its Accuracy Assessment vol.79, pp.8, 2013, https://doi.org/10.14358/pers.79.8.731
  3. Automatic Parameter Selection for Intensity-Based Registration of Imagery to LiDAR Data vol.54, pp.12, 2011, https://doi.org/10.1109/tgrs.2016.2594294
  4. Registration of Aerial Optical Images with LiDAR Data Using the Closest Point Principle and Collinearity Equations vol.18, pp.6, 2018, https://doi.org/10.3390/s18061770
  5. Automatic Registration Between Low-Altitude LiDAR Point Clouds and Aerial Images Using Road Features vol.46, pp.12, 2011, https://doi.org/10.1007/s12524-018-0851-6
  6. Automatic Registration of Optical Images with Airborne LiDAR Point Cloud in Urban Scenes Based on Line-Point Similarity Invariant and Extended Collinearity Equations vol.19, pp.5, 2011, https://doi.org/10.3390/s19051086