Symbol recognition using vectorial signature matching for building mechanical drawings

  • Cho, Chi Yon (Department of Civil and Environmental Engineering, Carnegie Mellon University) ;
  • Liu, Xuesong (Department of Civil and Environmental Engineering, Carnegie Mellon University) ;
  • Akinci, Burcu (Department of Civil and Environmental Engineering, Carnegie Mellon University)
  • Received : 2018.09.29
  • Accepted : 2019.02.14
  • Published : 2019.04.25


Operation and Maintenance (O&M) phase is the main contributor to the total lifecycle cost of a building. Previous studies have described that Building Information Models (BIM), if available with detailed asset information and their properties, can enable rapid troubleshooting and execution of O&M tasks by providing the required information of the facility. Despite the potential benefits, there is still rarely BIM with Mechanical, Electrical and Plumbing (MEP) assets and properties that are available for O&M. BIM is usually not in possession for existing buildings and generating BIM manually is a time-consuming process. Hence, there is a need for an automated approach that can reconstruct the MEP systems in BIM. Previous studies investigated automatic reconstruction of BIM using architectural drawings, structural drawings, or the combination with photos. But most of the previous studies are limited to reconstruct the architectural and structural components. Note that mechanical components in the building typically require more frequent maintenance than architectural or structural components. However, the building mechanical drawings are relatively more complex due to various type of symbols that are used to represent the mechanical systems. In order to address this challenge, this paper proposed a symbol recognition framework that can automatically recognize the different type of symbols in the building mechanical drawings. This study applied vector-based computer vision techniques to recognize the symbols and their properties (e.g., location, type, etc.) in two vector-based input documents: 2D drawings and the symbol description document. The framework not only enables recognizing and locating the mechanical component of interest for BIM reconstruction purpose but opens the possibility of merging the updated information into the current BIM in the future reducing the time of repeated manual creation of BIM after every renovation project.



Supported by : Carnegie Mellon University


  1. Ah-Soon, C. and Tombre, K. (2001), "Architectural symbol recognition using a network of constraints", Pattern Recog. Lett., 22(2), 231-248.
  2. Ahmad, N. and Haque, A.A. (2001), "Manufacturing feature recognition of parts using DXF files", 4th International Conference on Mechanical Engineering, 6, 111-115, Istanbul, December.
  3. Ahmed, S., Weber, M., Liwicki, M. and Dengel, A. (2011), "Text/graphics segmentation in architectural floor plans", Document Analysis and Recognition (ICDAR), 2011 International Conference, 734-738, IEEE, Peking, China, September.
  4. American Institute of Architects (1997), "AIA Document B141 - 1997 Part 1: Standard form of agreement between owner and architect with standard form of architect's services", U.S. Securities and Exchange Commission, Washington, D.C, U.S.A.
  5. Belongie, S., Malik, J. and Puzicha, J. (2001), "Matching shapes", ICCV 2001, Proceedings of Eighth IEEE International Conference, 454-461, IEEE, Vancouver, July.
  6. Borgefors, G. (1984), "Distance transformations in arbitrary dimensions", Comput. Vis. Graphic Image Process., 27(3), 321-345.
  7. Bortoluzzi, B., Sobieraj. D. and McArthur, J. (2017), "Automating creation of facility and energy management Building Information Models", Lean and Computation in Construction Congress, Heraklion, Greece, July, 153-160.
  8. Cho, C.Y. and Liu, X. (2017), "An automated reconstruction approach of mechanical systems in building information modeling (BIM) using 2D drawings", Comput. Civil Eng., 236-244, Seattle, Washington, U.S.A., June.
  9. Cho, C.Y. Liu, X. and Akinci, B. (2018b), "Recognizing symbols in building mechanical drawings for automated building information models reconstruction", 17th International Conference on Computing in Civil and Building Engineering, 295-302, Tampere, Finland, June.
  10. Cho, C.Y., Liu, X. and Akinci, B. (2018a), "Automated building information models reconstruction using 2D mechanical drawings", 35th CIB W78 2018 Conference (Advances in Informatics and Computing in Civil and Construction Engineering), 505-512, Chicago, Illinois, U.S.A., October.
  11. Cordella, L.P. and Vento, M. (1999), "Symbol and shape recognition", International Workshop on Graphics Recognition, 167-182, Springer, Berlin, Heidelberg, Germany, September.
  12. De, P., Mandal, S., Das, A. and Bhowmick P. (2014), "A new approach to detect and classify graphic primitives in engineering drawings", 2014 Fourth International Conference of Emerging Applications of Information Technology, Kolkata, India, 243-248.
  13. Dosch, P. and Llados, J. (2003), "Vectorial signatures for symbol discrimination", International Workshop on Graphics Recognition, 154-165, Springer, Berlin, Heidelberg, Germany, July.
  14. Dosch, P., Tombre, K., Ah-Soon, C. and Masini, G. (2000), "A complete system for the analysis of architectural drawings", J. Document Anal. Recog., 3(2), 102-116.
  15. Fallon, K.K. and Palmer, M.E. (2007), "General buildings information handover guide: Principles", NISTIR 7417; National Institute of Standards and Technology, Gaithersburg, MD, U.S.A.
  16. Gimenez, L., Robert, S., Suard, F. and Zreik, K. (2016), "Automatic reconstruction of 3D building models from scanned 2D floor plans", Automat. Construct., 63, 48-56.
  17. Goshtasby, A. (1985), "Description and discrimination of planar shapes using shape matrices", IEEE T. Pattern Anal. Machine Intell., 6, 738-743.
  18. Ha, D. and Eck, D. (2017), "A neural representation of sketch drawings", arXiv preprint arXiv:1704.03477.
  19. Jain, A.K., Duin, R.P.W. and Mao, J. (2000), "Statistical pattern recognition: A review", IEEE T. Pattern Anal., 22(1), 4-37.
  20. Lewis, R. and Sequin, C. (1998), "Generation of 3D building models from 2D architectural plans", Comput. Aided Design, 30(10), 765-779.
  21. Lin, X., Shimotsuji, S., Minoh, M. and Sakai, T. (1985), "Efficient diagram understanding with characteristic pattern detection", Comput. Vis. Graphic Image Process., 30(1), 84-106.
  22. Liu, C., Wu, J., Kohli, P. and Furukawa, Y. (2017), "Raster-to-Vector: Revisiting floorplan transformation", International Conference on Computer Vision (ICCV 2017), 2195-2203, Venice, Italy, October.
  23. Llados, J., Marti, E. and Villanueva, J.J. (2001), "Symbol recognition by error-tolerant subgraph matching between region adjacency graphs", IEEE T. Pattern Anal. Machine Intelligence, 23(10), 1137-1143.
  24. Loncaric, S. (1998), "A survey of shape analysis techniques", Pattern Recog., 31(8), 983-1001.
  25. Lu, Q. and Lee, S. (2017), "A semi-automatic approach to detect structural components from CAD drawings for constructing as-is BIM objects", Computing in Civil Engineering 2017, 84-91, Seattle, Washington, U.S.A., June.
  26. Lu, T., Tai, C.L., Su, F. and Cai, S. (2005), "A new recognition model for electronic architectural drawings", Comput. Aided Design, 37(10), 1053-1069.
  27. Maity, S.K., Seraogi, B., Das, S., Banerjee, P., Majumder, H., Mukkamala, S., Roy, R. and Chaudhuri, B.B. (2017), "An approach for detecting circular callouts in architectural, engineering and constructional drawing documents", International Workshop on Graphics Recognition, 17-29, Kyoto, November.
  28. McArthur, J.J. (2015), "A building information management (BIM) framework and supporting case study for existing building operations, maintenance and sustainability", Procedia Eng., 118, 1104-1111.
  29. Messmer, B.T. and Bunke, H. (1995), "Automatic learning and recognition of graphical symbols in engineering drawings", International Workshop on Graphics Recognition, 123-134, Berlin, Heidelberg, August.
  30. National Institute of Building Sciences buildingSMART alliance (2014), "United States National CAD Standard(R)-V6: Module 6 - Symbols", United States National CAD Standard, U.S.A.
  31. Santos, D.S., Dionisio, M., Rodrigues, N., Pereira, A. and Leiria, I.I.I. (2011), "Efficient creation of 3D models from buildings' floor plans", J. Interactive Worlds, 2011(2011), 1-30.
  32. Schettini, R. (1996), "A general-purpose procedure for complex graphic symbol recognition", Cybernet. Syst., 27(4), 353-365.
  33. Tabbone, S. and Terrades, O.R. (2014), "An overview of symbol recognition", Handbook of Document Image Processing and Recognition, 523-551, Springer, London, United Kingdom.
  34. Tabbone, S., Wendling, L. and Salmon, J.P. (2006), "A new shape descriptor defined on the Radon transform", Comput. Vis. Image Und., 102(1), 42-51.
  35. Valveny, E. and Dosch, P. (2003), "Symbol recognition contest: A synthesis", International Workshop on Graphics Recognition, 368-385, Berlin, Heidelberg, Germany, July.
  36. Valveny, E. and Marti, E. (1999), "Application of deformable template matching to symbol recognition in handwritten architectural drawings", Document Analysis and Recognition, ICDAR'99: Proceedings of the Fifth International Conference, 483-486, IEEE, Bangalore, India, September.
  37. Ventura, A.D. and Schettini, R. (1994), "Graphic symbol recognition using a signature technique", Proceedings of the 12th IAPR International Conference on Pattern Recognition, 533-535, IEEE, Jerusalem, Israel, October.
  38. Xu, D., Jin, P., Zhang, X., Du, J. and Yue, L. (2015), "Extracting indoor spatial objects from CAD models: A database approach", International Conference on Database Systems for Advanced Applications, 273-279, Hanoi, Vietnam, April.
  39. Yin, Z., Guan, Y., Chen, S., Wu, W. and Zhang, H. (2013), "Off-line programming of robotic system based on dxf files of 3d models", IEEE International Conference on Information and Automation (ICIA 2013), 1296-1301, Yinchuan, China, August.
  40. Zhang, D. and Lu, G. (2004), "Review of shape representation and description techniques", Pattern Recog., 37(1), 1-19.
  41. Zhang, W. and Liu, W. (2007), "A new vectorial signature for quick symbol indexing, filtering and recognition", 9th International Conference on Document Analysis and Recognition (ICDAR 2007), 536-540, Curitiba, Parana, Brazil, September.
  42. Zhi, G.S., Lo, S.M. and Fang, Z. (2003), "A graph-based algorithm for extracting units and loops from architectural floor plans for a building evacuation model", Comput. Aid Design, 35(1), 1-14.
  43. Zhu, J., Zhang, H. and Wen, Y. (2014), "A new reconstruction method for 3D buildings from 2D vector floor plan", Comput. Aid Design Appl., 11(6), 704-714.