ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Real-Time License Plate Detection in High-Resolution Videos Using Fastest Available Cascade Classifier and Core Patterns

  • Han, Byung-Gil (IT Convergence Technology Research Laboratory, ETRI) ;
  • Lee, Jong Taek (IT Convergence Technology Research Laboratory, ETRI) ;
  • Lim, Kil-Taek (IT Convergence Technology Research Laboratory, ETRI) ;
  • Chung, Yunsu (IT Convergence Technology Research Laboratory, ETRI)
  • Received : 2014.08.07
  • Accepted : 2014.11.12
  • Published : 2015.04.01
Download PDF
⟨ Previous Next ⟩

Abstract

We present a novel method for real-time automatic license plate detection in high-resolution videos. Although there have been extensive studies of license plate detection since the 1970s, the suggested approaches resulting from such studies have difficulties in processing high-resolution imagery in real-time. Herein, we propose a novel cascade structure, the fastest classifier available, by rejecting false positives most efficiently. Furthermore, we train the classifier using the core patterns of various types of license plates, improving both the computation load and the accuracy of license plate detection. To show its superiority, our approach is compared with other state-of-the-art approaches. In addition, we collected 20,000 images including license plates from real traffic scenes for comprehensive experiments. The results show that our proposed approach significantly reduces the computational load in comparison to the other state-of-the-art approaches, with comparable performance accuracy.

Keywords

References

  1. S. Du et al., "Automatic License Plate Recognition (ALPR): A State-of-the-Art Review," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 2, Feb. 2013, pp. 311-325. https://doi.org/10.1109/TCSVT.2012.2203741
  2. C.-N.E. Anagnostopoulos et al., "License Plate Recognition from Still Images and Video Sequences: A Survey," IEEE Trans. Intell. Transp. Syst., vol. 9, no. 3, Sept. 2008, pp. 377-391. https://doi.org/10.1109/TITS.2008.922938
  3. J.T. Lee et al., "Real-Time Illegal Parking Detection in Outdoor Environments Using 1-D Transformation," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no.7, July 2009, pp.1014-1024. https://doi.org/10.1109/TCSVT.2009.2020249
  4. P. Viola and M.J. Jones, "Robust Real-Time Face Detection," Int. J. Comput. Vis., vol. 57, no. 2, May 2004, pp. 137-154. https://doi.org/10.1023/B:VISI.0000013087.49260.fb
  5. B. Froba and A. Ernst, "Face Detection with the Modified Census Transform," IEEE Int. Conf. Automat. Face Gesture Recogn., Seoul, Rep. of Korea, May 17-19, 2004, pp. 91-96.
  6. Y. Lee et al., "License Plate Detection Using Local Structure Patterns," IEEE Int. Conf. Adv. Video Signal Based Surveillance, Boston, MA, USA, Aug. 30-Sept. 1, 2010, pp. 574-579.
  7. H. Sheng et al., "Real-Time Anti-Interference Location of Vehicle License Plates Using High-Definition Video," IEEE Intell. Transp. Syst. Mag., vol. 1, no. 4, 2009, pp. 17-23. https://doi.org/10.1109/MITS.2010.935911
  8. Y. Yoon et al., "Best Combination of Binarization Methods for License Plate Character Segmentation," ETRI J., vol. 35, no. 3, June 2013, pp. 491-500. https://doi.org/10.4218/etrij.13.0112.0545
  9. D. Zheng, Y. Zhao, and J. Wang, "An Efficient Method of License Plate Location," Pattern Recogn. Lett., vol. 26, no. 15, Nov. 2005, pp. 2431-2438. https://doi.org/10.1016/j.patrec.2005.04.014
  10. B. Hongliang and L. Changping, "A Hybrid License Plate Extraction Method Based on Edge Statistics and Morphology," Int. Conf. Pattern Recogn., Cambridge, UK, vol. 2, Aug. 23-26, 2004, pp. 831-834.
  11. W. Jia, H. Zhang, and X. He, "Region-Based License Plate Detection," J. Netw. Comput. Appl., vol. 30, no. 4, Nov. 2007, pp. 1324-1333. https://doi.org/10.1016/j.jnca.2006.09.010
  12. T. Ojala, M. Pietikainen, and T. Maenpaa, "Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, July 2002, pp. 971-987. https://doi.org/10.1109/TPAMI.2002.1017623
  13. R. Zabih and J. Woodfill, "Non-parametric Local Transforms for Computing Visual Correspondence," European Conf. Comput. Vis., Stockholm, Sweden, May 2-6, 1994, pp. 151-158.
  14. W.-H. Yun et al., "Disguised-Face Discriminator for Embedded Systems," ETRI J., vol. 32, no. 5, Oct. 2010, pp. 761-765. https://doi.org/10.4218/etrij.10.1510.0139
  15. D. Lee et al., "Robust Sign Recognition System at Subway Stations Using Verification Knowledge," ETRI J., vol. 36, no. 5, Oct. 2014, pp. 696-703. https://doi.org/10.4218/etrij.14.2214.0007
  16. H. Zhang et al., "Learning-Based License Plate Detection Using Global and Local Features," Int. Conf. Pattern Recogn., Hong Kong, China, vol. 2, Aug. 20-24, 2006, pp. 1102-1105.
  17. L. Dlagnekov, "License Plate Detection Using AdaBoost," Comput. Sci. University of California, San Diego, CA, USA, 2004.
  18. B. Jun and D. Kim, "Robust Face Detection Using Local Gradient Patterns and Evidence Accumulation," Pattern Recogn., vol. 45, no. 9, Sept. 2012, pp. 3304-3316. https://doi.org/10.1016/j.patcog.2012.02.031
  19. K.-D. Ban et al., "Tiny and Blurred Face Alignment for Long Distance Face Recognition," ETRI J., vol. 33, no. 2, Apr. 2011, pp. 251-258. https://doi.org/10.4218/etrij.11.1510.0022
  20. B. Wu et al., "Fast Rotation Invariant Multi-view Face Detection Based on Real AdaBoost," IEEE Int. Conf. Autom. Face Gesture Recogn., Seoul, Rep. of Korea, May 17-19, 2004, pp. 79-84.

Cited by

  1. License plate localization in complex scenes based on oriented FAST and rotated BRIEF feature vol.24, pp.5, 2015, https://doi.org/10.1117/1.jei.24.5.053011
  2. 옥외영상의 개선된 차량번호판 인식기술 vol.26, pp.5, 2015, https://doi.org/10.5391/jkiis.2016.26.5.423
  3. License Plate Recognition System Using Artificial Neural Networks vol.39, pp.2, 2015, https://doi.org/10.4218/etrij.17.0115.0766
  4. Evaluation methodology for license plate recognition systems and experimental results vol.12, pp.5, 2018, https://doi.org/10.1049/iet-its.2017.0138
  5. An image enhancement-based License plate detection method for Naturally Degraded Images vol.22, pp.4, 2015, https://doi.org/10.7471/ikeee.2018.22.4.1188
  6. Chinese license plate image database building methodology for license plate recognition vol.28, pp.1, 2015, https://doi.org/10.1117/1.jei.28.1.013001
  7. Automatic license plate detection and recognition framework to enhance security applications vol.28, pp.1, 2019, https://doi.org/10.1117/1.jei.28.1.013036
  8. Effects of Challenging Weather and Illumination on Learning-Based License Plate Detection in Noncontrolled Environments vol.2019, pp.None, 2019, https://doi.org/10.1155/2019/6897345
  9. New approach to vehicle license plate location based on new model YOLO‐L and plate pre‐identification vol.13, pp.7, 2015, https://doi.org/10.1049/iet-ipr.2018.6449
  10. License Plate Image Generation using Generative Adversarial Networks for End-To-End License Plate Character Recognition from a Small Set of Real Images vol.10, pp.8, 2015, https://doi.org/10.3390/app10082780
  11. A Method of Counting Vehicle with High Accuracy Using YOLO v3 vol.29, pp.3, 2021, https://doi.org/10.7467/ksae.2021.29.3.283