DOI QR코드

DOI QR Code

Vision-based Food Shape Recognition and Its Positioning for Automated Production of Custom Cakes

주문형 케이크 제작 자동화를 위한 영상 기반 식품 모양 인식 및 측위

  • Oh, Jang-Sub (Department of Electronic Engineering, Korea National University of Transportation) ;
  • Lee, Jaesung (Department of Electronic Engineering, Korea National University of Transportation)
  • Received : 2020.08.31
  • Accepted : 2020.09.02
  • Published : 2020.10.31

Abstract

This paper proposes a vision-based food recognition method for automated production of custom cakes. A small camera module mounted on a food art printer recognizes objects' shape and estimates their center points through image processing. Through the perspective transformation, the top-view image is obtained from the original image taken at an oblique position. The line and circular hough transformations are applied to recognize square and circular shapes respectively. In addition, the center of gravity of each figure are accurately detected in units of pixels. The test results show that the shape recognition rate is more than 98.75% under 180 ~ 250 lux of light and the positioning error rate is less than 0.87% under 50 ~ 120 lux. These values sufficiently meet the needs of the corresponding market. In addition, the processing delay is also less than 0.5 seconds per frame, so the proposed algorithm is suitable for commercial purpose.

본 논문에서는 주문형 케이크의 자동화 제작을 위해 필요한 일련의 영상 기반 식품 모양 인식 및 정밀 측위 방법을 제안한다. 초소형 카메라 모듈을 푸드 아트 프린터 내부의 비스듬한 위치에 장착 후 원근 변환을 적용하여 탑 뷰(top veiw) 이미지로 전환 후 에지 검출, 직선 및 원형 허프 변환 등을 수행하도록 하여 식품의 모양을 인식하고 무게 중심 좌표를 검출하도록 하였다. 본 알고리즘을 케이크 및 떡 모형에 적용하여 테스트를 수행하였으며 그 결과 180~250 lux 범위의 조명 환경에서 98.75% 의 높은 객체 인식률을 얻을 수 있었으며 50~120 lux 범위에서 0.87% 이내의 중심점 측위 오차율을 얻을 수 있었다. 이는 수요처의 요구 사항을 충분히 만족하는 수치이며 실시간 처리 성능도 프레임당 0.5초 이내로 나타나 상용화 가능성을 충분히 갖춘 것으로 판단된다.

Keywords

References

  1. Asia Economy, A special latte art by a robot barista [Internet]. Available: https://view.asiae.co.kr/article/2020070911192438556
  2. Latte Art Printer Folletto [Internet]. Available: www.latteart-printer.com/.
  3. S. W. Seo, S. W. Joeng, Y. S. Han, J. S. Choi, and S. K. Lee, "Efficient Homography Estimation for Panoramic Image Generation," Journal of the Institute of Electronics Engineers of Korea, vol. 50, no. 8, pp. 2143-2152, Aug. 2013.
  4. P. Topno and G. Murmu, "An Improved Edge Detection Method based on Median Filter," Devices for Integrated Circuit (DevIC), Kalyani, India, pp. 378-381, Mar. 2019.
  5. J. Lian, "Two Adaptive Schemes for Image Sharpening," IEEE 2nd International Conference on Information and Computer Technologies (ICICT), Kahului, HI, USA, 2019, pp. 122-125, Mar. 2019.
  6. S. Hong and J. Lee, "An Method for Inferring Fine Dust Concentration Using CCTV," Journal of the Korea Institute of Information and Communication Engineering, vol. 23, no. 10, pp. 1234-1239, Oct. 2019.
  7. D. J. Kim and P. L. Manjusha, "Building Detection in High Resolution Remotely Sensed Images based on Automatic Histogram-Based Fuzzy C-Means Algorithm," Asia-pacific Journal of Convergent Research Interchange, vol. 3, no. 1, pp. 57-62, Mar. 2017. https://doi.org/10.21742/apjcri.2017.12.11
  8. Y. Song, B. Ma, W. Gao, and S. Fan, "Medical Image Edge Detection Based on Improved Differential Evolution Algorithm and Prewitt Operator," Acta Microscopica, vol. 28, no. 1, pp. 30-39, Feb. 2019.
  9. J. H. Cho, E. Tsogtbaatar, S. H. Kim, Y. M. Jang, P. M. L. Nguyen, and S. B. Cho, "Improved lane detection system using Hough transform with super-resolution reconstruction algorithm and multi-ROI," 2014 International Conference on Electronics, Information and Communications (ICEIC), Kota Kinabalu, pp. 1-4, 2014.
  10. S. H. Hwang and Y. J. Lee, "FPGA-based real-time lane detection for advanced driver assistance systems," 2016 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS), Jeju, pp. 218-219, 2016.
  11. S. H. Kim and H. I. Choi, "Circular Shape Detection using Improved 2D Hough Transform," in Proceedings of the KIISE conference, Seoul, pp. 233-237, 2008.
  12. OpenCV team. Open Source Computer Vision Library [Internet]. Available: https://docs.opencv.org/master/d9/df8/tutorial_root.html.
  13. D. G. Kim, C++ API OpenCV Programming, Dec. 2016.