Korean Journal of Agricultural Science (농업과학연구)

Institute of Agricultural Science, CNU (충남대학교 농업과학연구소)
권호 표지
DOI QR코드

DOI QR Code

A study on autonomy level classification for self-propelled agricultural machines

  • Nam, Kyu-Chul (Certification, Warranty, Inspection and Standardization Team, Korea Agricultural Machinery Industry Cooperative) ;
  • Kim, Yong-Joo (Department of Biosystems Machinery Engineering, Chungnam National University) ;
  • Kim, Hak-Jin (Department of Biosystems Engineering, College of Agriculture and Life Sciences, Seoul National University) ;
  • Jeon, Chan-Woo (Department of Biosystems Engineering, College of Agriculture and Life Sciences, Seoul National University) ;
  • Kim, Wan-Soo (Institute of Agricultural Science, Chungnam National University)
  • Received : 2021.07.16
  • Accepted : 2021.08.18
  • Published : 2021.09.01
Download PDF
⟨ Previous Next ⟩

Abstract

In the field of on-road motor vehicles, the level for autonomous driving technology is defined according to J3016, proposed by Society of Automotive Engineers (SAE) International. However, in the field of agricultural machinery, different standards are applied by country and manufacturer, without a standardized classification for autonomous driving technology which makes it difficult to clearly define and accurately evaluate the autonomous driving technology, for agricultural machinery. In this study, a method to classify the autonomy levels for autonomous agricultural machinery (ALAAM) is proposed by modifying the SAE International J3016 to better characterize various agricultural operations such as tillage, spraying and harvesting. The ALAAM was classified into 6 levels from 0 (manual) to 5 (full automation) depending on the status of operator and autonomous system interventions for each item related to the automation of agricultural tasks such as straight-curve path driving, path-implement operation, operation-environmental awareness, error response, and task area planning. The core of the ALAAM classification is based on the relative roles between the operator and autonomous system for the automation of agricultural machines. The proposed ALAAM is expected to promote the establishment of a standard to classify the autonomous driving levels of self-propelled agricultural machinery.

Keywords

Acknowledgement

본 연구는 농림식품기술기획평가원의 첨단생산기술개발사업(과제번호: 318072-03 및 320026-3)의 지원에 의해 이루어진 것임.

References

  1. An MG, Park YS. 2018. Legal system of autonomous driving automobile and status of autonomous driving automobile laws at home and abroad. Convergence Security Journal 18:53-61. [in Korean]
  2. Baek SM, Kim WS, Kim YJ, Chung SO, Nam KC, Lee DH. 2020. Development of a real-time crop recognition system using a stereo camera. Korean Journal of Agricultural Science 47:315-326. [in Korean] https://doi.org/10.7744/KJOAS.20200022
  3. Blanquart JE, Sirignano E, Lenaerts B, Saeys W. 2020. Online crop height and density estimation in grain fields using LiDAR. Biosystems Engineering 198:1-14. https://doi.org/10.1016/j.biosystemseng.2020.06.014
  4. Christiansen P, Nielsen LN, Steen KA, Jorgensen RN, Karstoft H. 2016. DeepAnomaly: Combining background subtraction and deep learning for detecting obstacles and anomalies in an agricultural field. Sensors 16:1904. https://doi.org/10.3390/s16111904
  5. Fagnant DJ, Kockelman K. 2015. Preparing a nation for autonomous vehicles: Opportunities, barriers and policy recommendations. Transportation Research Part A: Policy and Practice 77:167-181. https://doi.org/10.1016/j.tra.2015.04.003
  6. Fang H, Fan R, Thuilot B, Martinet P. 2006. Trajectory tracking control of farm vehicles in presence of sliding. Robotics and Autonomous Systems 54:828-839. https://doi.org/10.1016/j.robot.2006.04.011
  7. Han JB, Yang KM, Sin HS, Lee JI, Lee SJ, Kim DH, Song SH, Seo KH. 2019a. Simulation based on the multibody dynamics for verification of autonomous driving control of agricultural robot. Journal of Institute of Control, Robotics, and Systems 25:902-909. [in Korean] https://doi.org/10.5302/J.ICROS.2019.19.0064
  8. Han XZ, Kim HJ, Kim JY, Yi SY, Moon HC, Kim JH, Kim YJ. 2015. Path-tracking simulation and field tests for an auto-guidance tillage tractor for a paddy field. Computers and Electronics in Agriculture 112:161-171. https://doi.org/10.1016/j.compag.2014.12.025
  9. Han XZ, Kim HJ, Jeon CW, Kim JH. 2019b. Simulation study to develop implement control and headland turning algorithms for autonomous tillage operations. Journal of Biosystems Engineering 44:245-257. https://doi.org/10.1007/s42853-019-00035-9
  10. Han XZ, Kim HJ, Jeon CW, Moon HC, Kim JH, Yi SY. 2019c. Application of a 3D tractor-driving simulator for slip estimation-based path-tracking control of auto-guided tillage operation. Biosystems Engineering 178:70-85. https://doi.org/10.1016/j.biosystemseng.2018.11.003
  11. Jeon CW, Kim HJ, Yun C, Han X, Kim JH. 2021. Design and validation testing of a complete paddy field-coverage path planner for a fully autonomous tillage tractor. Biosystems Engineering 208:79-97. https://doi.org/10.1016/j.biosystemseng.2021.05.008
  12. Jeong HH, Cho KY. 2020. Development of collaborated self-control system for an automated earthworks. Journal of Drive and Control 17:181-185. [in Korean]
  13. Kayacan E, Kayacan E, Ramon H, Saeys W. 2015. Towards agrobots: Identification of the yaw dynamics and trajectory tracking of an autonomous tractor. Computers and Electronics in Agriculture 115:78-87. https://doi.org/10.1016/j.compag.2015.05.012
  14. Kim HJ, Kim JH. 2018. Auto-guidance technology for agricultural machinery. Journal of the KSME 58:42-46. [in Korean]
  15. Kim WS, Lee DH, Kim T, Kim G, Kim H, Sim T, Kim YJ. 2021a. One-shot classification-based tilled soil region segmentation for boundary guidance in autonomous tillage. Computers and Electronics in Agriculture 189:106371. https://doi.org/10.1016/j.compag.2021.106371
  16. Kim WS, Lee DH, Kim T, Kim H, Sim T, Kim YJ. 2021b. Weakly supervised crop area segmentation for an autonomous combine harvester. Sensors 21:4801.
  17. Kim WS, Lee DH, Kim YJ, Kim T, Lee HJ. 2020a. Path detection for autonomous traveling in orchards using patch-based CNN. Computers and Electronics in Agriculture 175:105620. https://doi.org/10.1016/j.compag.2020.105620
  18. Kim WS, Lee DH, Kim YJ, Kim T, Lee WS, Choi CH. 2021c. Stereo-vision-based crop height estimation for agricultural robots. Computers and Electronics in Agriculture 181:105937. https://doi.org/10.1016/j.compag.2020.105937
  19. Kim WS, Lee WS, Kim YJ. 2020b. A review of the applications of the internet of things (IoT) for agricultural automation. Journal of Biosystems Engineering 45:385-400. https://doi.org/10.1007/s42853-020-00078-3
  20. Kim YJ. 2018. A legal study on the autonomous vehicle drivers license system - focusing on the road traffic act. ChungAng Law Association 20:201-248. [in Korean]
  21. Kise M, Zhang Q, Mas FR. 2005. A stereovision-based crop row detection method for tractor-automated guidance. Biosystems Engineering 90:357-367. https://doi.org/10.1016/j.biosystemseng.2004.12.008
  22. Lee DH, Choi CH, Chung SO, Kim YJ, Lee KH, Shin BS. 2016. Development of a plow tillage cycle for an agricultural tractor. Transactions of the ASABE 59:445-454. https://doi.org/10.13031/trans.59.11208
  23. Lee DM, Kan YC, Kim JY. 2021. A study on the UX design for satisfaction with ownership of autonomous shared vehicles - focusing on customizing in boarding stage. Journal of Digital Convergence 19:275-284. [in Korean]
  24. Li Y, Lida M, Suyama T, Suguri M, Masuda R. 2020. Implementation of deep-learning algorithm for obstacle detection and collision avoidance for robotic harvester. Computers and Electronics in Agriculture 174:105499. https://doi.org/10.1016/j.compag.2020.105499
  25. Lyu HK, Park CH, Han DH, Kwak SW, Choi BD. 2018. Orchard free space and center line estimation using naive bayesian classifier for unmanned ground self-driving vehicle. Symmetry 10:355. https://doi.org/10.3390/sym10090355
  26. Mohareri O, Dhaouadi R, Rad AB. 2012. Indirect adaptive tracking control of a nonholonomic mobile robot via neural networks. Neurocomputing 88:54-66. https://doi.org/10.1016/j.neucom.2011.06.035
  27. NHTSA (National Highway Traffic Safety Administration). 2013. Department of transportation releases policy on automated vehicle development. NHTSA, Washington, D.C., USA.
  28. Noble AM, Miles M, Perez MA, Guo F, Klauer SG. 2021. Evaluating driver eye glance behavior and secondary task engagement while using driving automation systems. Accident Analysis & Prevention 151:105959. https://doi.org/10.1016/j.aap.2020.105959
  29. Noguchi N, Will J, Reid J, Zhang Q. 2004. Development of a master-slave robot system for farm operations. Computers and Electronics in Agriculture 44:1-19. https://doi.org/10.1016/j.compag.2004.01.006
  30. SAE International (Society of Automotive Engineers International). 2018. J3016 - Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles. SAE International, Warrendale, PA, USA.
  31. Song HJ, Yang KM, Oh JS, Song SH, Han JB, Seo KH. 2020. Study on the model based control considering rotary tillage of autonomous driving agricultural robot. Journal of Korea Robotics Society 15:233-239. [in Korean] https://doi.org/10.7746/jkros.2020.15.3.233
  32. Song MZ, Kabir MSN, Chung SO, Kim YJ, Ha JK, Lee KH. 2015. Path planning for autonomous lawn mower tractor. Korean Journal of Agricultural Science 42:63-71. https://doi.org/10.7744/cnujas.2015.42.1.063
  33. Stentz A, Dima C, Wellington C, Herman H, Stager D. 2002. A system for semi-autonomous tractor operations. Autonomous Robots 13:87-104. https://doi.org/10.1023/A:1015634322857
  34. Teng Z, Noguchi N, Liangliang Y, Ishii K, Jun C. 2016. Development of uncut crop edge detection system based on laser rangefinder for combine harvesters. International Journal of Agricultural and Biological Engineering 9:21-28.
  35. Tian Z, Junfang X, Gang W, Jianbo Z. 2014. Automatic navigation path detection method for tillage machines working on high crop stubble fields based on machine vision. International Journal of Agricultural and Biological Engineering 7:29-37.
  36. Zhang C, Noguchi N, Yang L. 2016. Leader-follower system using two robot tractors to improve work efficiency. Computers and Electronics in Agriculture 121:269-281. https://doi.org/10.1016/j.compag.2015.12.015