IP Library Granted Patent US 12,608,003
Granted Patent B2
US 12,608,003 · App. 17/804,086 · Granted Apr 21, 2026

Material detection and handling of material irregularities

Inventor: Tobias Blume (Marktoberdorf, DE)
Assignee: AGCO International GmbH
G05D1/0219A01B69/008G05D1/00G05D1/221G05D2105/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,608,003
App. No.
17/804,086
Granted
Apr 21, 2026
Kind
B2
Abstract

Methods and systems for guiding movement of an agricultural system within a field including sensor data indicative of an environment of the agricultural system used to identify a material profile along which the agricultural system shall be guided, one or more properties of the material profile determined from the sensor data and in particular properties indicative of an irregularity in the material profile, determination of a correcting path segment for guiding movement of the agricultural system with respect to the material profile irregularity, and movement of the agricultural system controlled along the determined correcting path segment.

Claims (81)

1 . A method of guiding movement of an agricultural system within a field, the method comprising:

receiving sensor data indicative of an environment of an agricultural system, the sensor data comprising two-dimensional (2D) image data and three-dimensional (3D) image data;

fusing the 2D image data and the 3D image data and identifying overlapping edges by identifying which edges from the 3D image data overlap with edges from the 2D image data;

merging the overlapping edges of the 3D image data and the 2D image data into merged edges;

identifying, from the sensor data and based at least partially on the merged edges, a material profile of a swath windrow of previously processed crop material along which the agricultural system shall be guided;

determining at least one property of the material profile from the sensor data indicative of an irregularity in the material profile;

determining whether a global path is available, wherein the global path is predetermined based at least partially on at least one of:

previous operations performed within the environment; and

previously collected sensed data of the environment;

responsive to a determination that the global path is available, determining a correcting path segment with respect to the global path for guiding movement of the agricultural system with respect to the irregularity in the material profile;

responsive to a determination that the global path is not available, performing one or more alternative path planning procedures, comprising:

determining whether the agricultural system is located in a headland of the environment;

determining whether a field contour is available;

based at least partially on whether or not the agricultural system is determined to be located in a headland of the environment and whether or not a field contour is available, determining an alternative correcting path segment; and

controlling movement of the agricultural system along one of the correcting path segment or the alternative correcting path segment.

2 . The method of claim 1 , comprising identifying, from the sensor data, an end of a material profile irregularity and determining the correcting path segment in dependence thereon.

3 . The method of claim 1 , wherein the material profile irregularity comprises disrupted material; flattened material; or a misalignment of the material with respect to a global path.

4 . The method of claim 1 , wherein determining a correcting path segment with respect to the global path comprises:

determining a guidance path between a current location of the agricultural system and the global path;

determining a guidance path from a position where the irregularity in the material profile began and following a profile of the global path; and/or

determining a guidance path between the position where the irregularity of the material profile began and a position on the global path corresponding to an end of the material profile irregularity.

5 . The method of claim 1 , further comprising:

responsive to a determination that the agricultural system is not located in a headland of the environment, performing a second path planning procedure.

6 . The method of claim 5 , wherein the second path planning procedure comprises:

analysing the sensor data;

determining at least one data point which correspond to material within the environment; and

determining a global path in dependence on an identification of a section of material within the environment.

7 . The method of claim 1 , further comprising:

responsive to a determination that the agricultural system is located in a headland of the environment, performing a third or fourth path planning procedure.

8 . The method of claim 1 , further comprising:

responsive to information indicative of the field contour not being available, performing a third path planning procedure comprising:

analyzing the sensor data to determine at least one data point which corresponds to material within the environment;

identifying a curved contour of material traversed or to be traversed by the agricultural system;

determining a radius of curvature of the curved contour; and

determining a correcting path segment as an extension of a (part) circular path passing through the points of the curved contour and extending from a beginning of the irregularity in the material profile at least partly towards an end of the irregularity in the material profile.

9 . The method of claim 1 , further comprising:

determining whether information indicative of a contour of the field is available; and

when the information indicative of the field contour is available, performing a fourth path planning procedure comprising:

determining an offset distance between a boundary of the field with respect to at least one section of material corresponding to a regular material profile; and

determining a correcting path segment as a guidance path correlated to the field contour and starting from a beginning of the irregularity in the material profile;

wherein the field contour correlated guidance path is spaced from the boundary by the offset distance, or at least in dependence on the offset distance.

10 . The method of claim 1 , further comprising:

receiving sensor data from a sensor having a three-dimensional sensing region;

receiving sensor data from a sensor having a two-dimensional sensing region; and

determining the at least one material property from a fusion of sensor data from the sensor having a three-dimensional sensing region and the sensor having a two-dimensional sensing region.

11 . The method of claim 3 ,

wherein, responsive to the material profile irregularity comprising disrupted material, determining an end of the material profile irregularity at a point where a region of uniform or regular material ahead of the agricultural system is identified in the sensor data, and

wherein, responsive to the material profile irregularity comprising flattened material, determining an end of the material profile irregularity at a point where the profile is no longer flattened.

12 . The method of claim 1 , further comprising determining a primary guidance path for the agricultural system for a region of the field beyond the material profile irregularity, where the beginning of the primary guidance path is defined at an end of the material profile irregularity.

13 . A control system for controlling movement of an agricultural system within a field, the control system comprising one or more controllers configured to:

receive sensor data indicative of an environment of an agricultural system, the sensor data comprising two-dimensional (2D) image data and three-dimensional (3D) image data;

fusing the 2D image data and the 3D image data and identifying overlapping edges by identifying which edges from the 3D image data overlap with edges from the 2D image data;

merging the overlapping edges of the 3D image data and the 2D image data into merged edges;

identify, from the sensor data and based at least partially on the merged edges, a material profile of a swath windrow of previously processed crop material along which movement of the agricultural system shall be guided;

determine at least one property of the material profile indicative of an irregularity in the material profile;

determine whether a global path is available, wherein the global path is predetermined based at least partially on at least one of:

previous operations performed within the environment; and

previously collected sensed data of the environment;

responsive to a determination that the global path is available, determine a correcting path segment with respect to the global path for guiding movement of the agricultural system with respect to the determined material profile irregularity;

responsive to a determination that the global path is not available, perform one or more alternative path planning procedures, comprising,

determining whether or not the agricultural system is located in a headland of the environment;

determining whether a field contour is available;

based at least partially on whether or not the agricultural system is determined to be located in a headland of the environment and whether or not a field contour is available, determining an alternative correcting path segment; and

control movement of the agricultural system along one of the correcting path segment or the alternative correcting path segment.

14 . An agricultural system comprising:

a control system comprising one or more controllers configured to:

receive sensor data indicative of an environment of an agricultural system, the sensor data comprising two-dimensional (2D) image data and three-dimensional (3D) image data;

fuse the 2D image data and the 3D image data and identify overlapping edges by identifying which edges from the 3D image data overlap with edges from the 2D image data;

merge the overlapping edges of the 3D image data and the 2D image data into merged edges;

identify, from the sensor data and based at least partially on the merged edges, a material profile of a swath windrow of previously processed crop material along which movement of the agricultural system shall be guided;

determine at least one property of the material profile indicative of an irregularity in the material profile;

determine whether a global path is available, wherein the global path is predetermined based at least partially on at least one of:

previous operations performed within the environment; and

previously collected sensed data of the environment;

responsive to a determination that the global path is available, determine a correcting path segment with respect to the global path for guiding movement of the agricultural system with respect to the determined material profile irregularity;

responsive to a determination that the global path is not available, perform one or more alternative path planning procedures, comprising:

determining whether or not the agricultural system is located in a headland of the environment;

determining whether a field contour is available; and

based at least partially on whether or not the agricultural system is determined to be located in a headland of the environment and whether or not a field contour is available, determining an alternative correcting path segment; and

control movement of the agricultural system along one of the correcting path segment or the alternative correcting path segment.

15 . The method of claim 1 , further comprising determining the correcting path segment between a location of the agricultural system and an end of the material profile irregularity to guide the agricultural system from a current location to a primary guidance path.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2022
From: BLUME, TOBIAS
To: AGCO INTERNATIONAL GMBH
Reel/Frame 060019/0647 →
Priority Claims (1)
GB 2107499 · May 26, 2021 · national
Continuity (1)
Related Publication 20220382290A1 · Dec 1, 2022
References Cited (23)
US 8214111B2 · Heiniger · 2012 [cited by examiner]
US 11582903B1 · Brown · 2023 [cited by examiner]
US 20050102079A1 · Hofer et al. · 2005 [cited by applicant]
US 20080065286A1 · Han · 2008 [cited by examiner]
US 20090118904A1 · Birnie · 2009 [cited by examiner]
US 20180188366A1 · Kemmer · 2018 [cited by examiner]
US 20180373264A1 · Madsen et al. · 2018 [cited by applicant]
US 20190208695A1 · Graf Plessen · 2019 [cited by examiner]
US 20220382290A1 · Blume · 2022 [cited by examiner]
EP 1769662A1 · 2007 [cited by applicant]
JP 2019170271 · 2019 [cited by examiner]
WO 2020037003A1 · 2020 [cited by applicant]
Zhang, Xiya et al. “Automated Robust Crop-Row Detection in Maize Fields Based on Position Clustering Algorithm and Shortest Path Method.” Computers and electronics in agriculture 154 (2018): 165-175. Web. (Year: 2018). [cited by examiner]
Souza, Iuri R., Mauricio C. Escarpinati, and Daniel D. Abdala. “A Curve Completion Algorithm for Agricultural Planning.” Proceedings of the 33rd Annual ACM Symposium on Applied Computing. New York, NY, USA: ACM, 2018. 2… [cited by examiner]
JP-2019170271-A translation (Year: 2019). [cited by examiner]
Mohammadreza Beygifard Automated driving for a UGV for agriculture 4.0. Politecnico di Torino, Corso di laurea magistrale in Mechatronic Engineering (Ingegneria Meccatronica) Thesis, 2020 (Year: 2020). [cited by examiner]
J. A. R. Silva and V. Grassi, “Clothoid-Based Global Path Planning for Autonomous Vehicles in Urban Scenarios,” 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia, 2018, pp. 4… [cited by examiner]
S. Sedighi, D. . -V. Nguyen, P. Kapsalas and K. . -D. Kuhnert, “Implementing Voronoi-based Guided Hybrid A* in Global Path Planning for Autonomous Vehicles, ” 2019 IEEE Intelligent Transportation Systems Conference (ITS… [cited by examiner]
Executive summary, J. Giesbrecht Defence R&D Canada—Suffield, Global Path Planning for Unmanned Ground Vehicles, Technical Memorandum DRDC Suffield TM 2004-272 Dec. 2004 (Year: 2004). [cited by examiner]
Mohammadreza Beygifard, Automated driving for a UGV for agriculture 4.0., Rel Politecnico di Torino, Corso di laurea magistrale in Mechatronic Engineering (Ingegneria Meccatronica) Thesis, 2020 (Year: 2020). [cited by examiner]
UK Intellectual Property Office, Search report for UK priority Application No. GB2107499.2, dated Feb. 4, 2022. [cited by applicant]
Zhang Xiya et al, “Automated robust crop-row detection in maire fields based on position clustering algorithm and shortest path method”, Computers and Electronics in Agriculture, 2018, vol. 154, pp. 165-175, as cited in… [cited by applicant]
Souza, et al., “A curve completion algorithm for agricultural planning”, Applied Computing, 2018, pp. 284-291, as cited in GB SR. [cited by applicant]