IP Library Granted Patent US 12,093,347
Granted Patent B2
US 12,093,347 · App. 18/111,067 · Granted Sep 17, 2024

Systems and methods for residue bunch detection

Inventor: Christopher Nicholas Warwick (Hertfordshire, GB)
G06F18/2413G06T7/50G06T7/60G06V10/443G06V20/56A01B79/005G06T2207/30188G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,093,347
App. No.
18/111,067
Granted
Sep 17, 2024
Kind
B2
Abstract

In one aspect, a method for detecting residue bunches within a field includes receiving one or more images depicting an imaged portion of an agricultural field, with the imaged portion of the field being at least partially represented by a plurality of pixels within the one or more images. The method also includes classifying a portion of the plurality of pixels that are associated with crop residue within the imaged portion of the field as residue pixels, with each residue pixel being associated with a respective pixel height. Additionally, the method includes identifying each residue pixel having a pixel height that exceeds a pixel height threshold as a candidate residue bunch pixel, and determining whether a residue bunch is present within the imaged portion of the field based at least in part on the candidate residue bunch pixels.

Claims (44)

1. A method for detecting residue bunches within a field, the method comprising:

receiving, with a computing system, one or more images depicting an imaged portion of an agricultural field, the imaged portion of the field being at least partially represented by a plurality of pixels within the one or more images;

classifying, with the computing system, a portion of the plurality of pixels that are associated with crop residue within the imaged portion of the field as residue pixels, each residue pixel being associated with a respective pixel height;

identifying, with the computing system, each residue pixel having a pixel height that exceeds a pixel height threshold as a candidate residue bunch pixel;

determining an area associated with the candidate residue bunch pixels;

comparing the area to a predetermined area threshold; and

determining that a residue bunch is present within the imaged portion of the field when the area associated with the candidate residue bunch pixels exceeds the predetermined area threshold.

2. The method of claim 1 , wherein the one or more images comprise a depth image of the imaged portion of the agricultural field, each of the plurality of pixels within the depth image being associated with a respective pixel height.

3. The method of claim 2 , further comprising generating, with the computing system, a slope-corrected depth image in which the depth image is corrected based on an estimated slope of the imaged portion of the field, the pixel height of each of the plurality of pixels deriving from the slope-corrected depth image.

4. The method of claim 2 , further comprising:

determining, with the computing system, a reference height based on at least a portion of the respective pixel heights of the plurality of pixels within the depth image; and

defining, with the computing system, the pixel height threshold based at least in part on the reference height.

5. The method of claim 4 , wherein determining the reference height comprises calculating the reference height based at least in part on a height associated with a predetermined percentile of the pixel heights of the residue pixels.

6. The method of claim 4 , further comprising classifying, with the computing system, another portion of the plurality of pixels that are associated with soil within the imaged portion of the field as soil pixels, each soil pixel being associated with a respective pixel height;

wherein determining the reference height comprises:

calculating an average height of the soil based at least in part on the pixel heights of the soil pixels; and

calculating the reference height based at least in part on the average height of the soil.

7. The method of claim 4 , wherein defining the pixel height threshold comprises setting the pixel height threshold as a summation of the reference height and a predetermined height value.

8. The method of claim 1 , further comprising:

generating, with the computing system, a residue bunch mask of the candidate residue bunch pixels, the area associated with the candidate residue bunch pixels comprising a pixel area of the candidate residue bunch pixels within the residue bunch mask.

9. The method of claim 1 , further comprising, when it is determined that a residue bunch is present within the imaged portion of the field, calculating a height associated with the detected residue bunch.

10. The method of claim 1 , wherein receiving the one or more images comprises receiving the one or more images from an imaging devices supported relative to an agricultural machine, the one or more images being captured by the imaging device as the agricultural machine travels across the field.

11. The method of claim 10 , further comprising initiating, with the computing system, a control action associated with adjusting an operation of the agricultural machine based at least in part on the determination that a residue bunch is present within the imaged portion of the field.

12. A system for detecting residue bunches within a field, the system comprising:

an imaging device configured to capture one or more images depicting an imaged portion of the field, the imaged portion of the field being at least partially represented by a plurality of pixels within the one or more images; and

a computing system communicatively coupled to the imaging device, the computing system including a processor and associated memory, the memory storing instructions that, when implemented by the processor, configure the computing system to:

receive the one or more images from the imaging devices;

classify a portion of the plurality of pixels that are associated with crop residue within the imaged portion of the field as residue pixels, each residue pixel being associated with a respective pixel height;

identify each residue pixel having a pixel height that exceeds a pixel height threshold as a candidate residue bunch pixel;

determine an area associated with the candidate residue bunch pixels;

compare the area to a predetermined area threshold; and

determine that a residue bunch is present within the imaged portion of the field when the area associated with the candidate residue bunch pixels exceeds the predetermined area threshold.

13. The system of claim 12 , wherein:

the one or more images comprise a depth image of the imaged portion of the agricultural field, with each of the plurality of pixels within the depth image being associated with a respective pixel height;

the computing system is configured to determine a reference height based on at least a portion of the respective pixel heights of the plurality of pixels within the depth image, the pixel height threshold being defined based at least in part on the reference height.

14. The system of claim 13 , wherein the computing system is configured to determine the reference height by calculating the reference height based at least in part on a height associated with a predetermined percentile of the pixel heights of the residue pixels.

15. The system of claim 13 , wherein:

the computing system is further configured to classify another portion of the plurality of pixels that are associated with soil within the imaged portion of the field as soil pixels, with each soil pixel being associated with a respective pixel height; and

the computing system is configured to determine the reference height based at least in part on an average height of the soil calculated based at least in part on the pixel heights of the soil pixels.

16. The system of claim 12 , wherein the computing system is further configured to generate a residue bunch mask of the candidate residue bunch pixels, the area associated with the candidate residue bunch pixels comprising a pixel area of the candidate residue bunch pixels within the residue bunch mask.

17. The system of claim 12 , wherein, when it is determined that a residue bunch is present within the imaged portion of the field, the computing system is further configured to calculate a height associated with the detected residue bunch.

18. The system of claim 12 , wherein:

the imaging device is supported relative to an agricultural machine such that the one or more images are captured as the agricultural machine travels across the field; and

the computing system is further configured to initiate a control action associated with adjusting an operation of the agricultural machine based at least in part on the determination that a residue bunch is present within the imaged portion of the field.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2024
From: CNH INDUSTRIAL AMERICA LLC
To: BLUE LEAF I.P., INC.
Reel/Frame 069385/0726 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE APPLICATION NUMBER PREVIOUSLY RECORDED AT REEL: `062731 FRAME: 0462. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 22, 2023
From: WARWICK, CHRISTOPHER NICHOLAS; LTD., SAGENTIA
To: CNH INDUSTRIAL AMERICA LLC
Reel/Frame 063281/0127 →
Continuity (2)
Continuation 17174754 · Feb 12, 2021
Related Publication 20230205848A1 · Jun 29, 2023