IP Library Granted Patent US 12,635,680
Granted Patent B2
US 12,635,680 · App. 18/663,758 · Granted May 26, 2026

Agricultural product application field map visualization and control

Inventors: Michelle Kwak (Ankeny, IA); Andrew M. Colosky (Urbandale, IA)
Assignee: Deere & Company
A01M7/0089A01C21/005A01C23/047A01M7/0042
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,635,680
App. No.
18/663,758
Granted
May 26, 2026
Kind
B2
Abstract

A method includes obtaining image data indicative of plant matter on a field and identifying, based on the image data, one or more areas on the field in a path of an agricultural machine to apply an agricultural product. The agricultural machine includes a product application system having a plurality of actuatable applicator mechanisms, and the one or more areas includes some, but not all, of the field in the path of an agricultural machine. The method includes operating the product application system to apply the agricultural product to the one or more areas, and generating a user interface display that displays a field representation that visually distinguishes the one or more areas, identified based on the image data, from other areas on the field.

Claims (69)

1 . A method comprising:

obtaining image data indicative of plant matter on a field;

identifying, based on the image data, a plurality of discrete areas on the field in a path of an agricultural machine to apply an agricultural product, the agricultural machine comprising a product application system having a plurality of actuatable applicator mechanisms;

generating, for each respective discrete area of the plurality of discrete areas, location data identifying a respective geographic location of the respective discrete area based on the image data;

operating the product application system to apply the agricultural product to the plurality of discrete areas on the field based on the location data; and

generating a user interface display that displays a field representation with spray area display elements at display locations on the user interface display identified based on the location data.

2 . The method of claim 1 , wherein operating the product application system comprises:

selecting a mode from a plurality of product application modes based on the image data; and

operating the product application system in the mode.

3 . The method of claim 2 , wherein selecting the mode comprises:

determining a characteristic of plant matter on the field based on the image data; and

selecting the mode from the plurality of product application modes based on the characteristic.

4 . The method of claim 3 , wherein selecting the mode comprises:

generating a classification result representing a classification of the plant matter as a target plant type based on the image data;

generating a confidence metric representing the classification result;

selecting the mode from the plurality of product application modes based on comparing the confidence metric to a confidence threshold.

5 . The method of claim 4 , wherein the method comprises:

operating the product application system in a first mode based on a determination that the confidence metric is below a confidence threshold; and

operating the product application system in a second mode based on a determination that the confidence metric is above the confidence threshold.

6 . The method of claim 1 , wherein the plurality of actuatable applicator mechanisms are spaced apart along a frame of the agricultural machine.

7 . The method of claim 6 , wherein the agricultural machine comprises an agricultural sprayer and the plurality of actuatable applicator mechanisms comprise a plurality of spray nozzles.

8 . The method of claim 7 , wherein

the plurality of spray nozzles are spaced apart along the frame to define a spray width,

a first mode, of a plurality of product application modes, controls the plurality of spray nozzles to spray the agricultural product over the spray width, and

a second mode, of the plurality of product application modes, controls a set of spray nozzles based on the image data, the set of spray nozzles comprising some, but not all, of the plurality of spray nozzles.

9 . The method of claim 8 , wherein

the first mode comprises a broadcast spraying mode,

the second mode comprises a precision spraying mode, and

the user interface display comprises one or more broadcast mode display elements having a visual characteristic that identifies one or more areas on the field on which the broadcast spraying mode was performed.

10 . The method of claim 1 , wherein the field representation comprises a field map and the agricultural product comprises at least one of a herbicide, a fertilizer, or a fungicide.

11 . An agricultural machine comprising:

a product application system comprising a plurality of actuatable applicator mechanisms, each actuatable applicator mechanism, of the plurality of actuatable applicator mechanisms, configured to apply an agricultural product on a field;

an imaging system configured to obtain image data indicative of plant matter on the field; and

a control system configured to:

identify, based on the image data, a plurality of discrete areas on the field in a path of the agricultural machine to apply the agricultural product;

generate, for each respective discrete area of the plurality of discrete areas, location data identifying a respective geographic location of the respective discrete area based on the image data;

operate the product application system to apply the agricultural product to the plurality of discrete areas on the field based on the location data; and

generate a user interface display that displays a field representation with spray area display elements at display locations on the user interface display identified based on the location data.

12 . The agricultural machine of claim 11 , wherein the control system is configured to:

determine a characteristic of plant matter on the field based on the image data;

select a mode from a plurality of product application modes based on the characteristic; and

operate the product application system in the mode.

13 . The agricultural machine of claim 12 , wherein the control system is configured to:

generate a classification result representing a classification of the plant matter as a target plant type based on the image data;

generate a confidence metric representing the classification result;

operate the product application system in a first mode based on a determination that the confidence metric is below a confidence threshold; and

operate the product application system in a second mode based on a determination that the confidence metric is above the confidence threshold.

14 . The agricultural machine of claim 11 , wherein the plurality of actuatable applicator mechanisms are spaced apart along a frame of the agricultural machine.

15 . The agricultural machine of claim 14 , wherein the agricultural machine comprises an agricultural sprayer and the plurality of actuatable applicator mechanisms comprise a plurality of spray nozzles.

16 . The agricultural machine of claim 15 , wherein

the plurality of spray nozzles are spaced apart along the frame to define a spray width,

a first mode, of a plurality of product application modes, controls the plurality of spray nozzles to spray the agricultural product over the spray width, and

a second mode, of the plurality of product application modes, controls a set of spray nozzles based on the image data, the set of spray nozzles comprising some, but not all, of the plurality of spray nozzles.

17 . The agricultural machine of claim 16 , wherein

the first mode comprises a broadcast spraying mode,

the second mode comprises a precision spraying mode, and

the user interface display comprises one or more broadcast mode display elements having a visual characteristic that identifies one or more areas on the field on which the broadcast spraying mode was performed.

18 . The agricultural machine of claim 11 , wherein the field representation comprises a field map and the agricultural product comprises at least one of a herbicide, a fertilizer, or a fungicide.

19 . An agricultural machine control system comprising:

at least one processor; and

memory storing instructions executable by the at least one processor, wherein the instructions, when executed, cause the agricultural machine control system to:

obtain image data indicative of plant matter on a field;

identify, based on the image data, a plurality of discrete areas on the field in a path of an agricultural machine to apply an agricultural product, the agricultural machine comprising a product application system having a plurality of actuatable applicator mechanisms;

generating, for each respective discrete area of the plurality of discrete areas based on the image data, location data identifying a respective geographic location of the respective discrete area;

operate the product application system to apply the agricultural product to the plurality of discrete areas on the field based on the location data;

generate a field representation that visually represents at least a portion of the field;

identify a plurality of display locations based on the location data, each display location, of the plurality of display locations, identifying a location on the field representation corresponding to a respective discrete area of the plurality of discrete areas; and

generate a user interface display that displays the field representation with spray area display elements at the plurality of display locations.

20 . The agricultural machine control system of claim 19 , wherein the field representation comprises a field map and the agricultural product comprises at least one of a herbicide, a fertilizer, or a fungicide.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 14, 2024
From: KWAK, MICHELLE; COLOSKY, ANDREW M.
To: DEERE & COMPANY
Reel/Frame 067408/0791 →
Continuity (3)
Continuation 17188210 · Mar 1, 2021
Provisional Application 63107672 · Oct 30, 2020
Related Publication 20240292826A1 · Sep 5, 2024
References Cited (37)
US 8186288B2 · Chinkiwsky · 2012 [cited by examiner]
US 8488874B2 · Zaman et al. · 2013 [cited by applicant]
US 10324461B2 · Ogura · 2019 [cited by applicant]
US 10721859B2 · Wu et al. · 2020 [cited by applicant]
US 11071991B2 · Serrat et al. · 2021 [cited by applicant]
US 11197409B2 · Redden · 2021 [cited by applicant]
US 11357153B2 · Foster · 2022 [cited by examiner]
US 20140180549A1 · Siemens et al. · 2014 [cited by applicant]
US 20160125331A1 · Vollmar · 2016 [cited by applicant]
US 20190066234A1 · Bedoya · 2019 [cited by examiner]
US 20190098825A1 · Neitemeier · 2019 [cited by examiner]
US 20190107521A1 · Riley · 2019 [cited by applicant]
US 20190220666A1 · Kiepe et al. · 2019 [cited by applicant]
US 20190246617A1 · Grimm et al. · 2019 [cited by applicant]
US 20190311209A1 · Ducote et al. · 2019 [cited by applicant]
US 20200005474A1 · Ferrari · 2020 [cited by examiner]
US 20200072809A1 · Bhanu et al. · 2020 [cited by applicant]
US 20210127659A1 · Loukili et al. · 2021 [cited by applicant]
US 20220132829A1 · Kwak et al. · 2022 [cited by applicant]
US 20220138464A1 · Kwak et al. · 2022 [cited by applicant]
US 20220142142A1 · Van Alphen · 2022 [cited by applicant]
US 20230131770A1 · Stoller et al. · 2023 [cited by applicant]
CN 120612632A · 2025 [cited by examiner]
EP 1000540A1 · 2000 [cited by examiner]
WO 2019148138A1 · 2019 [cited by applicant]
WO 2020169817A1 · 2020 [cited by applicant]
WO WO2020178663A1 · 2020 [cited by examiner]
WO WO2022223282A1 · 2022 [cited by examiner]
Prosecution History for U.S. Appl. No. 17/188,320 including: Restriction Requirement dated Jul. 6, 2023 and Non Final Office Action dated Aug. 31, 2023, 23 pages. [cited by applicant]
Prosecution History for U.S. Appl. No. 17/188,258 Including: Restriction Requirement dated Feb. 16. 2023, Non Compliant Responsive Amendment dated Jul. 24, 2023 and Non Final Office Action dated Oct. 3, 2023, 23 pages. [cited by applicant]
Application and Drawings for U.S. Appl. No. 17/188,258, filed Mar. 1, 2021, 68 pages. [cited by applicant]
Application and Drawings for U.S. Appl. No. 17/188,320, filed Mar. 1, 2021. [cited by applicant]
Extended European Search Report and Written Opinion Issued in European Patent Application No. 21201772.7, dated Apr. 4, 2022, 7 pages. [cited by applicant]
Extended European Search Report and Written Opinion Issued in European Patent Application No. 21201994.7, dated May 4, 2022, 7 pages. [cited by applicant]
Extended European Search Report and Written Opinion issued in European Patent Application No. 21201980.6, dated Apr. 4, 2022, 7 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/188,210, dated Feb. 28, 2024, 8 pages. [cited by applicant]
Non Final Office Action for U.S. Appl. No. 17/188,210, dated Nov. 3, 2023, 23 pages. [cited by applicant]