IP Library Granted Patent US 10,902,566
Granted Patent B2
US 10,902,566 · App. 16/438,128 · Granted Jan 26, 2021

Methods for agronomic and agricultural monitoring using unmanned aerial systems

Inventors: Doug Sauder (Tremont, IL); Justin L. Koch (Tremont, IL); Troy L. Plattner (Tremont, IL); Phil Baurer (Tremont, IL)
Assignee: THE CLIMATE CORPORATION
G06T5/006A01B79/005G05D1/0094G05D1/106G06K9/00657G06T11/60B64C2201/123
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,902,566
App. No.
16/438,128
Granted
Jan 26, 2021
Kind
B2
Abstract

A method for agronomic and agricultural monitoring includes designating an area for imaging, determining a flight path above the designated area, operating an unmanned aerial vehicle (UAV) along the flight path, acquiring images of the area using a camera system attached to the UAV, and processing the acquired images.

Claims (62)

1. A method for agronomic and agricultural monitoring, the method comprising:

monitoring, by a first central processing unit (CPU) at a base station, an unmanned aerial vehicle (UAV) as the UAV flies along a flight path above an area and as the UAV performs:

capturing, by a second CPU of the UAV as the UAV flies along the flight path, a plurality of initial images of the area and capturing one or more additional different images of one or more target areas suspected of having one or more anomalies;

orthorectifying and stitching the plurality of initial images into a first single continuous area image;

orthorectifying and stitching the one or more additional different images into a second single continuous area image;

superimposing the first single continuous area image onto the second single continuous area image to generate a superimposed image;

partitioning the superimposed image into one or more areas, each area corresponding to one plant of a plurality of plants;

identifying, in the one or more areas, one or more structures, each structure corresponding to part of at least one plant of a plurality of plants depicted in the superimposed image;

for each area of one or more areas:

determining, based on the one or more structures, whether at least one anomaly, of the one or more anomalies, is present in an area; and

in response to determining, based on the one or more structures, that at least one anomaly, of the one or more anomalies, is present in the area, generating one or more agronomic recommendations for addressing the at least one anomaly, of the one or more anomalies, in the area.

2. The method of claim 1 , wherein the one or more anomalies include one or more of: white spaces determined based on a greenness density and that do not represent any desired plant from a planted population.

3. The method of claim 1 , wherein the one or more anomalies include one or more of non-crop matters such as weeds, pests, or stalks affected by diseases.

4. The method of claim 1 , wherein the one or more anomalies include a weed anomaly which is identified by determining a weed pressure value for a structure from the one or more structures by dividing a size of the structure by a size of the area.

5. The method of claim 1 , wherein a plant disease anomaly is identified by comparing a reflectivity of a crop plant identified in a structure of the one or more structures to a threshold value or to an average reflectivity value of the crop plant.

6. The method of claim 1 , wherein a pest anomaly is identified by comparing a reflectivity of a crop plant identified in a structure of the one or more structures to a threshold value or to an average reflectivity value of the crop plant.

7. The method of claim 1 , wherein a pest anomaly is identified by collecting one or more high-resolution images for one or more high-resolution structures and comparing a reflectivity of a crop plant identified in a high-resolution structure of the one or more high-resolution structures to a threshold value or to an average reflectivity value of the crop plant.

8. The method of claim 1 , further comprising:

based on at least the one or more anomalies, generating a report indicating one or more regions having certain characteristics comprising one or more of: low nitrogen levels, low crop maturity levels, or high crop shadow levels;

using the UAV, sending the report to a computing device;

receiving, from the computing device, instructions to acquire one or more new images of one or more new target areas;

receiving, from the computing device, the one or more new images of the one or more new target areas; and

identifying the one or more anomalies based on, at least in part, the one or more new images.

9. The method of claim 1 , further comprising: based on the plurality of initial images and the one or more additional different images, determining a greenness density map for the area, wherein the greenness density map has an expected greenness density area depicted in a first color and other areas depicted in a second color.

10. The method of claim 1 , further comprising: processing, using the base station or a cloud computer, the plurality of initial images and the one or more additional different images by performing one or more of:

based on the plurality of initial images and the one or more additional different images, generating at least one of a normalized difference vegetation index map, or an application map for the area;

based on the plurality of initial images and the one or more additional different images, determining an emergence map for the area;

based on the plurality of initial images and the one or more additional different images, generating at least one of a normalized difference vegetation index map, or an application map;

based on the plurality of initial images and the one or more additional different images, generating one or more agronomic recommendations for the area; and

wherein the processing of the plurality of initial images and the one or more different images is performed at one or more of: the base station, or a cloud system.

11. A system for agronomic and agricultural monitoring, the system comprising:

one or more processors, one or more memory units, one or more non-transitory computer-readable storage media storing one or more computer instructions which, when executed by the one or more processors, cause the one or more processors to perform:

monitoring, by a first central processing unit (CPU) at a base station, an unmanned aerial vehicle (UAV) as the UAV flies along a flight path above an area and as the UAV performs:

capturing, by a second CPU of the UAV as the UAV flies along the flight path, a plurality of initial images of the area and capturing one or more additional different images of one or more target areas suspected of having one or more anomalies;

orthorectifying and stitching the plurality of initial images into a first single continuous area image;

orthorectifying and stitching the one or more additional different images into a second single continuous area image;

superimposing the first single continuous area image onto the second single continuous area image to generate a superimposed image;

partitioning the superimposed image into one or more areas, each area corresponding to one plant of a plurality of plants;

identifying, in the one or more areas, one or more structures, each structure corresponding to part of at least one plant of a plurality of plants depicted in the superimposed image;

for each area of one or more areas:

determining, based on the one or more structures, whether at least one anomaly, of the one or more anomalies, is present in an area; and

in response to determining, based on the one or more structures, that at least one anomaly, of the one or more anomalies, is present in the area, generating one or more agronomic recommendations for addressing the at least one anomaly, of the one or more anomalies, in the area.

12. The system of claim 11 , wherein the one or more anomalies include one or more of: white spaces determined based on a greenness density and that do not represent any desired plant from a planted population.

13. The system of claim 11 , wherein the one or more anomalies include one or more of non-crop matters such as weeds, pests, or stalks affected by diseases.

14. The system of claim 11 , wherein a weed anomaly is identified by determining a weed pressure value for a structure from the one or more structures by dividing a size of the structure by a size of the area.

15. The system of claim 11 , wherein a plant disease anomaly is identified by comparing a reflectivity of a crop plant identified in a structure of the one or more structures to a threshold value or to an average reflectivity value of the crop plant.

16. The system of claim 11 , wherein a pest anomaly is identified by comparing a reflectivity of a crop plant identified in a structure of the one or more structures to a threshold value or to an average reflectivity value of the crop plant.

17. The system of claim 11 , wherein a pest anomaly is identified by collecting one or more high-resolution images for one or more high-resolution structures and comparing a reflectivity of a crop plant identified in a high-resolution structure of the one or more high-resolution structures to a threshold value or to an average reflectivity value of the crop plant.

18. The system of claim 11 , wherein the one or more non-transitory computer-readable storage media store additional instructions which, when executed by the one or more processors, cause the one or more processors to perform:

based on at least the one or more anomalies, generating a report indicating one or more regions having certain characteristics comprising one or more of: low nitrogen levels, low crop maturity levels, or high crop shadow levels;

using the UAV, sending the report to a computing device;

receiving, from the computing device, instructions to acquire one or more new images of one or more new target areas;

receiving, from the computing device, the one or more new images of one or more new target areas; and

identifying the one or more anomalies based on, at least in part, the one or more new images.

19. The system of claim 11 , wherein the one or more non-transitory computer-readable storage media store additional instructions which, when executed by the one or more processors, cause the one or more processors to perform: based on the plurality of initial images and the one or more additional different images, determining a greenness density map for the area, wherein the greenness density map has an expected greenness density area depicted in a first color and other areas depicted in a second color.

20. The system of claim 11 , wherein the one or more non-transitory computer-readable storage media store additional instructions which, when executed by the one or more processors, cause the one or more processors to perform:

processing, using the base station or a cloud computer, the plurality of initial images and the one or more additional different images by performing one or more of:

based on the plurality of initial images and the one or more additional different images, generating at least one of a normalized difference vegetation index map, or an application map for the area;

based on the plurality of initial images and the one or more additional different images, determining an emergence map for the area;

based on the plurality of initial images and the one or more additional different images, generating at least one of a normalized difference vegetation index map, or an application map;

based on the plurality of initial images and the one or more additional different images, generating one or more agronomic recommendations for the area; and

wherein the processing of the plurality of initial images and the one or more different images is performed at one or more of: the base station, or a cloud system.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2026
From: CLIMATE LLC
To: MONSANTO COMPANY
Reel/Frame 075177/0751 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2026
From: MONSANTO COMPANY
To: MONSANTO TECHNOLOGY LLC
Reel/Frame 075177/0908 →
CHANGE IN PRINCIPAL PLACE OF BUSINESS Recorded Sep 2, 2025
From: CLIMATE LLC
To: CLIMATE LLC
Reel/Frame 072810/0444 →
CHANGE OF ADDRESS Recorded Jul 28, 2025
From: CLIMATE LLC
To: CLIMATE LLC
Reel/Frame 072257/0429 →
CHANGE OF NAME Recorded Nov 17, 2022
From: THE CLIMATE CORPORATION
To: CLIMATE LLC
Reel/Frame 061963/0737 →