Methods for agronomic and agricultural monitoring using unmanned aerial systems

Inventors: Doug Sauder (Tremont, IL); Justin L. Koch (Tremont, IL); Troy L. Plattner (Tremont, IL); Phil Baurer (Tremont, IL)

Assignee: The Climate Corporation

G06T5/006 A01B79/005 G05D1/0094 G06K9/00657 G06T11/60 B64C2201/123

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 10,346,958
App. No.: 15/853,356
Granted: Jul 9, 2019
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

A method for agronomic and agricultural monitoring includes designating an area for imaging, determining a flight path above the designated area, operating an unmanned aerial vehicle (UAV) along the flight path, acquiring images of the area using a camera system attached to the UAV, and processing the acquired images.

Claims (61)

1. A method for agronomic and agricultural monitoring, the method comprising:

monitoring, by a first central processing unit (CPU) at a base station, an unmanned aerial vehicle (UAV), as the UAV flies along a flight path above an area and as the UAV performs:

capturing, by a second CPU of the UAV, a plurality of initial images of the area as the UAV flies along the flight path, and capturing one or more additional different images of one or more target areas having nitrogen levels below a certain threshold;

orthorectifying and stitching the plurality of initial images into a first single continuous area image;

orthorectifying and stitching the one or more additional different images into a second single continuous area image;

superimposing the first single continuous area image onto the second single continuous area image to generate a superimposed image;

based on the superimposed image, generating a visual animation and displaying the visual animation on a graphical user interface;

generating a partitioned image by partitioning the superimposed image into individual areas each corresponding to one plant of a plurality of plants and consistent with planting data;

identifying, in the partitioned image, one or more structures of at least one plant of the plurality of plants;

calculating an estimated yield from the at least one plant of the plurality of plants based on the one or more structures; and

generating a report based on the estimated yield.

2. The method of claim 1 , further comprising: the UAV identifying itself the one or more target areas for which the one or more different images are required as the UAV orthorectifies the plurality of initial images and identifies areas with a low-quality imagery.

3. The method of claim 1 , further comprising:

using the UAV, sending to a computing device an indication of areas having certain characteristics comprising one or more of low nitrogen levels, low crop maturity levels, or high crop shadow levels;

receiving, from the computing device, instructions to acquire one or more images of the one or more target areas for which the one or more additional different images are required;

receiving, from the computing device, an identification of the one or more target areas for which the one or more additional different images are required.

4. The method of claim 1 , further comprising: using the UAV, capturing the one or more additional different images at a higher resolution than a resolution at which the plurality of initial images was captured.

5. The method of claim 1 , further comprising, using the UAV, capturing the one or more different images at a lower elevation.

6. The method of claim 1 , further comprising: transferring the plurality of initial images and the one or more additional different images to the image recipient as the plurality of initial images and the one or more additional different images are captured by the UAV and while the UAV is airborne.

7. The method of claim 1 , further comprising: determining the flight path by:

receiving, at the base station, an input that indicates a type of image to be acquired;

receiving, at the base station, obstacle data indicating an obstacle within the area; and

determining, using the base station, the flight path based on at least in part the input and the obstacle data.

8. The method of claim 1 , further comprising: using the UAV, processing the plurality of initial images and the one or more additional different images as the UAV flies over the area.

9. The method of claim 1 , further comprising: based on the plurality of initial images and the one or more additional different images, determining a greenness density map for the area, wherein the greenness density map has an expected greenness density area depicted in a first color and other areas depicted in a second color.

10. The method of claim 1 , further comprising: processing, using the base station or a cloud computer, the plurality of initial images and the one or more additional different images by performing one or more of:

based on the plurality of initial images and the one or more additional different images, generating at least one of a normalized difference vegetation index map, or an application map for the area;

based on the plurality of initial images and the one or more additional different images, determining an emergence map for the area;

based on the plurality of initial images and the one or more additional different images, generating at least one of a normalized difference vegetation index map, or an application map;

based on the plurality of initial images and the one or more additional different images, generating one or more agronomic recommendations for the area;

wherein the processing of the plurality of initial images and the one or more different images is performed at one or more of: the base station, or a cloud system.

11. A system for agronomic and agricultural monitoring, the system comprising:

one or more processors,

one or more memory units,

one or more non-transitory computer-readable storage media storing one or more computer instructions which, when executed by the one or more processors, cause the one or more processors to perform: