IP Library Granted Patent US 10,803,313
Granted Patent B2
US 10,803,313 · App. 16/434,935 · Granted Oct 13, 2020

Systems and methods determining plant population and weed growth statistics from airborne measurements in row crops

Inventors: Michael Ritter (San Diego, CA); Michael Milton (San Diego, CA); Peter Matusov (La Jolla, CA)
Assignee: SLANTRANGE, INC.
G06K9/00657G06K9/6232G06T7/11G06T7/174G06T7/194G06T7/62G06T2207/10016G06T2207/10036G06T2207/10041G06T2207/30188G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,803,313
App. No.
16/434,935
Granted
Oct 13, 2020
Kind
B2
Abstract

This disclosure describes a system and a method for determining statistics of plant populations based on overhead optical measurements. The system may include one or more hardware processors configured by machine-readable instructions to receive output signals provided by one or more remote sensing devices mounted to an overhead platform. The output signals may convey information related to one or more images of a land area where crops are grown. The one or more hardware processors may be configured by machine-readable instructions to distinguish vegetation from background clutter; segregate image regions corresponding to the vegetation from image regions corresponding to the background clutter; and determine a plant count per unit area.

Claims (51)

1. A system configured for classifying plants within an area, the system comprising:

non-transitory storage media storing machine-readable instructions configured to cause one or more hardware processors to:

receive output signals provided by one or more remote sensing devices mounted to an unmanned aircraft system, the output signals conveying information related to one or more images of a land area, the one or more images being spatially resolved and including one or more spectral bands within a target wavelength range; and

segregate image regions corresponding to living vegetation from image regions corresponding to background clutter, the background clutter including one or more of soil, rock, liquid, man-made materials, or non-living vegetation, wherein segregating image regions comprises:

classifying content of image pixels as belonging to a vegetation class or to background clutter based on an adjustable threshold of spectral reflectance combinations; and

classifying groups of contiguous vegetation pixels as plants belonging to one of one or more vegetation classes responsive to characteristics of a pixel group being proximate to a description of one of one or more of the vegetation classes.

2. The system of claim 1 , wherein the one or more hardware processors are further configured by machine-readable instructions to count a number of plants within a vegetation class.

3. The system of claim 1 , wherein the one or more hardware processors are further configured by machine-readable instructions to calculate a size of plants within a vegetation class.

4. The system of claim 1 , wherein the one or more hardware processors are further configured by machine-readable instructions to calculate a geo-position of plant centroids of a vegetation class within the land area.

5. The system of claim 1 , wherein the one or more hardware processors are further configured by machine-readable instructions to assign groups of contiguous pixels to a class responsive to characteristics of a group being proximate to characteristics of a pixel region of interest selected by a user through a graphical user interface.

6. The system of claim 1 , wherein the one or more hardware processors are further configured by machine-readable instructions such that the target wavelength range is 400 nanometers to 3,000 nanometers.

7. The system of claim 1 , wherein the one or more hardware processors are further configured by machine-readable instructions to:

revise one or more intensity non-uniformities of the one or more images;

revise one or more spatial distortions of the one or more images;

revise one or more intensity values for variations in solar irradiance of the one or more images; or

register one or more pixels from one or more channels to a common pixel space.

8. The system of claim 1 , wherein segregating image regions corresponding to the living vegetation from image regions corresponding to the background clutter further comprises utilizing one or more differing spectral reflectance numerical combinations across one or more wavelength bands.

9. The system of claim 8 , wherein the one or more hardware processors are further configured by machine-readable instructions to amplify one or more spatial frequency components corresponding to a numerical combination.

10. The system of claim 1 , wherein the one or more hardware processors are further configured by machine-readable instructions to:

determine a spacing of one portion of the living vegetation from one or more other portions of the living vegetation in pixels;

determine the pixel's Ground Sample Dimension using externally provided spacing information and the spacing in pixels; and

determine an area of land portrayed by the one or more images using the number of pixels in the image and the pixel's Ground Sample Dimension.

11. A system configured for classifying plants within an area, the system comprising:

non-transitory storage media storing machine-readable instructions configured to cause one or more hardware processors to:

receive output signals provided by one or more remote sensing devices mounted to an unmanned aircraft system, the output signals conveying information related to one or more images of a land area, the one or more images being spatially resolved and including one or more spectral bands within a target wavelength range;

segregate image regions corresponding to living vegetation from image regions corresponding to background clutter, the background clutter including one or more of soil, rock, liquid, man-made materials, or non-living vegetation, wherein segregating image regions comprises:

classifying content of image pixels as belonging to a vegetation class or to background clutter based on an adjustable threshold of spectral reflectance combinations; and

classifying groups of contiguous vegetation pixels as plants belonging to one of one or more vegetation classes responsive to characteristics of a pixel group being proximate to a description of one of one or more of the vegetation classes; and

determine a living vegetation density by determining a first area corresponding to the living vegetation and dividing the first area by a total determined area of the land.

12. A system configured for classifying plants within an area, the system comprising:

non-transitory storage media storing machine-readable instructions configured to cause one or more hardware processors to:

receive output signals provided by one or more remote sensing devices mounted to an unmanned aircraft system, the output signals conveying information related to one or more images of a land area, the one or more images being spatially resolved and including one or more spectral bands within a target wavelength range;

characterize a reference spectral signature of living vegetation within the land area based on the output signals; wherein the reference spectral signature of living vegetation within the land area is determined based on the output signals for a user selected region of interest of the land area;

statistically compare a spectral signature of each pixel in an image of the land area to the reference spectral signature; and

assign each pixel as belonging to a same class or another class as the reference spectral signature.

13. A method for classifying plants within an area, the method comprising:

receiving, with one or more hardware processors, output signals provided by one or more remote sensing devices mounted to an unmanned aircraft system, the output signals conveying information related to one or more images of a land area, the one or more images being spatially resolved and including one or more spectral bands within a target wavelength range; and

segregating, with the one or more hardware processors, image regions corresponding to living vegetation from image regions corresponding to background clutter, the background clutter including one or more of soil, rock, liquid, man-made materials, or non-living vegetation, wherein segregating image regions comprises:

classifying content of image pixels as belonging to a vegetation class or to background clutter based on an adjustable threshold of spectral reflectance combinations; and

classifying groups of contiguous vegetation pixels as plants belonging to one of one or more vegetation classes responsive to characteristics of a pixel group being proximate to a description of one of one or more of the vegetation classes.

14. The method of claim 13 , further comprising counting, with the one or more hardware processors, a number of plants within a vegetation class.

15. The method of claim 13 , further comprising calculating, with the one or more hardware processors, a size of plants within a vegetation class.

16. The method of claim 13 , further comprising calculating, with the one or more hardware processors, a geo-position of plant centroids of a vegetation class within the land area.

17. The method of claim 13 , further comprising assigning, with the one or more hardware processors, groups of contiguous pixels to a class responsive to characteristics of a group being proximate to characteristics of a pixel region of interest selected by a user through a graphical user interface.

18. The method of claim 13 , wherein the target wavelength range is 400 nanometers to 3,000 nanometers.

19. The method of claim 13 , wherein segregating image regions corresponding to the living vegetation from image regions corresponding to the background clutter further comprises utilizing one or more differing spectral reflectance numerical combinations across one or more wavelength bands.

20. A method for classifying plants within an area, the method comprising:

receiving, with one or more hardware processors, output signals provided by one or more remote sensing devices mounted to an unmanned aircraft system, the output signals conveying information related to one or more images of a land area, the one or more images being spatially resolved and including one or more spectral bands within a target wavelength range;

characterizing, with the one or more hardware processors, a reference spectral signature of living vegetation within the land area based on the output signals; the reference spectral signature being determined based on the output signals for a user selection of a region of interest of the land area;

statistically comparing, with the one or more hardware processors, a spectral signature of each pixel in an image of the land area to the reference spectral signature; and

assigning, with the one or more hardware processors, each pixel as belonging to a same class or another class as the reference spectral signature.

Assignments (2)
CHANGE OF NAME Recorded Feb 7, 2024
From: SLANT RANGE, INC.
To: HIPHEN CORP
Reel/Frame 066522/0226 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 7, 2019
From: RITTER, MICHAEL; MILTON, MICHAEL; MATUSOV, PETER
To: SLANTRANGE, INC.
Reel/Frame 049407/0585 →
Continuity (3)
Continuation 15268370 · Sep 16, 2016
Provisional Application 62205596 · Sep 18, 2015
Related Publication 20190286905A1 · Sep 19, 2019
Cited By (1)
US 12,231,785