IP Library Granted Patent US 10,438,302
Granted Patent B2
US 10,438,302 · App. 15/688,567 · Granted Oct 8, 2019

Crop disease recognition and yield estimation

Inventors: Juan Pablo Bedoya (Berkeley, CA); Victor Stuber (El Cerrito, CA); Gerard Guillemette (Alameda, CA); Joost Kemink (San Francisco, CA); Yaqi Chen (Chesterfield, MO); Daniel Williams (Benicia, CA); Ying She (San Jose, CA); Marian Farah (San Francisco, CA); Julian Boshard (Berkeley, CA); Wei Guan (Pleasanton, CA)
Assignee: The Climate Corporation
G06Q50/02A01B79/005A01D41/1273A01G7/06G01D21/02G06K9/46G06K9/68A01D91/00A01G22/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,438,302
App. No.
15/688,567
Granted
Oct 8, 2019
Kind
B2
Abstract

In an embodiment, a computer-implemented method is disclosed. The method comprises causing a camera to continuously capture surroundings to generate multiple images and causing a display device to continuously display the multiple images as the multiple images are generated. In addition, the method comprises processing each of one or more of the multiple images. The processing comprises identifying at least one of a plurality of diseases and calculating at least one disease score associated with the at least one disease for a particular image; causing the display device to display information regarding the at least one disease and the at least one disease score in association with a currently displayed image; receiving input specifying one or more of the at least one disease; and causing the display device to show additional data regarding the one or more diseases, including a remedial measure for the one or more diseases.

Claims (56)

1. A non-transitory storage medium storing instructions which, when executed by one or more computing devices, cause performance of a method of real-time disease recognition in a crop field comprising the steps of:

causing a camera to continuously capture surroundings to generate multiple images;

causing a display device to continuously display the multiple images as the multiple images are generated;

processing each of one or more of the multiple images by:

identifying at least one of a plurality of diseases and calculating at least one disease score associated with the at least one disease for a particular image;

causing the display device to display information regarding the at least one disease and the at least one disease score in association with a currently displayed image;

receiving input specifying one or more of the at least one disease;

causing the display device to show additional data regarding the one or more diseases, including a remedial measure for the one or more diseases, in association with the currently displayed image.

2. The non-transitory storage medium of claim 1 , the processing further comprising:

receiving a confirmation of the one disease;

sending the image, the one disease, and the confirmation to a server computer over a communication network.

3. The non-transitory storage medium of claim 1 , the method further comprising performing identifying and calculating using a convolutional neural network that accepts the particular image as an input and produces at least one probability values specifying probabilities that the particular image is classified in the at least one disease.

4. The non-transitory storage medium of claim 1 , the processing further comprising causing the display device to present an alert when the one disease score exceeds a predetermined threshold score value.

5. The non-transitory storage medium of claim 1 , the method further comprising:

tracking a highest disease score that has been calculated and a geographical location where a corresponding image was generated;

causing the display device to continuously present directions to reach the location.

6. The non-transitory storage medium of claim 1 , the additional data regarding the at least one disease further including descriptions of symptoms or pathogens associated with the at least one disease.

7. The non-transitory storage medium of claim 1 , the method further comprising:

receiving a selection of a currently displayed image;

interrupting the processing of the one or more images and processing the selected image instead.

8. The non-transitory storage medium of claim 1 ,

the processing further comprising identifying at least one of a plurality of crop types and calculating at least one crop score associated with the at least one crop type for the particular image,

the one crop type being corn.

9. The non-transitory storage medium of claim 8 , the processing further comprising causing the display device to display information regarding the at least one crop type and the associated at least one crop score in association with a currently displayed image.

10. The non-transitory storage medium of claim 8 , the processing further comprising:

calculating a kernel count for the particular image;

causing the display device to display the kernel count in association with a currently displayed image.

11. A computer-implemented method of real-time disease recognition in a crop field, comprising:

retrieving a set of computer-executable instructions which, when executed by one or more computing devices, cause performance of:

causing a camera to continuously capture surroundings to generate multiple images;

causing a display device to continuously display the multiple images as the multiple images are generated;

processing each of one or more of the multiple images by:

identifying at least one of a plurality of diseases and calculating at least one disease score associated with the at least one disease for a particular image;

causing the display device to display information regarding the at least one disease and the at least one disease score in association with a currently displayed image;

receiving input specifying one or more of the at least one disease; and

causing the display device to show additional data regarding the one or more diseases, including a remedial measure for the one or more diseases, in association with the currently displayed image; and

transmitting the set of computer-executable instructions to a client device.

12. The computer-implemented method of claim 11 , the processing further comprising:

receiving a confirmation of the one disease;

sending the image, the one disease, and the confirmation to a server computer over a communication network.

13. The computer-implemented method of claim 11 , the identifying and calculating being performed using a convolutional neural network that accepts the particular image as an input and produces at least one probability values specifying probabilities that the particular image is classified in the at least one disease.

14. The computer-implemented method of claim 11 , the processing further comprising causing the display device to present an alert when the one disease score exceeds a predetermined threshold score value.

15. The computer-implemented method of claim 11 , the set of computer-executable instructions, when executed by one or more computing devices, causing further performance of:

tracking a highest disease score that has been calculated and a geographical location where a corresponding image was generated;

causing the display device to continuously present directions to reach the location.

16. The computer-implemented method of claim 11 , the additional data regarding the at least one disease further including descriptions of symptoms or pathogens associated with the at least one disease.

17. The computer-implemented method of claim 11 , the set of computer-executable instructions, when executed by one or more computing devices, causing further performance of:

receiving a selection of a currently displayed image;

interrupting the processing of the one or more images and processing the selected image instead.

18. The computer-implemented method of claim 11 ,

the processing further comprising identifying at least one of a plurality of crop types and calculating at least one crop score associated with the at least one crop type for the particular image,

the one crop type being corn.

19. The computer-implemented method of claim 18 , the processing further comprising causing the display device to display information regarding the at least one crop type and the associated at least one crop score in association with a currently displayed image.

20. The computer-implemented method of claim 18 , the processing further comprising:

calculating a kernel count for the particular image;

causing the display device to display the kernel count in association with a currently displayed image.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2026
From: CLIMATE LLC
To: MONSANTO COMPANY
Reel/Frame 075177/0751 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2026
From: MONSANTO COMPANY
To: MONSANTO TECHNOLOGY LLC
Reel/Frame 075177/0908 →
CHANGE IN PRINCIPAL PLACE OF BUSINESS Recorded Sep 2, 2025
From: CLIMATE LLC
To: CLIMATE LLC
Reel/Frame 072809/0623 →
CHANGE OF NAME Recorded Nov 17, 2023
From: THE CLIMATE CORPORATION
To: CLIMATE LLC
Reel/Frame 065625/0587 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2018
From: BEDOYA, JUAN PABLO; STUBER, VICTOR; GUILLEMETTE, GERARD; KEMINK, JOOST; CHEN, YAQI; WILLIAMS, DANIEL; SHE, YING; FARAH, MARIAN; BOSHARD, JULIAN; GUAN, WEI
To: THE CLIMATE CORPORATION
Reel/Frame 046911/0001 →
Cited By (1)
US 12,582,036