IP Library Granted Patent US 11,386,361
Granted Patent B2
US 11,386,361 · App. 16/933,247 · Granted Jul 12, 2022

Closed loop integrated pest management

Inventors: Iftach Birger (Kfar Kish, IL); Boaz Bachar (Tel-Aviv, IL)
Assignee: AGROMENTUM LTD.
G06Q10/04A01N25/02G06Q10/06G06Q50/02H04W4/38
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,386,361
App. No.
16/933,247
Granted
Jul 12, 2022
Kind
B2
Abstract

At least some embodiments are directed to a system that captures a set of images via cameras positioned in a lot having a crop. The system determines based on image processing and the set of images a phenological and biological stage of the crop, and a type of pest affecting the crop. The system generates a recommendation including a type of pesticide, a concentration of the type of pesticide, and an amount of pesticide and generates a pest control implementation plan. The system generates instructions for an autonomous carrier to execute the pest control implementation plan. The instructions include instructions for the autonomous carrier to execute the pest control implementation plan and instructions to control pesticide spraying nozzles mounted in the autonomous carrier. The system monitors a traveled distance of the autonomous carrier and determines that the pest control implementation plan has been executed.

Claims (136)

1. An apparatus, comprising:

a processor; and

a non-transitory memory storing instructions which, when executed by the processor, cause the processor to:

capture a first plurality of images via a plurality of cameras positioned in a lot;

wherein the lot comprises at least one type of crop;

receive crop data for the at least type of crop in the lot from a crop database;

wherein the crop data for the at least type of crop in the lot comprises:

(i) a history of the lot,

(ii) biological reference data for the at least one type of crop,

(iii) phenological reference data for the at least one type of crop,

(iv) at least one suspected type of pest to search for in the lot,

(v) at least one suggested location in the lot to search for the at least one suspected type of pest, and

(vi) pest control data for eradicating the at least one suspected type of pest;

utilize, a pest determination image process to determine from the first plurality of images, a phenological and biological stage of the at least one type of crop based at least in part on:

(i) the image processing data,

(ii) the biological reference data for the at least one type of crop, and

(iii) the phenological reference data for the at least one type of crop;

transmit to the plurality of cameras, monitoring instructions based on the phenological and biological stage of the at least one type of crop;

wherein the monitoring instructions comprise the at least one suggested location in the lot to search for the at least one suspected type of pest;

capture image data of a second plurality of images via the plurality of cameras based on the monitoring instructions;

utilize an infection-determination image process to extract, based on the image data of each image from the second plurality of images, an extent of an infection of at least one verified type of pest located in at least one verified location in the lot that is verified by applying, to the infection-determination image process, the image data of each image from the second plurality of images, comprising the at least one suspected type of pest at the at least one suggested location;

generate a pest control implementation plan, based on the at least one verified type of pest at the at least one verified location in the lot and the pest control data, and comprising:

(i) at least one type of pesticide,

(ii) a concentration of the at least one type of pesticide,

(iii) an amount of the at least one type of pesticide to eradicate the at least one verified type of pest,

(iv) sprayer data for a plurality of pesticide spraying nozzles for spraying the at least one verified type of pest in the lot, and

(v) a speed of a carrier to dispense the at least one verified type of pest at the at least one verified location in the lot;

generate instructions for the carrier to execute the pest control implementation plan;

wherein the instructions comprise a plurality of commands to control:

(i) the carrier to travel a path to execute the pest control implementation plan to spray the at least one verified type of pest in the at least one verified location in the lot, and

(ii) a plurality of pesticide spraying nozzles mounted in the carrier for delivering the at least one type of pesticide along the path; and

monitor the path travelled by the carrier in the lot to determine that the pest control implementation plan has been executed.

2. The apparatus of claim 1 , wherein in the instructions further cause the processor to:

detect a change of weather condition while the carrier executes the pest control implementation plan; and

change the plurality of commands to control the plurality of pesticide spraying nozzles based on the change of a weather condition causing the carrier to control the plurality of pesticide spraying nozzles based on the change of the plurality of commands.

3. The apparatus of claim 1 , wherein in the instructions further cause the processor to:

generate a pest distribution map of the lot that indicates a resistance event;

wherein the resistance event indicates a decrease of susceptibility of the at least one type of pest to the at least one type of pesticide; and

wherein the pest distribution map is generated at least in part based on a monitored traveled route of the carrier while the carrier executes the pest control implementation plan.

4. The apparatus of claim 1 , further comprising a display; and wherein in the instructions further cause the processor to:

receive from the carrier, pest control implementation plan data comprising a speed of the carrier at which the carrier traveled the path during an execution of the pest control implementation plan, an amount of the at least one type of pesticide used during the execution of the pest control implementation plan, and a carrier location during the execution of the pest control implementation plan;

generate, based on the pest control implementation plan data, a graphical representation of the spraying in the lot associated with the executed pest control implementation plan; and

display the graphical representation on the display;

wherein the graphical representation displays a map of the lot showing regions in the lot where the spraying was in accordance with the executed pest control implementation plan, and other regions in the lot where the spraying was not in accordance with the executed pest control implementation plan.

5. The apparatus of claim 1 , wherein the pest control implementation plan further comprises: a) a time to apply the at least one type of pesticide, b) a number of spraying nozzles to be open from the plurality of pesticide spraying nozzles while the carrier travels the path to execute the pest control implementation plan, and c) a spraying pressure of the plurality of pesticide spraying nozzles.

6. The apparatus of claim 1 , wherein the pest control implementation plan is further based at least in part on a previously executed pest control implementation plan.

7. The apparatus of claim 1 , wherein the carrier comprises a drone, a quadcopter, or any combination thereof.

8. A method, comprising:

capturing, by a processor, a first plurality of images via a plurality of cameras positioned in a lot;

wherein the lot comprises at least one type of crop;

receiving, by the processor, crop data for the at least one type of crop in the lot from a crop database;

wherein the crop data for the at least one type of crop in the lot comprises:

(i) a history of the lot,

(ii) biological reference data for the at least one type of crop,

(iii) phenological reference data for the at least one type of crop,

(iv) at least one suspected type of pest to search for in the lot,

(v) at least one suggested location in the lot to search for the at least one suspected type of pest, and,

(vi) pest control data for eradicating the at least one suspected type of pest;

utilizing, by the processor, a pest determination image process to determine, from the first plurality of images, a phenological and biological stage of the at least one type of crop based at least in part on:

(i) the image processing data,

(ii) the biological reference data for the at least one type of crop, and

(iii) the phenological reference data for the at least one type of crop;

transmitting, by the processor, to the plurality of cameras, monitoring instructions based on the phenological and biological stage of the at least one type of crop;

wherein the monitoring instructions comprise the at least one suggested location in the lot to search for the at least one suspected type of pest;

capturing, by the processor, image data of a second plurality of images via the plurality of cameras based on the monitoring instructions;

utilizing, by the processor, an infection-determination image process to extract, based on the image data of each image from the second plurality of images, an extent of an infection of at least one verified type of pest located in at least one verified location in the lot that is verified by applying, to the infection-determination image process, the image data of each image from the second plurality of images, comprising the at least one suspected type of pest at the at least one suggested location;

generating, by the processor, a pest control implementation plan, based on the at least one verified type of pest at the at least one verified location in the lot and the pest control data, and comprising:

(i) at least one type of pesticide,

(ii) a concentration of the at least one type of pesticide,

(iii) an amount of the at least one type of pesticide to eradicate the at least one verified type of pest,

(iv) sprayer data for a plurality of pesticide spraying nozzles for spraying the at least one verified type of pest in the lot, and

(v) a speed of a carrier to dispense the at least one verified type of pest at the at least one verified location in the lot;

generating, by the processor, instructions for the carrier to execute the pest control implementation plan;

wherein the instructions comprise a plurality of commands to control:

(i) the carrier to travel a path to execute the pest control implementation plan to spray the at least one verified type of pest in the at least one verified location in the lot, and

(ii) a plurality of pesticide spraying nozzles mounted in the carrier for delivering the at least one type of pesticide along the path; and

monitoring, by the processor, the path travelled by the carrier in the lot to determine that the pest control implementation plan has been executed.

9. The method of claim 8 , further comprising:

detecting, by the processor, a change of weather condition while the carrier executes the pest control implementation plan; and

changing, by the processor, the plurality of commands to control the plurality of pesticide spraying nozzles based on the change of a weather condition causing the carrier to control the plurality of pesticide spraying nozzles based on the change of the plurality of commands.

10. The method of claim 8 , further comprising:

generating, by the processor, a pest distribution map of the lot that indicates a resistance event;

wherein the resistance event indicates a decrease of susceptibility of the at least one type of pest to the at least one type of pesticide; and

wherein the pest distribution map is generated at least in part based on a monitored traveled route of the carrier while the carrier executes the pest control implementation plan.

11. The method of claim 8 , further comprising:

receiving, by the processor, from the carrier, pest control implementation plan data comprising a speed of the carrier at which the carrier traveled the path during the execution of the pest control implementation plan, an amount of the at least one type of pesticide used during the execution of the pest control implementation plan, and a carrier location during the execution of the pest control implementation plan;

generating, by the processor, based on the pest control implementation plan data, a graphical representation of the spraying in the lot associated with the executed pest control implementation plan; and

displaying, by the processor, the graphical representation on the display;

wherein the graphical representation displays a map of the lot showing regions in the lot where the spraying was in accordance with the executed pest control implementation plan, and other regions in the lot where the spraying was not in accordance with the executed pest control implementation plan.

12. The method of claim 8 , wherein the pest control implementation plan further comprises: a) a time to apply the at least one type of pesticide, b) a number of spraying nozzles to be open from the plurality of pesticide spraying nozzles while the carrier travels the path to execute the pest control implementation plan, and c) a spraying pressure of the plurality of pesticide spraying nozzles.

13. The method of claim 8 , wherein the pest control implementation plan is further based at least in part on a previously executed pest control implementation plan.

14. The method of claim 8 , wherein the carrier comprises a drone, a quadcopter, or any combination thereof.

15. A non-transitory computer readable medium storing instructions which, when executed by a processor, cause the processor to:

capture a first plurality of images via a plurality of cameras positioned in a lot;

wherein the lot comprises a at least one type of crop;

receive crop data for the at least one type of crop in the lot from a crop database;

wherein the crop data for the at least one type of crop in the lot comprises:

(i) a history of the lot,

(ii) biological reference data for the at least one type of crop,

(iii) phenological reference data for the at least one type of crop,

(iv) at least one suspected type of pest to search for in the lot,

(v) at least one suggested location in the lot to search for the at least one suspected type of pest, and,

(vi) pest control data for eradicating the at least one suspected type of pest;

utilize, a pest determination image process to determine from the first plurality of images, a phenological and biological stage of the at least one type of crop based at least in part on:

(i) the image processing data,

(ii) the biological reference data for the at least one type of crop, and

(iii) the phenological reference data for the at least one type of crop;

transmit to the plurality of cameras, monitoring instructions, based on the phenological and biological stage of the at least one type of crop;

wherein the monitoring instructions comprise the at least one suggested location in the lot to search for the at least one suspected type of pest;

capture image data of a second plurality of images via the plurality of cameras based on the monitoring instructions;

utilize an infection-determination image process to extract, based on the image data of each image from the second plurality of images, an extent of an infection of at least one verified type of pest located in at least one verified location in the lot that is verified by applying, to the infection-determination image process, the image data of each image from the second plurality of images, comprising the at least one suspected type of pest at the at least one suggested location;

generate a pest control implementation plan, based on the at least one verified type of pest at the at least one verified location in the lot and the pest control data, and comprising:

(i) at least one type of pesticide,

(ii) a concentration of the at least one type of pesticide,

(iii) an amount of the at least one type of pesticide to eradicate the at least one verified type of pest,

(iv) sprayer data for a plurality of pesticide spraying nozzles for spraying the at least one verified type of pest in the lot, and

(v) a speed of a carrier to dispense the at least one verified type of pest at the at least one verified location in the lot;

generate instructions for the carrier to execute the pest control implementation plan;

wherein the instructions comprise a plurality of commands to control:

the carrier to travel a path to execute the pest control implementation plan to spray the at least one verified type of pest in the at least one verified location in the lot, and

(ii) a plurality of pesticide spraying nozzles mounted in the carrier for delivering the at least one type of pesticide along the path; and

monitor the path travelled by the carrier in the lot to determine that the pest control implementation plan has been executed.

16. The non-transitory computer readable medium of claim 15 , wherein in the instructions further cause the processor to:

detect a change of weather condition while the carrier executes the pest control implementation plan; and

change the plurality of commands to control the plurality of pesticide spraying nozzles based on the change of a weather condition causing the carrier to control the plurality of pesticide spraying nozzles based on the change of the plurality of commands.

17. The non-transitory computer readable medium of claim 15 , wherein in the instructions further cause the processor to:

generate a pest distribution map of the lot that indicates a resistance event;

wherein the resistance event indicates a decrease of susceptibility of the at least one type of pest to the at least one type of pesticide; and

wherein the pest distribution map is generated at least in part based on a monitored traveled route of the carrier while the carrier executes the pest control implementation plan.

18. The non-transitory computer readable medium of claim 15 , wherein in the instructions further cause the processor to:

receive from the carrier pest control implementation plan data comprising a speed of the carrier at which the carrier traveled the path during the execution of the pest control implementation plan, an amount of the at least one type of pesticide used during the execution of the pest control implementation plan, and an carrier location during the execution of the pest control implementation plan;

generate, based on the pest control implementation plan data, a graphical representation of the spraying in the lot associated with the executed pest control implementation plan; and

display the graphical representation on the display;

wherein the graphical representation displays a map of the lot showing regions in the lot where the spraying was in accordance with the executed pest control implementation plan, and other regions in the lot where the spraying was not in accordance with the executed pest control implementation plan.

19. The non-transitory computer readable medium of claim 15 , wherein the pest control implementation plan further comprises: a) a time to apply the at least one type of pesticide, b) a number of spraying nozzles to be open from the plurality of pesticide spraying nozzles while the carrier travels the path to execute the pest control implementation plan, and c) a spraying pressure of the plurality of pesticide spraying nozzles.

20. The non-transitory computer readable medium of claim 15 , wherein the carrier comprises a drone, a quadcopter, or any combination thereof.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded May 18, 2026
From: FIFTH THIRD BANK, N.A., AS SUCCESSOR BY MERGER TO COMERICA BANK
To: AGROMENTUM LTD.
Reel/Frame 074680/0218 →
SECURITY INTEREST Recorded Jul 31, 2024
From: AGROMENTUM LTD.
To: COMERICA BANK
Reel/Frame 068138/0156 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2020
From: BIRGER, IFTACH; BACHAR, BOAZ
To: AGROMENTUM LTD.
Reel/Frame 053253/0241 →
Continuity (3)
Continuation 15574580
Provisional Application 62166025 · May 25, 2015
Related Publication 20200349477A1 · Nov 5, 2020