SYSTEMS AND METHODS FOR REAL-TIME MEASUREMENT AND CONTROL OF SPRAYED LIQUID COVERAGE ON PLANT SURFACES
Presented herein are systems and methods for automatically determining liquid coverage on plant surfaces. More particularly, in certain embodiments, presented herein is a system for receiving an image depicting one or more plant surfaces, automatically identifying the plant surfaces in the image and distinguishing portions covered by liquid, and automatically determining a liquid coverage value. In some embodiments, the system determines changes to liquid spraying parameters to achieve desired liquid coverage values.
1 . A system for automatically quantifying liquid coverage on plant surfaces, the system comprising:
a processor of a computing device; and
a memory having instructions stored thereon, wherein the instructions, when executed by the processor, cause the processor to:
receive an image comprising a region of interest corresponding to one or more plant surfaces;
automatically identify one or more portions of the region of interest corresponding to liquid; and
automatically determine a liquid coverage value for the region of interest in the image, wherein the liquid coverage value quantifies an area of the plant surfaces depicted in the region of interest that is covered by liquid.
2 . The system of claim 1 , wherein the liquid on the plant surfaces comprises a sprayed-on solution comprising one or more members of the group consisting of water, an adjuvant, an additive, a crop-compatible dye, an agrochemical solution, a liquid solution of a pesticide, a liquid solution of a fertilizer, and a foliar fertilizer.
3 . The system of claim 1 , wherein automatically identifying one or more portions of the region of interest corresponding to liquid comprises applying an image analysis technique selected from the group consisting of color thresholding, edge detection, filtering, deep learning, neural networks, convolutions, depth estimation, active learning, and transfer learning.
4 . The system of claim 1 , wherein the liquid coverage value is a quantity selected from the group consisting of an absolute surface area of the plant surfaces in the region of interest covered by liquid, a relative surface area of the plant surfaces in the region of interest covered by liquid, a number of droplets in the region of interest, a total liquid volume in the region of interest, a number of droplets per unit area of the region of interest, and a total liquid volume per unit area of the region of interest.
5 . The system of claim 1 , further comprising one or more imaging devices and/or sensors for obtaining the image, wherein the one or more imaging devices and/or sensors comprises at least one member of the group consisting of a camera, a digital camera, a camera phone, a thermal imaging device, a night vision camera, a Light Detection and Ranging (LiDAR) device, an electronic image sensor, a charge-coupled device (CCD), an active-pixel sensor (CMOS sensor), a smart image sensor, an intelligent image sensor, and a short-wave infrared (SWIR) camera.
6 . The system of claim 5 , wherein the one or more imaging devices and/or sensors comprises a first imaging device and/or sensor that collects data (e.g., images) before a sprayed-on solution has been applied to the plant surfaces and a second imaging device and/or sensor that collects data (e.g., images) the sprayed-on solution has been applied to the plant surfaces.
7 . The system of claim 1 , wherein the liquid on the plant surfaces comprises a sprayed-on solution, wherein the one or more imaging devices and/or sensors comprises a short-wave infrared (SWIR) camera, and wherein sufficient detectable contrast is achieved for accurate liquid coverage value determination without the need for any dyes to be added to the sprayed-on solution.
8 . The system of claim 1 , wherein the instructions, when executed by the processor, cause the processor to automatically determine a series of liquid coverage values for regions in a sequence of images in real time, as the sequence of images is obtained.
9 . The system of claim 1 , wherein the instructions, when executed by the processor, cause the processor to use the determined liquid coverage value to automatically determine an adjustment (e.g., a recommended adjustment) of one or more sprayer system parameters to achieve a desired level of liquid coverage, wherein the one or more sprayer system parameters comprises at least one member selected from the group consisting of a sprayer speed, a nozzle type, a nozzle positioning and/or orientation, a number of nozzles used, a spray pressure, an adjuvant and/or additive rate, an overall flow rate, a boom orientation and/or height, a spray solution composition, and a chemistry of one or more components of the spray solution.
10 . The system of claim 1 , the system further comprising:
a display comprising a display screen and a graphical user interface (GUI) (e.g., said GUI presented via a mobile device application, e.g., a smart phone app); and
a remote communications module (e.g., said remote communications module comprising one or more members selected from the group consisting of a wireless internet connection, a universal serial bus (USB) connection, and a Bluetooth connection).
11 . The system of claim 10 , wherein the instructions cause the processor to (i) graphically render the liquid coverage value for viewing by a person via the display and/or the remote communications module and/or (ii) communicate the liquid coverage value to a remote computing device (e.g., a device running farm management software, e.g., process control software) using the remote communications module.
12 . The system of claim 9 , wherein the system comprises one or more environmental sensors for capturing environmental data corresponding to one or more environmental conditions at a location and at a time the image(s) is/are obtained, and
wherein the instructions, when executed by the processor, cause the processor to use the environmental data along with the determined droplet coverage value or values to automatically determine the adjustment (e.g., a recommended adjustment) of the one or more sprayer system parameters, wherein the one or more environmental sensors comprise one or more sensors selected from the group consisting of a temperature sensor, a humidity sensor, a pressure sensor, a wind sensor, a light sensor, an air quality sensor, a gas sensor, a rainfall sensor, a radiation sensor, a soil sensor, and a sprayer speed sensor.
13 . The system of claim 9 , further comprising a control system for controlling the one or more sprayer system parameters in accordance with the automatically determined adjustment.
14 . The system of claim 13 , wherein the instructions, when executed by the processor, cause the processor to automatically determine a series of liquid coverage values for regions of interest in a sequence of images and use the automatically determined values to automatically determine the adjustment of the one or more sprayer system parameters to achieve the desired level of droplet coverage, wherein the instructions further cause the processor to automatically implement the determined adjustment(s) in real time via the control system for controlling the one or more sprayer system parameters, thereby operating the sprayer system in real time to improve liquid coverage by accounting for one or more changing conditions, wherein the one or more sprayer system parameters comprises one or more members selected from the group consisting of sprayer speed, nozzle type, nozzle positioning and/or orientation, spray pressure, adjuvant/additive rate, and overall flow rate.
15 . The system of claim 1 , comprising a sprayer retrofitted with an electronic injection system that is capable of infusing a crop compatible dye into liquid to be sprayed.
16 . A method for automatically quantifying liquid coverage on plant surfaces, the method comprising:
receiving, by a processor of a computing device, an image comprising a region of interest corresponding to one or more plant surfaces;
automatically identifying, by the processor, one or more portions of the region of interest corresponding to liquid; and
automatically determining, by the processor, a liquid coverage value for the region of interest in the image, wherein the liquid coverage value quantifies an area of the plant surfaces depicted in the region of interest that is covered by liquid.
17 . The method of claim 16 , wherein the liquid on the plant surfaces comprises a sprayed-on solution comprising one or more members of the group consisting of water, an adjuvant, an additive, a crop-compatible dye, an agrochemical solution, a liquid solution of a pesticide, a liquid solution of a fertilizer, and a foliar fertilizer.
18 . The method of claim 16 , wherein automatically identifying one or more portions of the region of interest corresponding to liquid comprises applying an image analysis technique selected from the group consisting of color thresholding, edge detection, filtering, deep learning, neural networks, convolutions, depth estimation, active learning, and transfer learning.
19 . The method of claim 16 , wherein the liquid coverage value is a quantity selected from the group consisting of an absolute surface area of the plant surfaces in the region of interest covered by liquid, a relative surface area of the plant surfaces in the region of interest covered by liquid, a number of droplets in the region of interest, a total liquid volume in the region of interest, a number of droplets per unit area of the region of interest, and a total liquid volume per unit area of the region of interest.
20 . The method of claim 16 , further comprising obtaining the image using one or more imaging devices and/or sensors, wherein the one or more imaging devices and/or sensors comprises at least one member of the group consisting of a camera, a digital camera, a camera phone, a thermal imaging device, a night vision camera, a Light Detection and Ranging (LiDAR) device, an electronic image sensor, a charge-coupled device (CCD), an active-pixel sensor (CMOS sensor), a smart image sensor, an intelligent image sensor, and a short-wave infrared (SWIR) camera.
21 . The method of claim 20 , wherein the one or more imaging devices and/or sensors comprises a first imaging device and/or sensor that collects data (e.g., images) before a sprayed-on solution has been applied to the plant surfaces and a second imaging device and/or sensor that collects data (e.g., images) the sprayed-on solution has been applied to the plant surfaces.
22 . The method of claim 20 , wherein the liquid on the plant surfaces comprises a sprayed-on solution, wherein the one or more imaging devices and/or sensors comprises a short-wave infrared (SWIR) camera, and wherein sufficient detectable contrast is achieved for accurate liquid coverage value determination without the need for any dyes to be added to the sprayed-on solution.
23 . The method of claim 16 , comprising automatically determining, by the processor, a series of liquid coverage values for regions in a sequence of images in real-time, as the sequence of images is obtained.
24 . The method of claim 16 , comprising automatically determining, by the processor, an adjustment (e.g., a recommended adjustment) of one or more sprayer system parameters to achieve a desired level of liquid coverage, using the determined liquid coverage value, wherein the one or more sprayer system parameters comprises at least one member selected from the group consisting of a sprayer speed, a nozzle type, a nozzle positioning and/or orientation, a number of nozzles used, a spray pressure, an adjuvant and/or additive rate, an overall flow rate, a boom orientation and/or height, a spray solution composition, and a chemistry of one or more components of the spray solution.
25 . The method of claim 16 , further comprising graphically rendering the liquid coverage value on a display for viewing by a person.
26 . The method of claim 16 , further comprising communicating, by the processor, the liquid coverage value to a remote computing device.
27 . The method of claim 24 , wherein the method comprises capturing environmental data corresponding to one or more environmental conditions at a location and at a time the image(s) is/are obtained using one or more environmental sensors, and automatically determining, by the processor, the adjustment (e.g., a recommended adjustment) of the one or more sprayer system parameters using the environmental data along with the determined droplet coverage value or values, wherein the one or more environmental sensors comprise one or more sensors selected from the group consisting of a temperature sensor, a humidity sensor, a pressure sensor, a wind sensor, a light sensor, an air quality sensor, a gas sensor, a rainfall sensor, a radiation sensor, a soil sensor, and a sprayer speed sensor.
28 . The method of claim 24 , further comprising controlling the one or more sprayer system parameters in accordance with the automatically determined adjustment via a control system.
29 . The method of claim 28 , comprising automatically determining, by the processor, a series of liquid coverage values for regions of interest in a sequence of images and using the automatically determined liquid coverage values to automatically determine the adjustment of the one or more sprayer system parameters to achieve the desired level of droplet coverage, and automatically implementing the determined adjustment(s) in real time via the control system for controlling the one or more sprayer system parameters, thereby operating the sprayer system in real time to improve droplet coverage by accounting for one or more changing conditions, wherein the one or more sprayer system parameters comprises one or more members selected from the group consisting of sprayer speed, nozzle type, nozzle positioning and/or orientation, spray pressure, adjuvant/additive rate, and overall flow rate.
30 . The method of claim 16 , comprising retrofitting a sprayer with an electronic injection system that is capable of infusing a crop compatible dye into liquid to be sprayed.