IP Library Granted Patent US 12,417,532
Granted Patent B2
US 12,417,532 · App. 18/313,780 · Granted Sep 16, 2025

Systems, apparatuses, and methods for detecting early drought stress in plants

Inventors: John Benedict Allasas Estrada (Fresno, CA); Pauline Victoria Allasas Estrada (Fresno, CA)
G06T7/0012H04N7/181G06T2207/10024G06T2207/10048G06T2207/20081G06T2207/20084G06T2207/30188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,417,532
App. No.
18/313,780
Granted
Sep 16, 2025
Kind
B2
Abstract

A remote inspection vehicle for inspecting a plant for early drought stress and a neural network model for calculating a score corresponding to a level of early drought stress in the plant. The inspection vehicle may be equipped with an inspection camera having a radiometric infrared sensor and a red, green, and blue light sensor to capture plant images. Image data from the inspection vehicle, as well as soil moisture and calculated CWSI scores, can be used to train the neural network model, deriving weights and biases therefrom using a plurality of neural network layers. Using a plant canopy temperature value, a red raster value, a green raster value, a blue raster value, and a soil moisture value, the trained neural network model can generate a score which can be used to assess the level of early drought stress in a plant.

Claims (37)

1. A method for determining the probability of early drought stress in a plant comprising the steps of:

a) creating a neural network model having at least three layers;

b) obtaining a radiometric infrared image file of said plant;

c) obtaining each of a red, green, and blue light reflectance image file of said plant;

d) providing each of said radiometric infrared image file, said red light reflectance image file, said green light reflectance image file, and said blue light reflectance image file to said model; and

e) generating a score associated with said plant;

wherein said step of creating said model comprises creating a training database, said training database consisting of a plurality of databases of samples, each of said samples comprising a temperature value, a red raster value, a green raster value, a blue raster value, a moisture value, and a calculated CWSI value.

2. The method of claim 1 , wherein said temperature value is extracted from a radiometric infrared image.

3. The method of claim 1 , wherein each of said red raster value, said green raster value, and said blue raster value are extracted from a light reflectance image.

4. The method of claim 1 , wherein said CWSI value is calculated by taking an average of a plurality of said temperature value.

5. The method of claim 1 , further comprising the step of:

f) determining a plurality of weights and biases of the neural network model by using about eighty percent (80%) of said samples in said database.

6. The method of claim 1 , further comprising the step of:

f) optimizing the model with a loss function of mean squared error, and metrics of mean squared error and mean absolute error.

7. The method of claim 1 further comprising the step of:

f) applying an early stopping function to prevent overfitting.

8. The method of claim 1 , further comprising the steps of:

f) obtaining a soil moisture value associated with said plant; and

g) providing said soil moisture value to said model.

9. A system for determining early drought stress in a plant, comprising:

a) a processor and a memory, said memory comprising instructions adapted to generate a drought assessment score associated with said plant from a radiometric infrared image and a red, green, and blue light reflectance image of said plant; and

b) a remote inspection vehicle for obtaining said images of said plant, said remote inspection vehicle comprising a (1) data transceiver and (2) an inspection camera, said inspection camera comprising a first image processor engaged with a radiometric infrared sensor and a color light sensor, and configured to generate said images therefrom,

wherein said instructions comprise a neural network model having at least three layers, and is trained and optimized using a database of samples, each said sample comprising a temperature value, a red raster value, a green raster value, a blue raster value, a moisture value, and a calculated CWSI value.

10. The system of claim 9 , said remote inspection vehicle further comprising:

(3) a plurality of motors;

(4) a motion control circuit comprising a processor electrically engaged with said plurality of motors and a memory for storing instructions, said instructions adapted to cause said motion control circuit to move said motors; and

(5) a movement transceiver electrically engaged with said motion control circuit and adapted to interface with a remote transceiver and receive said instructions.

11. The system of claim 10 , wherein said motion control circuit comprises a position determining circuit.

12. The system of claim 10 , wherein said remote inspection vehicle further comprises:

(6) a main controller, said main controller comprising a processor and a memory for storing instructions, said main controller electrically engaged to said motion control circuit, said data transceiver, said inspection camera, and said movement transceiver.

13. The system of claim 12 , wherein said instructions are adapted to cause said motion control circuit to move said motors.

14. The system of claim 12 , wherein said instructions are adapted to cause said controller to receive and process said images.

15. The system of claim 12 , wherein said instructions are adapted to cause said controller to transmit said images to a remote memory through said data transceiver.

16. The system of claim 9 , wherein said temperature value is extracted from a radiometric infrared image generated from said radiometric infrared sensor.

17. The system of claim 9 , wherein each of said red raster value, said green raster value, and said blue raster value are extracted from a light reflectance image generated from said color light sensor.

18. The system of claim 17 , wherein said color light sensor comprises an RGB sensor with an infrared filter.

19. The system of claim 9 , wherein said model is further trained and optimized with a soil moisture value associated with said plant.

Continuity (5)
Provisional Application 63339420 · May 7, 2022
Provisional Application 63339422 · May 7, 2022
Provisional Application 63339421 · May 7, 2022
Provisional Application 63339418 · May 7, 2022
Related Publication 20230360211A1 · Nov 9, 2023
References Cited (42)
US 9866768B1 · O'Shaughnessy · 2018 [cited by examiner]
US 11263707B2 · Perry · 2022 [cited by examiner]
US 20200333185A1 · Vrabie · 2020 [cited by examiner]
US 20210398281A1 · Lys · 2021 [cited by examiner]
US 20230026679A1 · Matarazzo · 2023 [cited by examiner]
US 20230292647A1 · Bainbridge · 2023 [cited by examiner]
US 20230316555A1 · Spangenberg · 2023 [cited by examiner]
US 20240095911A1 · Taneja · 2024 [cited by examiner]
Abdelrahman et al., “The “Stay-Green” trait and phytohormone signaling networks in plants under heat stress”, published May 8, 2017. [cited by applicant]
Barry et al., “Amino Acid Substitutions in Homologs of the Stay-Green Protein are Responsible for the green-flesh and chlorophyll retainer Mutations of Tomato and Pepper”, published Mar. 21, 2008. [cited by applicant]
An et al., “Identification and Classification of Maize Drought Stress Using Deep Convolutional Neural Network”, published Feb. 18, 2019. [cited by applicant]
Andrade et al., “Machine learning algorithms applied to the forecasting of crop water stress indicators”, published 2018. [cited by applicant]
Singh et al., “Machine Learning for High-Throughput Stress Phenotyping in Plants”, published Feb. 2016. [cited by applicant]
Barry et al., “A survey of cultivated heirloom tomato varieties identifies four new mutant alleles at the green-flesh locus”, published May 18, 2009. [cited by applicant]
Talbott et al., “Phytochrome and Blue Light-Mediated Stomatal Opening in the Orchid, Paphiopedilum”, published 2002. [cited by applicant]
Buitrago et al., “Changes in thermal infrared spectra of plants caused by temperature and water stress”, published Dec. 8, 2015. [cited by applicant]
Chattopadhyay et al., “Skin colour, carotenogenesis and chlorophyll degradation mutant alleles: genetic orchestration behind the fruit colour variation in tomato”, published Jan. 3, 2021. [cited by applicant]
Corrigan, “10 Thermal Vision Cameras for Drones and How Thermal Imaging Works”, believed to be published Feb. 27, 2020, retrieved Jul. 18, 2023 from https://www.dronezon.com/learn-about-drones-quadcopters/9-heat-vision-… [cited by applicant]
Alordzinu et al., “Rapid Estimation of CropWater Stress Index on Tomato Growth”, published Jul. 29, 2021. [cited by applicant]
Stutsel et al., “Detecting Plant Stress Using Thermal and Optical Imagery From an Unoccupied Aerial Vehicle”, published Oct. 25, 2021. [cited by applicant]
Colak et al., “Evaluation of Crop Water Stress Index (CWSI) for Eggplant under Varying Irrigation Regimes Using Surface and Subsurface Drip Systems”, published Apr. 27, 2015. [cited by applicant]
Hortensteiner, “Stay-green regulates chlorophyll and chlorophyll-binding protein degradation during senescence”, published Feb. 23, 2009. [cited by applicant]
Thomas et al., “The stay-green trait”, published Mar. 5, 2014. [cited by applicant]
Hu et al., “Silencing of the LeSGR1 gene in tomato inhibits chlorophyll degradation and exhibits a stay-green phenotype”, published 2011. [cited by applicant]
Idso, “Non-Water-Stressed Baselines: A Key to Measuring and Interpreting Plant Water Stress”, published 1982. [cited by applicant]
Inoue et al., “Blue Light Regulation of Stomatal Opening and the Plasma Membrane H+-ATPase1[Open]”, published Jun. 2017. [cited by applicant]
Jackson et al., “Canopy Temperature as a Crop Water Stress Indicator”, published Aug. 1981. [cited by applicant]
Mott et al., “The role of the mesophyll in stomatal responses to light and CO2”, published 2008. [cited by applicant]
Nay et al., “A machine-learning approach to forecasting remotely sensed vegetation health”, published Dec. 18, 2017. [cited by applicant]
Condorelli et al., “Comparative Aerial and Ground Based High Throughput Phenotyping for the Genetic Dissection of NDVI as a Proxy for Drought Adaptive Traits in Durum Wheat”, published Jun. 26, 2018. [cited by applicant]
Erken et al., “Effects of Water Stress on Yield and Some Quality Parameters of Broccoli”, published Jun. 2010. [cited by applicant]
Dayer et al., “Nighttime transpiration represents a negligible part of water loss and does not increase the risk of water stress in grapevine”, published 2021. [cited by applicant]
Jackson et al., “A Reexamination of the Crop Water Stress Index”, published 1988. [cited by applicant]
Jiao et al., “Roles of stay green (SGR) homologs during chlorophyll degradation in green plants”, published Sep. 23, 2020. [cited by applicant]
Kang et al., “Molecular Insights Reveal Psy1, SGR, and SIMYB12 Genes are Associated with Diverse Fruit Color Pigments in Tomato ( [cited by applicant]
Shimazaki et al., “Light Regulation of Stomatal Movement”, published Jan. 5, 2007. [cited by applicant]
Eisinger et al., “The Ultraviolet Action Spectrum for Stomatal Opening in Broad Bean”, published Jan. 2000. [cited by applicant]
Ehrler, “Cotton Leaf Temperatures as Related to Soil Water Depletion and Meteorological Factors”, published May 1, 1973. [cited by applicant]
Yang et al., “Assessment of Water and Nitrogen Use Efficiencies Through UAV-Based Multispectral Phenotyping in Winter Wheat”, published Jun. 26, 2020. [cited by applicant]
Yang et al., “Light-Mediated Signaling and Metabolic Changes Coordinate Stomatal Opening and Closure”, published Dec. 4, 2020. [cited by applicant]
Yang et al., “Non-Contacting Techniques for Plant Drought Stress Detection”, published 2008. [cited by applicant]
Luo et al., “A Stay-Green protein SISGR1 regulates lycopene and β-carotene accumulation by interacting directly with SIPSY1 during ripening processes in tomato”, published Apr. 2013. [cited by applicant]
Cited By (1)
US 12,694,555