IP Library Granted Patent US 12,302,807
Granted Patent B2
US 12,302,807 · App. 17/384,568 · Granted May 20, 2025

Method for monitoring growth of plants and generating a plant grow schedule

Inventors: Jonathan Binney (Lockhart, TX); Winnie Ding (Lockhart, TX); Peter Cheng (Lockhart, TX); Martha Patricia Romero Luna (Lockhart, TX); Jamie Young (Lockhart, TX); Sarah Osentoski (Lockhart, TX)
Assignee: Inevitable Technology Inc.
A01G5/00B25J9/1679G01N33/0098G05B19/416G06T7/0012G06T7/0016G05B2219/39369G05B2219/40233G06T2207/10024G06T2207/30188Y10S901/01Y10S901/47
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,302,807
App. No.
17/384,568
Granted
May 20, 2025
Kind
B2
Abstract

One variation of a method for monitoring growth of plants within a facility includes: aggregating global ambient data recorded by a suite of fixed sensors, arranged proximal a grow area within the facility, at a first frequency during a grow period; extracting intermediate outcomes of a set of plants, occupying a module in the grow area, from module-level images recorded by a mover at a second frequency less than the first frequency while interfacing with the module during the period of time; dispatching the mover to autonomously deliver the module to a transfer station; extracting intermediate outcomes of the set of plants from plant-level images recorded by the transfer station while sequentially transferring plants out of the module at the conclusion of the grow period; and deriving relationships between ambient conditions, intermediate outcomes, and final outcomes from a corpus of plant records associated with plants grown in the facility.

Claims (145)

1. A method for monitoring growth of plants within an agricultural facility comprising:

accessing a series of ambient conditions captured by a fixed sensor unit, arranged proximal a grow area within the agricultural facility, during a first time period;

writing the series of ambient conditions to a corpus of plant records associated with plants occupying a group of modules within the grow area based on known locations of modules within the grow area, the corpus of plant records comprising a first set of plant records associated with a first set of plants occupying a first module, in the group of modules, during the first time period;

dispatching a mover to autonomously deliver the first module from the grow area to a transfer station within the agricultural facility during a second time period succeeding the first time period;

for each plant in the first set of plants:

interpreting a final outcome of the plant based on plant-level data captured by the transfer station while transferring the plant out of the first module during the second time period; and

writing the final outcome of the plant to a plant record, in the first set of plant records, associated with the plant; and

deriving a set of relationships between ambient conditions and final outcomes of plants grown within the agricultural facility based on the corpus of plant records associated with plants grown in the agricultural facility.

2. The method of claim 1 :

further comprising:

dispatching the mover to autonomously deliver the first module from the grow area to an imaging station within the agricultural facility during the first time period;

accessing a set of module-level data captured by the imaging station when occupied by the first module during the first period of time;

interpreting intermediate outcomes of a first set of plants occupying the first module during the first time period based on the set of module-level data; and

writing intermediate outcomes of the first set of plants to the first set of plant records associated with the first set of plants; and

wherein deriving the set of relationships between ambient conditions and final outcomes of plants grown within the agricultural facility comprises deriving the set of relationships between ambient conditions, intermediate outcomes, and final outcomes of plants grown within the agricultural facility based on the corpus of plant records associated with plants grown within the agricultural facility.

3. The method of claim 1 :

further comprising:

accessing a set of water quality data captured by the mover via a probe inserted into the first module by the mover during the first time period; and

writing the set of water quality data to the first set of plant records; and

wherein deriving the set of relationships between ambient conditions and final outcomes of plants grown within the agricultural facility comprises deriving the set of relationships between ambient conditions, water quality, and final outcomes of plants grown within the agricultural facility based on the corpus of plant records.

4. The method of claim 1 :

wherein accessing the series of ambient conditions comprises accessing a series of ambient humidity data captured by the fixed sensor unit during the first time period;

wherein deriving the set of relationships between ambient conditions and final outcomes of plants grown within the agricultural facility based on the corpus of plant records comprises deriving a relationship between ambient humidity and final outcomes of plants grown within the agricultural facility; and

further comprising setting a target humidity range in the grow area based on the relationship between ambient humidity and final outcomes of plants grown within the agricultural facility.

5. A method for monitoring growth of plants within an agricultural facility comprising:

accessing a series of ambient conditions captured by a fixed sensor unit, arranged proximal a grow area within the agricultural facility, during a first time period;

writing the series of ambient conditions to a corpus of plant records associated with plants occupying a group of modules within the grow area based on known locations of modules within the grow area, the corpus of plant records comprising a first set of plant records associated with a first set of plants occupying a first module, in the group of modules, during the first time period;

dispatching a mover to autonomously deliver the first module from the grow area to an imaging station within the agricultural facility during the first time period;

accessing a set of module-level data captured by the imaging station when occupied by the first module during a first period of time;

interpreting intermediate outcomes of a first set of plants occupying the first module during the first time period based on the set of module-level data;

writing intermediate outcomes of the first set of plants to the first set of plant records associated with the first set of plants; and

deriving a first set of relationships between ambient conditions and intermediate outcomes of plants grown within the agricultural facility based on the corpus of plant records associated with plants grown within the agricultural facility.

6. The method of claim 5 , further comprising:

dispatching the mover to autonomously deliver the first module from the grow area to a transfer station within the agricultural facility during the first time period;

for each plant in the first set of plants:

interpreting a final outcome of the plant based on plant-level data captured by the transfer station while transferring the plant out of the first module during a second time period succeeding the first time period; and

writing the final outcome of the plant to a plant record, in the first set of plant records, associated with the plant; and

deriving a second set of relationships between ambient conditions, intermediate outcomes, and final outcomes of plants grown within the agricultural facility based on the corpus of plant records associated with plants grown within the agricultural facility.

7. The method of claim 6 :

wherein accessing the set of module-level data comprises accessing a module-level image captured by the imaging station when occupied by the first module during the first period of time;

wherein interpreting intermediate outcomes of the first set of plants comprises:

identifying a first region of the module-level image depicting foliage;

extracting a first set of foliage characteristics from the first region of the module-level image; and

interpreting intermediate outcomes of the first set of plants during the first time period based on the first set of foliage characteristics; and

wherein interpreting the final outcome of a plant for each plant in the first set of plants comprises, for each plant in the first set of plants:

accessing a plant-level image of the plant captured by the transfer station while transferring the plant out of the first module during the second time period;

extracting a second set of visual features from the plant-level image of the plant; and

interpreting a final outcome of the plant based on the second set of features.

8. The method of claim 7 :

wherein extracting the first set of foliage characteristics from the first region of the module-level image comprises extracting a foliage color characteristic and a foliage density characteristic from the first region of the module-level image;

wherein interpreting intermediate outcomes of the first set of plants comprises interpreting intermediate outcomes of the first set of plants based on the first set of foliage color characteristic and the foliage density characteristic;

wherein extracting the second set of visual features from a plant-level image for each plant in the first set of plants comprises, for each plant in the first set of plants extracting a second set of visual features comprising a final color, a final size, and a final geometry of the plant from a plant-level image of the plant; and

wherein interpreting a final outcome of a plant for each plant in the first set of plants comprises, for each plant in the first set of plants, interpreting a final outcome of the plant based on a final color, a final size, and a final geometry of the plant.

9. The method of claim 5 :

further comprising:

by the mover, in response to receiving a command to deliver the first module from the grow area to the imaging station:

autonomously navigating to a first module at the grow area within the agricultural facility;

coupling to the first module;

autonomously navigating to the imaging station;

autonomously navigating the first module through the imaging station; and

autonomously returning the first module to the grow area;

by the imaging station, capturing the set of module-level data comprising a first image of the first module as the first module progresses through the imaging station; and

for each plant in the first set of plants:

detecting the plant in a region of the first image; and

deriving visual characteristics of the plant based on visual features detected in the region of the first image; and

wherein interpreting intermediate outcomes of the first set of plants comprises interpreting intermediate outcomes of the first set of plants based on visual characteristics of the first set of plants derived from the first image.

10. The method of claim 9 , wherein capturing the set of module-level data comprises:

by the imaging station, capturing a sequence of photographic images of the first module as the first module progresses through the imaging station; and

fusing the sequence of photographic images into the first image comprising a three-dimensional representation of the first set of plants occupying the first module.

11. The method of claim 5 :

further comprising:

by the mover, in response to receiving a command to deliver the first module from the grow area to the imaging station:

autonomously navigating to a first module at the grow area within the agricultural facility;

coupling to the first module;

autonomously navigating to the imaging station;

autonomously navigating the first module through the imaging station; and

autonomously returning the first module to the grow area; and

by the imaging station, capturing the set of module-level data comprising a first image of the first module as the first module progresses through the imaging station; and

wherein interpreting intermediate outcomes of the first set of plants comprises:

identifying a region of the first image depicting foliage;

extracting a set of foliage color characteristics and a set of foliage density characteristics from the region of the first image; and

interpreting intermediate outcomes of the first set of plants during the first time period based on the first set of foliage color characteristics and the set of foliage density characteristics.

12. The method of claim 5 :

wherein interpreting intermediate outcomes of the first set of plants based on the set of module-level data comprises, for each plant in the first set of plants:

characterizing an intermediate color, an intermediate size, and an intermediate geometry of the plant based on the set of module-level data captured by the imaging station during the first time period; and

calculating an intermediate viability score of the plant based on the intermediate color, the intermediate size, and the intermediate geometry of the plant; and

wherein writing intermediate outcomes of the first set of plants to the first set of plant records comprises, for each plant in the first set of plants, writing an intermediate viability score of the plant to a plant record, in the first set of plant records, associated with the plant.

13. The method of claim 5 :

further comprising, by the imaging station, capturing the set of module-level data comprising a photographic image of the first module as the first module progresses through the imaging station during the first time period; and

wherein interpreting intermediate outcomes of the first set of plants and writing intermediate outcomes of the first set of plants to the first set of plant records comprise, for each plant in the first set of plants:

selecting a plant location in the first module;

identifying a plant record associated with the plant location;

extracting a set of plant features from a region of the photographic image proximal the plant location;

interpreting an intermediate outcome based on the set of plant features; and

writing the intermediate outcome to the plant record.

14. The method of claim 5 :

wherein accessing the series of ambient conditions comprises accessing ambient conditions captured by the fixed sensor unit, arranged within the grow area, at a first frequency during the first time period;

wherein dispatching the mover to autonomously deliver the first module from the grow area to the imaging station during the first time period comprises dispatching the mover to autonomously deliver the first module from the grow area to the imaging station at a second frequency less than the first frequency during the first time period; and

wherein accessing the set of module-level data comprises accessing the set of module-level data captured by the imaging station, when occupied by the first module at the second frequency, during the first period of time.

15. The method of claim 14 :

wherein deriving the first set of relationships between ambient conditions and intermediate outcomes comprises deriving strengths of relationships between ambient conditions and intermediate outcomes of plants grown within the agricultural facility based on the corpus of plant records; and

further comprising:

based on the first set of relationships between ambient conditions and intermediate outcomes, generating a new grow schedule:

defining target ambient conditions for a new plant over a growth cycle; and

predicted to yield a target intermediate outcome for the new plant; and

for a second module loaded with a second set of plants and occupying the grow area during a second time period succeeding the first time period, autonomously adjusting actuators within the agricultural facility according to the new grow schedule based on ambient conditions captured by the fixed sensor unit during the second time period.

16. The method of claim 5 :

further comprising:

accessing a set of water quality data captured by the mover via a probe inserted into the first module by the mover during the first time period; and

writing the set of water quality data to the first set of plant records; and

wherein deriving the first set of relationships between ambient conditions and intermediate outcomes of plants grown within the agricultural facility comprises deriving the first set of relationships between ambient conditions, water quality, and intermediate outcomes of plants grown within the agricultural facility based on the corpus of plant records.

17. A method for monitoring growth of plants within an agricultural facility comprising:

during a first time period, by a mover deployed within the agricultural facility:

autonomously navigating to a first module at a grow area;

autonomously navigating the first module through an imaging station within the agricultural facility; and

autonomously returning the first module to the grow area;

accessing a set of module-level data captured by the imaging station when occupied by the first module, at a first frequency, during a first period of time;

interpreting intermediate outcomes of a first set of plants occupying the first module during the first time period based on the set of module-level data;

writing intermediate outcomes of the first set of plants to a first set of plant records associated with the first set of plants;

during a second time period succeeding the first time period, by the mover, autonomously delivering the first module from the grow area to a transfer station within the agricultural facility;

for each plant in the first set of plants:

interpreting a final outcome of the plant based on plant-level data captured by the transfer station while transferring the plant out of the first module; and

writing the final outcome of the plant to a plant record, in the first set of plant records, associated with the plant; and

deriving a set of relationships between intermediate outcomes and final outcomes of plants grown within the agricultural facility based on the first set of plant records.

18. The method of claim 17 :

further comprising:

accessing a series of ambient conditions captured by a fixed sensor unit, arranged proximal the grow area within the agricultural facility, at a second frequency greater than the first frequency during a third time period preceding the second time period; and

writing the series of ambient conditions to a corpus of plant records associated with plants occupying a group of modules within the grow area based on known locations of modules within the grow area during the third time period, the corpus of plant records comprising the first set of plant records; and

wherein deriving the set of relationships between intermediate outcomes and final outcomes from the first set of plant records comprises deriving relationships between ambient conditions, intermediate outcomes, and final outcomes of plants grown within the agricultural facility based on the corpus of plant records.

19. The method of claim 17 :

further comprising:

by the mover, in response to receiving a command to deliver the first module from the grow area to the imaging station:

autonomously navigating to a first module at the grow area within the agricultural facility;

coupling to the first module;

autonomously navigating to the imaging station;

autonomously navigating the first module through the imaging station; and

autonomously returning the first module to the grow area;

by the imaging station, capturing the set of module-level data comprising a first image of the first module as the first module progresses through the imaging station;

for each plant in the first set of plants:

detecting the plant in a region of the first image; and

extracting visual characteristics of the plant based on visual features detected in the region of the first image; and

wherein interpreting intermediate outcomes of the first set of plants comprises interpreting intermediate outcomes of the first set of plants based on visual characteristics of the first set of plants derived from the first image.

20. The method of claim 19 , wherein capturing the set of module-level data comprises:

by the imaging station, capturing a sequence of photographic images of the first module as the first module progresses through the imaging station; and

fusing the sequence of photographic images into the first image comprising a three-dimensional representation of the first set of plants occupying the first module.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 23, 2024
From: INEVITABLE TECH INC.
To: INEVITABLE TECHNOLOGY INC.
Reel/Frame 066219/0770 →
CHANGE OF NAME Recorded Jan 23, 2024
From: IRON OX, INC.
To: INEVITABLE TECH INC.
Reel/Frame 066365/0146 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2023
From: BINNEY, JONATHAN; DING, WINNIE; CHENG, PETER; ROMERO LUNA, MARTHA PATRICIA; YOUNG, JAMIE; OSENTOSKI, SARAH
To: IRON OX, INC.
Reel/Frame 065902/0197 →
SECURITY INTEREST Recorded Apr 25, 2022
From: IRON OX, INC.
To: SILICON VALLEY BANK, AS AGENT
Reel/Frame 059689/0838 →
Continuity (4)
Continuation In Part 17028641 · Sep 22, 2020
Continuation 15955651 · Apr 17, 2018
Provisional Application 62486391 · Apr 17, 2017
Related Publication 20220007589A1 · Jan 13, 2022
References Cited (37)
US 5054831A · Ting et al. · 1991 [cited by applicant]
US 6327986B1 · Williames · 2001 [cited by applicant]
US 9538714B2 · Anderson · 2017 [cited by examiner]
US 20020043195A1 · Williames · 2002 [cited by applicant]
US 20020088173A1 · Hessel et al. · 2002 [cited by applicant]
US 20040122592A1 · Fuessley et al. · 2004 [cited by applicant]
US 20050135912A1 · Schempf et al. · 2005 [cited by applicant]
US 20060213167A1 · Koselka et al. · 2006 [cited by applicant]
US 20130110341A1 · Jones et al. · 2013 [cited by applicant]
US 20130333600A1 · Struijk et al. · 2013 [cited by applicant]
US 20140316557A1 · Jones et al. · 2014 [cited by applicant]
US 20160050852A1 · Lee · 2016 [cited by applicant]
US 20160120114A1 · Tsutsumi et al. · 2016 [cited by applicant]
US 20170223947A1 · Gall et al. · 2017 [cited by applicant]
US 20180092304A1 · Moore · 2018 [cited by applicant]
US 20180343810A1 · Counne · 2018 [cited by applicant]
US 20190023396A1 · Hackert et al. · 2019 [cited by applicant]
US 20200012852A1 · Ding et al. · 2020 [cited by applicant]
US 20200184153A1 · Bongartz et al. · 2020 [cited by applicant]
CN 101406150A · 2009 [cited by applicant]
CN 103213128A · 2013 [cited by applicant]
CN 105265302A · 2016 [cited by applicant]
CN 103279760B · 2016 [cited by applicant]
EP 3557970A4 · 2020 [cited by applicant]
JP 2012191903A · 2012 [cited by applicant]
NL 1031686C2 · 2007 [cited by applicant]
WO 2013186669A1 · 2013 [cited by applicant]
WO 2015110268A1 · 2015 [cited by applicant]
WO 2016070196A1 · 2016 [cited by applicant]
U.S. Appl. No. 17/028,641, “Non-Final Office Action”, Sep. 20, 2022, 11 pages. [cited by applicant]
Extended European Search Report received in EP 17883320.8 dated Jun. 26, 2020. [cited by applicant]
Extended European Search Report received in EP 18728818.6 dated Jun. 26, 2020. [cited by applicant]
International Search Report received in PCT/US18/13807 dated May 16, 2018. [cited by applicant]
International Search Report received in PCT/US2017/068224 dated Dec. 22, 2017. [cited by applicant]
Office Action received in CN 201780087239.9 dated Aug. 26, 2021. [cited by applicant]
Office Action received in EP 18738818.6 dated Mar. 11, 2021. [cited by applicant]
Office Action received in U.S. Appl. No. 15/872,299 dated Apr. 29, 2020. [cited by applicant]