IP Library Granted Patent US 10,635,274
Granted Patent B2
US 10,635,274 · App. 15/271,630 · Granted Apr 28, 2020

Horticultural care tracking, validation and verification

Inventors: Adam Phillip Takla Greenberg (San Francisco, CA); Matthew Charles King (Seattle, WA)
Assignee: IUNU, Inc.
G06F3/04842A01G22/00G06F3/03547G06F3/0484G06F3/04817G06F3/04883G06F16/5854G06T11/206G06T11/60G06F17/241G06K9/00657
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,635,274
App. No.
15/271,630
Granted
Apr 28, 2020
Kind
B2
Abstract

A system to collect information about plants on a per plant or near per plant basis and to promulgate remedial courses of action is disclosed. A horticultural operation collects plant information, aggregates the information, and allows an administrative worker such as a master grower to review issues about plants in a grow operations and the associated potential remedial course of action. The administrative worker can then browse data about the affected plants to determine whether to select the potential remedial course of action. Browsing and review of issues may be done collaboratively by remote administrative workers. Remedial courses of action are then dispatched to line workers solely using an iconographic language, who in turn provide notifications when the courses of action are done. Administrative workers may then validate and verify that the courses of action have been properly executed and evaluate the courses of action's efficacy.

Claims (73)

1. A method to evaluate detected anomalies of a plant, comprising:

under control of one or more processors:

receiving a plurality of images corresponding to a plurality of plants respectively, wherein at individual image of the plurality of images includes an identified plant and an identified artifact;

analyzing, via an image processing method, the individual image to generate an issue record associated with the identified plant, the issue record including an identified issue that corresponds to the identified artifact of the identified plant;

displaying the individual image along with the identified issue, wherein the identified issue is based on an analysis of the identified artifact;

identifying and dispatching a remedial course of action that is associated with the identified issue;

receiving, a notification that indicates a performance of the remedial course of action; and

retrieving, a first instance of the individual image at a point in time prior to the performance of the remedial course of action and a second instance of the individual image at a second point in time after the performance of the remedial course of action; and

dynamically verifying, via a general trend analysis method and a sequential analysis method, the performance of the remedial course of action based at least in part on the first instance of the individual image and the second instance of the individual image, wherein verifying the performance of the remedial course of action occurs without manual user input.

2. The method of claim 1 , further comprising:

displaying the remedial course of action;

receiving a selection of the remedial course of action; and

graphically indicating that the remedial course of action has been dispatched to a line worker.

3. The method of claim 1 , further comprising:

determining that the performance of the remedial course of action was not effective;

specifying an alternate remedial course of action;

storing the alternate remedial course of action; and

graphically indicating that the alternate remedial course of action has been dispatched to a line worker.

4. The method of claim 2 , further comprising:

graphically indicating that the remedial course of action has been performed.

5. The method of claim 2 , further comprising:

specifying a time threshold as to when the remedial course of action is to be performed; and

determining that the remedial course of action has not been performed has not been received within the time threshold; and

graphically indicating an alter that the remedial course of action has not been performed.

6. The method of claim 1 , further comprising:

receiving a user interface gesture selecting an image of interest, the image of interest including the identified plant or an image segment of the identified artifact; and

displaying, responsive to the user interface gesture, an additional image related to the image of interest.

7. The method of claim 1 , wherein displaying the individual image occurs on a local display and a remote display.

8. The method of claim 1 , further comprising:

receiving, from a remote administrative personnel, a collaborative request to perform a collaborative review of the individual image along with the identified issue; and

initiating the collaborative review of the individual image along with the identified issue with the remote administrative personnel, based at least in part on collaboration privileges associated with the remote administrative personnel, wherein the collaborative review occurs on a local display and a remote display associated with the remote administrative personnel.

9. The method of claim 1 , wherein the individual image corresponds to an image of interest, and the identified artifact is displayed with a graphical indicia distinguishing the identified artifact from a remaining portion of the image of interest.

10. The method of claim 1 , wherein the individual image is a first image of interest and the plurality of images includes a second image of interest that includes the identified plant and the identified artifact, and further comprising;

receiving a selection to display the first image of interest and the second image of interest in a user interface pattern of a plurality of user interface patterns; and

displaying the first image of interest and the second image of interest based at least in part on the user interface pattern.

11. The method of claim 10 , wherein the selection corresponds to

a user interface gesture that is configured to toggle between display patterns, and

wherein, displaying the first image of interest and the second image of interest occurs responsive to the user interface gesture.

12. The method of claim 11 , further comprising:

displaying a chart over time of at least one parameter of the identified plant, and

wherein the user interface gesture corresponds to an additional selection on the chart, the additional selection corresponding to a point in time, and

wherein the second image of interest corresponds to the identified plant at the point in time.

13. The method of claim 12 , wherein the at least one parameter is any one of the following:

daily light integral;

vapor pressure deficit; or

relative photosynthesis index.

14. The method of claim 10 , wherein one of the first image of interest or the second image of interest represents a baseline image of the identified plant.

15. The method of claim 1 , wherein the individual image corresponds to an image of interest, and further comprising:

receiving a user interface gesture to annotate the image of interest;

receiving annotation information; and

graphically displaying the annotation information and a graphical link to the image of interest.

16. A method to queue tasks to a horticultural line worker, comprising:

receiving at least one task to perform on a plant;

requesting, via a dispatching device, a first image of the plant at a point in time prior to completion of the at least one task;

requesting, via the dispatching device, a second image of the plant at a second point in time after the at least one task was reported as complete;

selecting a display pattern of a plurality of display patterns that overlay the first image and the second image on the dispatching device and highlight differences between the first image and the second image;

presenting on a display of the dispatching device the first image and the second image, based at least in part on the display pattern; and

determining, via a general trend analysis method of a sequential analysis method, whether the at least one task was properly performed, based at least in part on a comparison of the first image and the second image.

17. The method of claim 16 , further comprising:

receiving a user interface gesture indicating that the at least one task was properly performed, and

wherein, determining whether the at least task was properly performed is further based at least in part on receipt of the user interface gesture.

18. A system to determine an efficacy of horticultural tasks, comprising:

a processor;

a memory communicatively coupled to the processor;

a data storage comprised of records of tasks, each record of a task associated with an identified issue associated with an artifact of an identified plant, and each record of a task configured to be associated with one or more images, the artifact corresponding to a portion of the identified plant;

a dispatcher software component, resident in the memory, configured to receive a plurality of tasks to be performed on an identified plant;

a status receiver software component, resident in the memory, configured to receive notifications of a plurality of tasks completed on the identified plant;

an analysis software component, resident in the memory, configured to:

review a first image of the identified plant prior to receiving a notification of a task being performed and a second image of the identified plant after receiving a notification of the task being performed,

dynamically perform a trend analysis to determine an efficacy of the task being performed to resolve the identified issue associated with the artifact of the identified plant, based at least in part on a comparison of the first image and the second image, the trend analysis being performed without manual user input; and

a reporting software component, resident in the memory, configured to report the trend analysis.

19. The system of claim 18 , wherein the analysis software component determines that a notification that the task was performed does not agree with the review of the images.

20. The system of claim 18 , wherein the analysis software component determines that the identified plant was improperly removed based on the review of the first image and the second image.

Assignments (5)
SECURITY INTEREST Recorded Nov 15, 2024
From: IUNU, INC.
To: FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 069282/0466 →
CHANGE OF NAME Recorded May 18, 2017
From: IUNU, LLC
To: IUNU, INC.
Reel/Frame 042500/0892 →
RELEASE OF SECURITY INTEREST Recorded May 4, 2017
From: LINDQUIST, THOMAS M.
To: IUNU, LLC.
Reel/Frame 042247/0113 →
SECURITY INTEREST Recorded Nov 16, 2016
From: IUNU, LLC.
To: LINDQUIST, THOMAS M.
Reel/Frame 040347/0797 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2016
From: GREENBERG, ADAM PHILLIP TAKLA; KING, MATTHEW CHARLES
To: IUNU, LLC
Reel/Frame 040314/0077 →
Continuity (2)
Continuation In Part 15271569 · Sep 21, 2016
Related Publication 20180081522A1 · Mar 22, 2018
Cited By (3)
US 12,197,219 US 12,423,762 US 12,716,879