IP Library Granted Patent US 10,524,402
Granted Patent B2
US 10,524,402 · App. 15/665,025 · Granted Jan 7, 2020

Method and apparatus for automated plan necrosis

Inventor: Lee Redden (Stanford, CA)
Assignee: BLUE RIVER TECHNOLOGY INC.
A01B41/06A01D75/00A01G7/00A01M21/00G06K9/00657G06K9/2036G06K9/3241G06T7/11G06T7/66G06T7/73G06K2209/17G06T2207/20164G06T2207/30128G06T2207/30188G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,524,402
App. No.
15/665,025
Granted
Jan 7, 2020
Kind
B2
Abstract

A method of real-time plant selection and removal from a plant field including capturing a first image of a first section of the plant field, segmenting the first image into regions indicative of individual plants within the first section, selecting the optimal plants for retention from the first image based on the first image and the previously thinned plant field sections, sending instructions to the plant removal mechanism for removal of the plants corresponding to the unselected regions of the first image from the second section before the machine passes the unselected regions, and repeating the aforementioned steps for a second section of the plant field adjacent the first section in the direction of machine travel.

Claims (79)

1. A method comprising:

capturing an image of a section of a field of plants with a camera physically attached to a machine travelling in a direction through the field, the image comprising a plurality of plants in the field;

identifying a distinct plant of the plurality of plants having a plant portion overlapping another plant portion of another distinct plant of the plurality of plants;

in response to identifying the overlapping plant portions, generating a plant pattern to identify two sets of plants, a first set of plants to be retained in the field including at least the distinct plant, and a second set of plants to be removed from the field and including at least the other distict plant;

selecting a plant removal mechanism for removing the second set of plants including the other distinct plant from a plurality of plant removal mechanisms physically attached to the machine based on properties of the other distinct plant; and

activating the selected plant removal mechanism to remove the other distinct plant as the plant removal mechanism passes by the other distinct plant along a first direction.

2. The method of claim 1 , wherein identifying the distinct plant of the plurality of plants having a plant portion overlapping another plant portion of another distinct plant of the plurality of plants further comprises:

segmenting the image into a plurality of regions, the plurality of regions segmented based on differences between pixels of the image;

identifying a plurality of potential points of interest within a region of the plurality of regions;

determining that each potential point of interest of the plurality indicates a unique feature of the other distinct plant; and

determining properties of each potential point of interest and the region of the plurality of potential points of interest based on a set of cultivation parameters.

3. The method of claim 1 , wherein the properties of the other distinct plant include any of plant size, plant shape, plant health, plant spacing, and plant yield.

4. The method of claim 1 , wherein selecting a plant removal mechanism based on properties of the other distinct plant comprises:

selecting a type of the plant removal mechanism, wherein the type can include any of a spraying mechanism, a cutting mechanism, an uprooting mechanism, a heat generating mechanism, or an electricity generating mechanism.

5. The method of claim 1 , wherein the properties of the other distinct plant include a position of the distinct plant and the selected plant removal mechanism is a plant removal mechanism of the plurality of plant removal mechanisms most proximal to the position of the distinct plant.

6. The method of claim 1 , wherein the plurality of plant removal mechanisms include a first spraying mechanism for spraying a first substance and a second spraying mechanism for spraying a second substance, and wherein selecting the plant removal mechanism comprises:

determining if the first substance or the second substance is suitable for removing the other distinct plant from the field; and

selecting the first spraying mechanism or the second spraying mechanism based on the determination.

7. The method of claim 1 , comprising:

generating, by the computer, a set of instructions for removal of the distinct plant using the selected plant removal mechanism;

sending, from the computer, the set of instructions to the selected plant removal mechanism before the selected plant removal mechanism passes by the other distinct plant along the first direction.

8. A non-transitory computer readable medium storing instructions, the instructions when executed cause a processor physically attached to a machine travelling in a direction through a field of plants to:

capture an image of a section of a field of plants with a camera physically attached to a machine travelling in a direction through the field, the image comprising a plurality of plants in the field;

identify a distinct plant of the plurality of plants having a plant portion overlapping another plant portion of another distinct plant of the plurality of plants;

in response to identifying the overlapping plant portions, generate a plant pattern to identify two sets of plants, a first set of plants to be retained in the field including at least the first distinct plant, and a second set of plants to be removed from the field and including at least the other distict plant;

select a plant removal mechanism for removing the second set of plants including the other distinct plant from a plurality of plant removal mechanisms physically attached to the machine based on properties of the other distinct plant; and

activate the selected plant removal mechanism to remove the other distinct plant as the plant removal mechanism passes by the other distinct plant along a first direction.

9. The non-transitory computer readable medium of claim 8 , wherein the instructions for identifying the distinct plant of the plurality of plants having a plant portion overlapping another plant portion of another distinct plant of the plurality of plants further cause the processor to:

segment the image into a plurality of regions, the plurality of regions segmented based on differences between pixels of the image;

identify a plurality of potential points of interest within a region of the plurality of regions;

determine that each potential point of interest of the plurality indicates a unique feature of the other distinct plant; and

determine properties of the potential point of interest and the region of the plurality of potential points of interest based on a set of cultivation parameters.

10. The non-transitory computer readable medium of claim 8 , wherein the properties of the other distinct plant include any of plant size, plant shape, plant health, plant spacing, and plant yield.

11. The non-transitory computer readable medium of claim 8 , wherein the instructions to select a plant removal mechanism based on properties of the other distinct plant further causes the processor to:

select a type of the plant removal mechanism, wherein the type can include any of a spraying mechanism, a cutting mechanism, an uprooting mechanism, a heat generating mechanism, or an electricity generating mechanism.

12. The non-transitory computer readable medium of claim 8 , wherein the properties of the other distinct plant include a position of the distinct plant and the selected plant removal mechanism is a plant removal mechanism of the plurality of plant removal mechanisms most proximal to the position of the distinct plant.

13. The non-transitory computer readable medium of claim 8 , wherein the plurality of plant removal mechanisms include a first spraying mechanism for spraying a first substance and a second spraying mechanism for spraying a second substance, and wherein the instructions to select the plant removal mechanism further cause the processor to:

determine if the first substance or the second substance is suitable for removing the other distinct plant from the field; and

select the first spraying mechanism or the second spraying mechanism based on the determination.

14. The non-transitory computer readable medium of claim 8 , wherein the instructions further cause the processor to:

generate a set of instructions for removal of the distinct plant using the selected plant removal mechanism;

send the set of instructions to the selected plant removal mechanism before the selected plant removal mechanism passes by the other distinct plant along the first direction.

15. A machine comprising:

a drive mechanism configured to move the machine in a direction in a field of plants;

a plurality of plant removal mechanisms for removing plants from the field;

a camera system for capturing images of the field of plants;

a processor storing instructions that when executed cause the machine to:

capture an image of a section of a field of plants with a camera physically attached to a machine travelling in a direction through the field, the image comprising a plurality of plants in the field;

identify a distinct plant of the plurality of plants having a plant portion overlapping another plant portion of another distinct plant of the plurality of plants;

in response to identifying the overlapping plant portions, generate a plant pattern to identify two sets of plants, a first set of plants to be retained in the field and including at least the first distinct plant, and a second set of plants to be removed from the field and including at least the other distict plant;

select a plant removal mechanism for removing the second set of plants including the other distinct plant from a plurality of plant removal mechanisms physically attached to the machine based on properties of the other distinct plant; and

activate the selected plant removal mechanism to remove the other distinct plant as the plant removal mechanism passes by the other distinct plant along a first direction.

16. The machine of claim 15 , wherein the instructions for identifying the distinct plant of the plurality of plants having a plant portion overlapping another plant portion of another distinct plant of the plurality of plants further cause the machine to:

segment the image into a plurality of regions, the plurality of regions segmented based on differences between pixels of the image;

identify a plurality of potential points of interest within a region of the plurality of regions;

determine that each potential point of interest of the plurality indicates a unique feature of the other distinct plant; and

determine properties of the potential point of interest and the region of the plurality of potential points of interest based on a set of cultivation parameters.

17. The machine of claim 15 , wherein the properties of the other distinct plant to be removed include any of plant size, plant shape, plant health, plant spacing, and plant yield.

18. The machine of claim 15 , wherein the instructions to select a plant removal mechanism based on properties of the other distinct plant further causes the processor to:

select a type of the plant removal mechanism, wherein the type can include any of a spraying mechanism, a cutting mechanism, an uprooting mechanism, a heat generating mechanism, or an electricity generating mechanism.

19. The machine of claim 15 , wherein the properties of the other distinct plant include a position of the distinct plant, and the selected plant removal mechanism is a plant removal mechanism of the plurality of plant removal mechanisms most proximal to the position of the distinct plant.

20. The machine of claim 15 , wherein the plurality of plant removal mechanisms include a first spraying mechanism for spraying a first substance and a second spraying mechanism for spraying a second substance, and wherein the instructions to select the plant removal mechanism further causes the processor to:

determine if the first substance or the second substance is suitable for removing the other distinct plant from the field; and

select the first spraying mechanism or the second spraying mechanism based on the determination.

21. The machine of claim 15 , wherein the instructions further cause the machine to:

generate a set of instructions for removal of the distinct plant using the selected plant removal mechanism;

send the set of instructions to the selected plant removal mechanism before the selected plant removal mechanism passes by the other distinct plant along the first direction.

22. The method of claim 1 , wherein generating the plant pattern further comprises:

calculating a utility value for each of a set of permutations of retained plants of the first set of plants;

selecting a maximum utility value from the calculated values, the maximum utility value corresponding to an optimal permutation; and

generating a plant pattern based on the optimal permutation.

23. The non-transitory computer readable medium of claim 8 , wherein generating the plant pattern further comprises instructions that cause the processor to:

calculate a utility value for each of a set of permutations of retained plants of the first set of plants;

select a maximum uitility value from the calculated values, the maximum utility value corresponding to an optimal permutation; and

generate a plant pattern based on the optimal permutation.

24. The machine of claim 15 , wherein generating the plant pattern further comprises instructions that cause the processor to:

calculate a utility value for each of a set of permutations of retained plants of the first of plants;

select a maximum uitility value from the calculated values, the maximum utility value corresponding to an optimal permutation; and

generate a plant pattern based on the optimal permutation.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2024
From: BLUE RIVER TECHNOLOGY INC.
To: DEERE & COMPANY
Reel/Frame 069164/0195 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2017
From: REDDEN, LEE
To: BLUE RIVER TECHNOLOGY INC.
Reel/Frame 043149/0035 →
Continuity (5)
Continuation 14713362 · May 15, 2015
Continuation 13788359 · Mar 7, 2013
Provisional Application 61609767 · Mar 12, 2012
Provisional Application 61608005 · Mar 7, 2012
Related Publication 20180116094A1 · May 3, 2018
Cited By (2)
US 12,201,044 US 12,317,881