IP Library Granted Patent US 11,277,957
Granted Patent B2
US 11,277,957 · App. 16/547,151 · Granted Mar 22, 2022

Vehicle controllers for agricultural and industrial applications

Inventors: David E. Bertucci (Sunnyvale, CA); Igino C. Cafiero (Palo Alto, CA); Aubrey C. Donnellan (San Mateo, CA); Thuy T. Nguyen (Albany, CA); Vaibhav K. Viswanathan (Omaha, NE)
Assignee: Bear Flag Robotics, Inc.
A01B79/005G05D1/0088G05D1/0212G05D1/0276G06F16/29G06K9/00791G06K9/6202G06K9/623G06T7/70G05D2201/0201G06T2207/10028G06T2207/30188G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,277,957
App. No.
16/547,151
Filed
Aug 21, 2019
Granted
Mar 22, 2022
Kind
B2
Art Unit
3662
USPC
701/24
Abstract

Systems and methods for vehicle controllers for agricultural and industrial applications are described. For example, a method includes receiving image data, captured using one or more image sensors connected to a vehicle, depicting one or more plants in a vicinity of the vehicle; detecting the one or more plants based on the image data; responsive to detecting the one or more plants, adjusting implement control data; and controlling, based on the adjusted implement control data, an implement connected to the vehicle to perform an operation on the one or more plants.

Claims (44)

1. A system, comprising:

one or more image sensors connected to a vehicle, including a normalized difference vegetation index camera connected to the vehicle;

actuators configured to control operation of an implement, wherein the implement is connected to the vehicle and configured to selectively perform an operation in a vicinity of the vehicle; and

a processing apparatus configured to:

receive image data, captured using the one or more image sensors, depicting one or more plants in a vicinity of the vehicle, wherein the image data includes normalized difference vegetation index data captured using the normalized difference vegetation index camera for the one or more plants;

detect the one or more plants based on the image data;

determine an indication of an extent to which the one or more plants are thriving based on the normalized difference vegetation index data;

responsive to detecting the one or more plants, adjust implement control data based on the indication of the extent to which the one or more plants are thriving, wherein the implement control data is adjusted based on a count of the one or more plants detected in the vicinity of the vehicle; and

control one or more of the actuators, based on the adjusted implement control data, to cause the implement to perform the operation on the one or more plants.

2. The system of claim 1 , wherein adjusting the implement control data includes adjusting an amount of input to be deposited on the one or more plants based on the normalized difference vegetation index data.

3. The system of claim 1 , in which the implement is configured to selectively deposit input in a vicinity of the vehicle, and the processing apparatus is configured to:

control one or more of the actuators, based on the adjusted implement control data, to cause the implement to deposit an input on the one or more plants.

4. The system of claim 3 , in which the input is water, fertilizer, or pesticide.

5. The system of claim 1 , in which the implement is configured to selectively collect output in a vicinity of the vehicle, and the processing apparatus is configured to:

control one or more of the actuators, based on the adjusted implement control data, to cause the implement to collect an output from the one or more plants.

6. The system of claim 1 , in which the vehicle is a tractor and the implement is a sprayer.

7. The system of claim 1 , in which the vehicle is a tractor and the implement is a harvester.

8. A method comprising:

receiving image data, captured using one or more image sensors connected to a vehicle, depicting one or more plants in a vicinity of the vehicle, wherein the one or more image sensors include a normalized difference vegetation index camera connected to the vehicle and the image data includes normalized difference vegetation index data captured using the normalized difference vegetation index camera for the one or more plants;

detecting the one or more plants based on the image data;

determining an indication of an extent to which the one or more plants are thriving based on the normalized difference vegetation index data;

responsive to detecting the one or more plants, adjusting implement control data based on the indication of the extent to which the one or more plants are thriving, wherein the implement control data is adjusted based on a count of the one or more plants detected in the vicinity of the vehicle; and

controlling, based on the adjusted implement control data, an implement connected to the vehicle to perform an operation on the one or more plants.

9. The method of claim 8 , wherein adjusting the implement control data includes adjusting an amount of input to be deposited on the one or more plants based on the normalized difference vegetation index data.

10. The method of claim 8 , in which the implement is configured to selectively deposit input in a vicinity of the vehicle, and the method comprising:

controlling, based on the adjusted implement control data, the implement to deposit an input on the one or more plants.

11. The method of claim 10 , in which the input is water, fertilizer, or pesticide.

12. The method of claim 8 , in which the implement is configured to selectively collect output in a vicinity of the vehicle, and the method comprising:

controlling, based on the adjusted implement control data, the implement to collect an output from the one or more plants.

13. The method of claim 8 , in which the vehicle is a tractor and the implement is a sprayer.

14. The method of claim 8 , in which the vehicle is a tractor and the implement is a harvester.

15. A non-transitory computer-readable storage medium storing executable instructions that, when executed by a processor, facilitate performance of operations comprising:

receiving image data, captured using one or more image sensors connected to a vehicle, depicting one or more plants in a vicinity of the vehicle, wherein the one or more image sensors include a normalized difference vegetation index camera connected to the vehicle and the image data includes normalized difference vegetation index data captured using the normalized difference vegetation index camera for the one or more plants;

detecting the one or more plants based on the image data;

determining an indication of an extent to which the one or more plants are thriving based on the normalized difference vegetation index data;

responsive to detecting the one or more plants, adjusting implement control data based on the indication of the extent to which the one or more plants are thriving, wherein the implement control data is adjusted based on a count of the one or more plants detected in the vicinity of the vehicle; and

controlling, based on the adjusted implement control data, an implement connected to the vehicle to perform an operation on the one or more plants.

16. The non-transitory computer-readable storage medium of claim 15 , wherein adjusting the implement control data includes adjusting an amount of input to be deposited on the one or more plants based on the normalized difference vegetation index data.

17. The non-transitory computer-readable storage medium of claim 15 , in which the implement is configured to selectively deposit input in a vicinity of the vehicle, and in which the operations comprise:

controlling, based on the adjusted implement control data, the implement to deposit an input on the one or more plants.

18. The non-transitory computer-readable storage medium of claim 15 , in which the implement is configured to selectively collect output in a vicinity of the vehicle, and in which the operations comprise:

controlling, based on the adjusted implement control data, the implement to collect an output from the one or more plants.

19. The non-transitory computer-readable storage medium of claim 15 , in which the vehicle is a tractor and the implement is a sprayer.

20. The non-transitory computer-readable storage medium of claim 15 , in which the vehicle is a tractor and the implement is a harvester.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2023
From: BEAR FLAG ROBOTICS, INC.
To: DEERE & COMPANY
Reel/Frame 065960/0225 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2021
From: BERTUCCI, DAVID E.; CAFIERO, IGINO C.; DONNELLAN, AUBREY C.; NGUYEN, THUY T.; VISWANATHAN, VAIBHAV K.
To: BEAR FLAG ROBOTICS, INC.
Reel/Frame 058370/0280 →
Continuity (3)
Continuation 16288441 · Feb 28, 2019
Provisional Application 62703718 · Jul 26, 2018
Related Publication 20200029490A1 · Jan 30, 2020
Cited By (1)
US 12,294,722