IP Library Granted Patent US 11,406,097
Granted Patent B2
US 11,406,097 · App. 17/544,165 · Granted Aug 9, 2022

Autonomous detection and treatment of agricultural objects via precision treatment delivery system

Inventors: Gabriel Thurston Sibley (Portland, OR); Lorenzo Ibarria (Dublin, CA); Curtis Dale Garner (Modesto, CA); Patrick Christopher Leger (Belmont, CA); Wisit Jirattigalochote (Palo Alto, CA)
Assignee: Verdant Robotics, Inc.
A01M7/0089A01B69/001A01B69/008A01M7/005A01M7/0025A01M7/0039A01M7/0057A01M21/00A01M21/04A01M21/043G05B15/02G05D1/0094G05D2201/0201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,406,097
App. No.
17/544,165
Granted
Aug 9, 2022
Kind
B2
Abstract

Various embodiments of an apparatus, methods, systems and computer program products described herein are directed to an agricultural observation and treatment system and method of operation. The agricultural treatment system determines a vehicle pose of a vehicle as the vehicle moves along a path. The system identifies a first target agricultural object for treatment. Based on the determined vehicle pose, the system positions a treatment head of a first treatment unit such that a first projectile fluid may be emitted by the first treatment unit at the identified first target agricultural object. The system then causes an emitter to emit a fluid from the treatment head at the first target agricultural object.

Claims (68)

1. A computer-implemented method for treating agricultural objects, the method comprising:

determining a vehicle pose of a vehicle as the vehicle moves along a path;

identifying a first target agricultural object for treatment; and

based on the determined vehicle pose, positioning a treatment head of a first treatment unit such that a projectile fluid may be emitted by the first treatment unit at the identified first target agricultural object;

determining a spraybox pose for a first spraybox, the first spraybox comprising a component treatment module, wherein the first spraybox includes one or more cameras integral to the spraybox, and the spraybox pose is based on obtained sensor data from at least the one or more cameras integral to the spraybox; and

emitting a first fluid projectile from the treatment head at the first target agricultural object.

2. The method of claim 1 , wherein the vehicle pose is based on obtained sensor data from at least one of a camera, laser, radar sensor, sonar sensor, radio sensor, ultrasonic sensor, rangefinder, photoelectric sensor, global positioning systems (GPS), inertial measurement unit (IMU), gyroscopes, accelerometer, magnetometer, or a combination thereof.

3. The method of claim 1 , wherein the vehicle pose may be set to a vehicle local coordinate origin (x 0 , y 0 , z 0 ) and a local vehicle orientation (Φ 0 , θ 0 , Ψ 0 ), and the first treatment unit pose may be determined as a translated first treatment unit coordinate origin (x 1 , y 1 , z 1 ) relative to the vehicle local coordinate origin and as a translated first treatment unit starting orientation (Φ 1 , θ 1 , Ψ 1 ) relative to the local vehicle orientation.

4. The method of claim 1 , further comprising:

identifying a second target agricultural object for treatment; and

determining a spraybox pose for a second spraybox, the second spraybox comprising a treatment module, a component treatment module and treatment subsystem; and

based on the determined vehicle pose, and the determined spraybox pose for a second spraybox, positioning a treatment head of the second treatment unit such that a second projectile fluid may be emitted by the second treatment unit at the identified second target agricultural object.

5. The method of claim 1 , further comprising:

determining a treatment head pose for the treatment head, the treatment head pose based on encoders tracking the orientation of the treatment head and spraybox pose.

6. The method of claim 1 , further comprising:

determine a treatment head pose, based on the vehicle pose, the spraybox pose, and an orientation of the treatment unit to spraybox.

7. The method of claim 1 , wherein determining the vehicle pose comprises:

obtaining sensor data from one or more sensors and analyzing the obtained sensor data to determine the vehicle pose, wherein the sensor data comprise images of a real-word environment in which the vehicle may travel.

8. The method of claim 1 , further wherein identifying the first target agricultural object for treatment comprises:

obtaining one or more images depicting a plurality of agricultural objects;

analyzing the one or more image to identify one of the plurality of agricultural objects to treat; and

selecting the identified one of the plurality of agricultural objects as the first target agricultural object for treatment.

9. The method of claim 1 , further comprising:

identifying one or more agricultural objects positioned about the vehicle;

using the determined vehicle pose, while the vehicle is moving along the path, navigating the vehicle about the identified one or more agricultural objects so as to avoid vehicle impact with the identified one or more agricultural objects; and

activating the treatment unit to emit a second fluid projectile at the first target object.

10. The method of claim 1 , further comprising:

emitting a second fluid projectile from the treatment head at the first target agricultural object, wherein the first fluid projectile is obtained from a first fluid source tank and the second fluid projectile is obtained from a second fluid source tank.

11. The method of claim 10 , wherein the first fluid projectile is a liquid polymer and the second fluid projectile is a liquid hardener, and the liquid polymer may harden when the liquid polymer and liquid hardener are mixed on the first target object.

12. A system for treating agricultural objects, the system comprising:

a first treatment unit, first treatment unit having a moveable treatment head;

one or more processors, the one more processors configured to:

determine a vehicle pose of a vehicle as the vehicle moves along a path;

identify first target agricultural object for treatment; and

based on the determined vehicle pose, position a treatment head of a first treatment unit such that a first projectile fluid may be emitted by the first

treatment unit at the identified first target agricultural object;

determine a spraybox pose for a first spraybox, the first spraybox comprising a treatment module, a component treatment module and treatment subsystem, wherein the first spraybox includes one or more cameras integral to the spraybox, and the spraybox pose is based on obtained sensor data from at least the one or more cameras integral to the spraybox; and

instruct an emitter to emit a fluid from the treatment head at the first target agricultural object.

13. The system of claim 12 , wherein the vehicle pose is based on obtained sensor data from at least one of a camera, laser, radar sensor, sonar sensor, radio sensor, ultrasonic sensor, rangefinder, photoelectric sensor, global positioning systems (GPS), inertial measurement unit (IMU), gyroscopes, accelerometer, magnetometer, or a combination thereof.

14. The system of claim 12 , wherein the vehicle pose may be set to a vehicle local coordinate origin (x 0 , y 0 , z 0 ) and a local vehicle orientation (Φ 0 , θ 0 , Ψ 0 ), and the first treatment unit pose may be determined as a translated first treatment unit coordinate origin (x 1 , y 1 , z 1 ) relative to the vehicle local coordinate origin and as a translated first treatment unit starting orientation (Φ 1 , θ 1 , Ψ 1 ) relative to the local vehicle orientation.

15. The system of claim 12 , the one or more processors further configured to:

identify a second target agricultural object for treatment; and

determine a spraybox pose for a second spraybox, the second spraybox comprising a treatment module, a component treatment module and treatment subsystem; and

based on the determined vehicle pose, and the determined spraybox pose for a second spraybox, position a treatment head of the second treatment unit such that a second projectile fluid may be emitted by the second treatment unit at the identified second target agricultural object.

16. The system of claim 12 , the one or more processors further configured to:

determine a treatment head pose for the treatment head, the treatment head pose based on encoders tracking the orientation of the treatment head and spraybox pose.

17. The system of claim 12 , the one or more processors further configured to:

determine a treatment head pose, based on the vehicle pose, the spraybox pose, and an orientation of the treatment unit to spraybox.

18. The system of claim 12 , wherein determine the vehicle pose comprises:

obtaining sensor data from one or more sensors and analyzing the obtained sensor data to determine the vehicle pose, wherein the sensor data comprise images of a real-word environment in which the vehicle may travel.

19. The system of claim 12 , further wherein identify the first target agricultural object for treatment comprises:

obtain one or more images depicting a plurality of agricultural objects;

analyze the one or more image to identify one of the plurality of agricultural objects to treat; and

select the identified one of the plurality of agricultural objects as the first target agricultural object for treatment.

20. The system of claim 12 , the one or more processors further configured to:

identify one or more agricultural objects positioned about the vehicle; and

using the determined vehicle pose, while the vehicle is moving along the path, navigate the vehicle about the identified one or more agricultural objects so as to avoid vehicle impact with the identified one or more agricultural objects.

21. A computer-implemented method for treating agricultural objects, the method comprising:

determining a vehicle pose of a vehicle as the vehicle moves along a path;

identifying a first target agricultural object for treatment; and

based on the determined vehicle pose, positioning a treatment head of a first treatment unit such that a projectile fluid may be emitted by the first treatment unit at the identified first target agricultural object;

emitting a first fluid projectile from the treatment head at the first target agricultural object; and

emitting a second fluid projectile from the treatment head at the first target agricultural object, wherein the first fluid projectile is obtained from a first fluid source tank and the second fluid projectile is obtained from a second fluid source tank, wherein the first fluid projectile is a liquid polymer and the second fluid projectile is a liquid hardener, and the liquid polymer may harden when the liquid polymer and liquid hardener are mixed on the first target object.

22. A computer-implemented method for treating agricultural objects, the method comprising:

determining a vehicle pose of a vehicle as the vehicle moves along a path, wherein the vehicle pose may be set to a vehicle local coordinate origin (x 0 , y 0 , z 0 ) and a local vehicle orientation (Φ 0 , θ 0 , Ψ 0 ), and the first treatment unit pose may be determined as a translated first treatment unit coordinate origin (x 1 , y 1 , z 1 ) relative to the vehicle local coordinate origin and as a translated first treatment unit starting orientation (Φ 1 , θ 1 , Ψ 1 ) relative to the local vehicle orientation;

identifying a first target agricultural object for treatment; and

based on the determined vehicle pose, positioning a treatment head of a first treatment unit such that a projectile fluid may be emitted by the first treatment unit at the identified first target agricultural object; and

emitting a first fluid projectile from the treatment head at the first target agricultural object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2022
From: SIBLEY, GABRIEL THURSTON; IBARRIA, LORENZO; GARNER, CURTIS DALE; LEGER, PATRICK CHRISTOPHER; JIRATTIGALOCHOTE, WISIT
To: VERDANT ROBOTICS, INC.
Reel/Frame 060343/0254 →
Continuity (2)
Continuation In Part 17073244 · Oct 16, 2020
Related Publication 20220117215A1 · Apr 21, 2022
Cited By (1)
US 12,731,196