IP Library Granted Patent US 12,041,867
Granted Patent B2
US 12,041,867 · App. 17/544,941 · Granted Jul 23, 2024

System and method for automated odometry calibration for precision agriculture systems

Inventors: Lee Kamp Redden (Palo Alto, CA); Kent Anderson (Mountain View, CA); Edward William Jeffcott Pell (Sunnyvale, CA); James Patrick Ostrowski (Mountain View, CA)
Assignee: BLUE RIVER TECHNOLOGY INC.
A01B79/005A01B41/06A01C21/00A01C21/005A01M21/00A01M21/02A01M21/04G01C7/04G01C11/00G01C11/06G01C15/04Y02A40/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,041,867
App. No.
17/544,941
Granted
Jul 23, 2024
Kind
B2
Abstract

A method including: recording a first image of a first field region; automatically treating a plant within the first region in-situ based on the first image; automatically verifying the plant treatment with a second image of the first region; and automatically treating a second region concurrently with treatment verification.

Claims (78)

1. A method for calibrating a treatment mechanism physically mounted to a farming machine using a sensor physically mounted to the farming machine as the farming machine operates within a field, the method comprising:

capturing, by the sensor, a first image of a first plant in the field, the first image comprising features indicative of a first treatment applied to the first plant by the treatment mechanism;

determining, with a computer and based on the first image, a first timing delay between when the treatment mechanism was actuated to dispense the first treatment and when the first treatment was applied to the first plant by the treatment mechanism;

capturing, by the sensor, a second image of a second plant in the field, the second image comprising features indicative of a second treatment applied to the second plant by the treatment mechanism;

determining, by the computer and based on the second image, a second timing delay between when the treatment mechanism was actuated to dispense the second treatment and when the second treatment was applied to the second plant by the treatment mechanism; and

responsive to determining a deviation between the first timing delay and the second timing delay, calibrating the treatment mechanism based on the deviation.

2. The method of claim 1 , wherein the treatment mechanism is a spray implement and the first timing delay and the second timing delay represent delays in actuation of the spray implement and when the spray is applied to the first plant and the second plant.

3. The method of claim 1 , further comprising:

responsive to determining that the second timing delay deviates from the first timing delay by more than a threshold deviation, identifying a failure of the treatment mechanism;

communicating a notification of the identified failure to a remote monitoring system; and

halting operation of the treatment mechanism.

4. The method of claim 1 , further comprising:

determining, based on the first image, a first treatment calibration factor representing a first distance between the treatment mechanism and the sensor;

determining, based on the second image, a second treatment calibration factor representing a second distance between the treatment mechanism and the sensor; and

responsive to determining an additional deviation between the first treatment calibration factor and the second treatment calibration factor, calibrating the treatment mechanism based on the second treatment calibration factor.

5. The method of claim 1 , wherein the first and second image include image data representing a target treatment location and an actual treatment location of the first treatment, the method further comprising:

determining, based on the first image, a first treatment calibration factor correcting for a first distance between the target treatment location and the actual treatment location as measured in the first image;

determining, based on the second image, a second treatment calibration factor correcting for a second distance between the target treatment location and an actual treatment location as measured in the second image; and

responsive to determining an additional deviation between the first treatment calibration factor and the second treatment calibration factor, calibrating the treatment mechanism based on the second treatment calibration factor.

6. The method of claim 1 , further comprising:

determining a first set of treatment calibration factors based on the first image and a second set of treatment calibration factors based on the second image;

comparing the first set and the second set of treatment calibration factors to identify outliers representing calibration errors, each identified outlier representing deviations between the first set and the second set of treatment calibration factors; and

calibrating the treatment mechanism based on the calibration errors represented by the identified outliers.

7. The method of claim 6 , further comprising:

characterizing deviations between the first timing delay and the second timing delay based on the comparison of the first set of treatment factors and the second set of treatment factors; and

wherein deviations exceeding a threshold deviation represent an error in actuation of the treatment mechanism.

8. A non-transitory computer readable storage medium storing instructions for calibrating a treatment mechanism physically mounted to a farming machine that, when executed by a processor, cause the processor to:

capture, by a sensor, a first image of a first plant in a field, the first image comprising features indicative of a first treatment applied to the first plant by the treatment mechanism;

determine, with a computer and based on the first image, a first timing delay between when the treatment mechanism was actuated to dispense the first treatment and when the first treatment was applied to the first plant by the treatment mechanism;

capture, by the sensor, a second image of a second plant in the field, the second image comprising features indicative of a second treatment applied to the second plant by the treatment mechanism;

determine, by the computer and based on the second image, a second timing delay between when the treatment mechanism was actuated to dispense the second treatment and when the second treatment was applied to the second plant by the treatment mechanism; and

responsive to determining a deviation between the first timing delay and the second timing delay, calibrate the treatment mechanism based on the deviation.

9. The non-transitory computer readable storage medium of claim 8 , further comprising instructions that cause the processor to:

responsive to determining that the second timing delay deviates from the first timing delay by more than a threshold deviation, identify a failure of the treatment mechanism;

communicate a notification of the identified failure to a remote monitoring system; and

halt operation of the treatment mechanism.

10. The non-transitory computer readable storage medium of claim 8 , further comprising instructions that cause the processor to:

determine, based on the first image, a first treatment calibration factor representing a first distance between the treatment mechanism and the sensor;

determine, based on the second image, a second treatment calibration factor representing a second distance between the treatment mechanism and the sensor; and

responsive to determining an additional deviation between the first treatment calibration factor and the second treatment calibration factor, calibrate the treatment mechanism based on the second treatment calibration factor.

11. The non-transitory computer readable storage medium of claim 8 , wherein the first and second image include image data representing a target treatment location and an actual treatment location of the first treatment, and further comprising instructions that cause the processor to:

determine, based on the first image, a first treatment calibration factor correcting for a first distance between the target treatment location and the actual treatment location as measured in the first image;

determine, based on the second image, a second treatment calibration factor correcting for a second distance between the target treatment location and an actual treatment location as measured in the second image; and

responsive to determining an additional deviation between the first treatment calibration factor and the second treatment calibration factor, calibrate the treatment mechanism based on the second treatment calibration factor.

12. The non-transitory computer readable storage medium of claim 8 , further comprising instructions that cause the processor to:

determine a first set of treatment calibration factors based on the first image and a second set of treatment calibration factors based on the second image;

compare the first set and the second set of treatment calibration factors to identify outliers representing calibration errors, each identified outlier representing deviations between the first set and the second set of treatment calibration factors; and

calibrate the treatment mechanism based on the calibration errors represented by the identified outliers.

13. The non-transitory computer readable storage medium of claim 12 , further comprising:

characterize deviations between the first timing delay and the second timing delay based on the comparison of the first set of treatment factors and the second set of treatment factors; and

wherein deviations exceeding a threshold deviation represent an error in actuation of the treatment mechanism.

14. A farming machine comprising:

a sensor mounted to the farming machine;

a treatment mechanism mounted to the farming machine;

a processor; and

a non-transitory computer readable storage medium storing instructions for calibrating a treatment mechanism physically mounted to a farming machine that, when executed by a processor, cause the processor to:

capture, by a sensor, a first image of a first plant in a field, the first image comprising features indicative of a first treatment applied to the first plant by the treatment mechanism;

determine, with a computer and based on the first image, a first timing delay between when the treatment mechanism was actuated to dispense the first treatment and when the first treatment was applied to the first plant by the treatment mechanism;

capture, by the sensor, a second image of a second plant in the field, the second image comprising features indicative of a second treatment applied to the second plant by the treatment mechanism;

determine, by the computer and based on the second image, a second timing delay between when the treatment mechanism was actuated to dispense the second treatment and when the second treatment was applied to the second plant by the treatment mechanism; and

responsive to determining a deviation between the first timing delay and the second timing delay, calibrate the treatment mechanism based on the deviation.

15. The farming machine of claim 14 , further comprising instructions that cause the processor to:

responsive to determining that the second timing delay deviates from the first timing delay by more than a threshold deviation, identify a failure of the treatment mechanism;

communicate a notification of the identified failure to a remote monitoring system; and

halt operation of the treatment mechanism.

16. The farming machine of claim 14 , further comprising instructions that cause the processor to:

determine, based on the first image, a first treatment calibration factor representing a first distance between the treatment mechanism and the sensor;

determine, based on the second image, a second treatment calibration factor representing a second distance between the treatment mechanism and the sensor; and

responsive to determining an additional deviation between the first treatment calibration factor and the second treatment calibration factor, calibrate the treatment mechanism based on the second treatment calibration factor.

17. The farming machine of claim 14 , wherein the first and second image include image data representing a target treatment location and an actual treatment location of the first treatment, further comprising instructions that cause the processor to:

determine, based on the first image, a first treatment calibration factor correcting for a first distance between the target treatment location and the actual treatment location as measured in the first image;

determine, based on the second image, a second treatment calibration factor correcting for a second distance between the target treatment location and an actual treatment location as measured in the second image; and

responsive to determining an additional deviation between the first treatment calibration factor and the second treatment calibration factor, calibrate the treatment mechanism based on the second treatment calibration factor.

18. The farming machine of claim 14 , further comprising instructions that cause the processor to:

determine a first set of treatment calibration factors based on the first image and a second set of treatment calibration factors based on the second image;

compare the first set and the second set of treatment calibration factors to identify outliers representing calibration errors, each identified outlier representing deviations between the first set and the second set of treatment calibration factors; and

calibrate the treatment mechanism based on the calibration errors represented by the identified outliers.

19. The farming machine of claim 14 , wherein the treatment mechanism is a spray implement and the first timing delay and the second timing delay represent delays in actuation of the spray implement and when the spray is applied to the first plant and the second plant.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2024
From: BLUE RIVER TECHNOLOGY INC.
To: DEERE & COMPANY
Reel/Frame 069164/0195 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2021
From: REDDEN, LEE KAMP; ANDERSON, KENT; PELL, EDWARD WILLIAM JEFFCOTT; OSTROWSKI, JAMES PATRICK
To: BLUE RIVER TECHNOLOGY INC.
Reel/Frame 058366/0078 →
Continuity (5)
Continuation 16153824 · Oct 8, 2018
Continuation 15632583 · Jun 26, 2017
Continuation 14629361 · Feb 23, 2015
Provisional Application 61943158 · Feb 21, 2014
Related Publication 20220087094A1 · Mar 24, 2022
Cited By (1)
US 12,414,492