IP Library Granted Patent US 11,756,136
Granted Patent B2
US 11,756,136 · App. 18/170,551 · Granted Sep 12, 2023

Upward facing light sensor for plant detection

Inventors: Matthew Stephen Colgan (San Francisco, CA); Charles McCauley Ross (Los Altos, CA)
Assignee: BLUE RIVER TECHNOLOGY INC.
G06Q50/02A01M7/0071G01N21/255G06T7/0004G06V10/60G06V20/38G06T2207/30188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,756,136
App. No.
18/170,551
Granted
Sep 12, 2023
Kind
B2
Abstract

A farming machine is configured to identify and treat plants in a field. The farming machine includes one or more light sensors for measuring a characteristic of light. The one or more light sensors are coupled to the farming machine and are directed a substantially upwards orientation away from the plants. A control system adjusts settings of an image acquisition system based on a characteristic of light measured by the one or more light sensors. The image acquisition system captures an image of a plant using one or more image sensors coupled to the farming machine, the one or more image sensors directed in a substantially downwards orientation towards the plants. The control system identifies a plant in the image and actuates a treatment mechanism to treat the identified plant.

Claims (69)

1. A farming machine comprising:

an image acquisition system configured to capture an image of a plant in a field as the farming machine moves through the field, the image acquisition system capturing the image using an image sensor directed in a downwards orientation towards the plant;

a light measurement system configured to measure light incident on the light measurement system;

a plurality of plant treatment mechanisms for treating the plant in the field as the farming machine moves past the plant in the field; and

a control system including a processor, the processor configured to:

capture the image of the plant in the field using the image acquisition system and based on light measured by the light measurement system by:

determining an actual reflectance of the plant,

determining a perceived reflectance of the plant, and

adjusting a configuration of the image acquisition system by modifying one or more exposure parameters of the image acquisition system based on a difference between the actual reflectance and the perceived reflectance of the plant,

identify the plant in the image based on pixels in the image identified as representing the plant and image properties of the captured image corresponding to the configuration of the image acquisition system, and

actuate one or more of the plurality of plant treatment mechanisms to treat the identified plant.

2. The farming machine of claim 1 , wherein the image acquisition system further comprises:

one or more additional image sensors, each of the additional image sensors directed in the downwards orientation.

3. The farming machine of claim 1 , wherein the light measurement system comprises one or more light sensors.

4. The farming machine of claim 1 , wherein:

a light sensor is coupled to a top surface of the farming machine, and

the image sensor is coupled to a bottom surface of the farming machine.

5. The farming machine of claim 1 , further comprising:

a mounting mechanism having a first length that is substantially orthogonal to a direction of movement of the farming machine, and wherein the plurality of treatment mechanisms are coupled to the mounting mechanism.

6. The farming machine of claim 5 , wherein:

the image acquisition system is mounted to the mounting mechanism, and

the light measurement system is mounted to the mounting mechanism.

7. The farming machine of claim 1 , wherein the light measurement system comprises:

an electronic subsystem coupled to a light sensor;

a base including a receptacle configured to retain the electronic subsystem and the light sensor, the receptacle recessed within at least one of a set of surfaces of the base; and

a cap coupled to the base wherein the cap encloses the electronic subsystem and the light sensor.

8. The farming machine of claim 7 , wherein the image sensor is one of:

coupled to a front surface of the farming machine and directed downwards,

coupled to a bottom surface of the farming machine and directed downwards,

coupled to the bottom surface of the farming machine and titled forward,

coupled to a top surface of the farming machine and direct downwards, and

coupled to a side of the farming machine and directed downwards.

9. A farming machine comprising:

a light measurement system configured to measure a characteristic of light;

an image acquisition system configured to capture an image of a plant in a field;

a plurality of plant treatment mechanisms for treating plants in the field; and

a control system for:

capturing an image of the plant in the field using the image acquisition system by:

determining an actual reflectance of the plant,

determining a perceived reflectance of the plant at least in part using the light measurement system, and

adjusting the configuration of the image acquisition system based on a difference between the actual reflectance and the perceived reflectance of the plant; and

identifying the plant in the image and actuating one or more of the plurality of plant treatment mechanisms to treat the identified plant based on pixels in the image identified as representing the plant.

10. The farming machine of claim 9 , wherein the image acquisition system comprises one or more image sensors, each of the image sensors facing in a downwards direction towards the plant as the farming machine moves through the field.

11. The farming machine of claim 9 , wherein the light measurement system comprises one or more light sensors.

12. A method comprising:

detecting an amount of light incident on a light sensor mounted on a farming machine passing through a field;

capturing an image of a plant in the field using an image sensor mounted on the farming machine, the image captured using one or more exposure parameters for the image sensor selected based, by:

determining an actual reflectance of the plant,

determining a perceived reflectance of the plant, and

adjusting the one or more exposure parameters based on a difference between the actual reflectance and the perceived reflectance of the plant;

identifying the plant in the image based on pixels in the image identified as representing the plant; and

applying, with a treatment mechanism mounted on the farming machine, a treatment to the identified plant.

13. The method of claim 12 , wherein the image sensor is orientated to face downward towards the plant in the field.

14. The method of claim 12 , wherein adjusting the one or more exposure parameters includes:

determining the difference exceeds a difference threshold; and

responsive to the difference exceeding the difference threshold, adjusting an exposure parameter of the one or more exposure parameters.

15. The method of claim 12 , wherein the one or more exposure parameters is one of: shutter speed, aperture, ISO speed, or white balance.

16. The method of claim 12 , further comprising:

evaluating a characteristic of the detected light;

determining whether the characteristic of the detected light exceeds a threshold corresponding to the characteristic; and

responsive to determining the characteristic exceeds the threshold corresponding to the characteristic, adjusting the one or more exposure parameters.

17. The method of claim 16 , wherein the characteristic is one of: light intensity or color temperature.

18. The method of claim 12 , further comprising:

determining a characteristic of light incident on a plurality of light sensors mounted on the farming machine; and

comparing the characteristic of light incident on each of the plurality of light sensors to determine a difference in the characteristic of light incident on each of the plurality of sensors.

19. The method of claim 18 , further comprising:

selecting a subset of the plurality of light sensors based on the characteristic of light incident on each of the plurality of light sensors and the difference in the characteristic of light incident on each of the plurality of sensors; and

evaluating the characteristic of light based on the subset of the plurality of light sensors.

20. The method of claim 19 , further comprising adjusting the one or more exposure parameters based on the characteristic of light evaluated by the subset of the plurality of light sensors.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2024
From: BLUE RIVER TECHNOLOGY INC.
To: DEERE & COMPANY
Reel/Frame 069164/0195 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2023
From: COLGAN, MATTHEW STEPHEN; ROSS, CHARLES MCCAULEY
To: BLUE RIVER TECHNOLOGY INC.
Reel/Frame 062850/0227 →
Continuity (2)
Continuation 16789406 · Feb 12, 2020
Related Publication 20230206353A1 · Jun 29, 2023