IP Library Granted Patent US 12,073,475
Granted Patent B2
US 12,073,475 · App. 18/360,756 · Granted Aug 27, 2024

Upward facing light sensor for plant detection

Inventors: Matthew Stephen Colgan (San Francisco, CA); Charles McCauley Ross (Los Altos, CA)
Assignee: BLUE RIVER TECHNOLOGY INC.
G06Q50/02A01M7/0071G01N21/255G06T7/0004G06V10/60G06V20/38G06T2207/30188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,073,475
App. No.
18/360,756
Granted
Aug 27, 2024
Kind
B2
Abstract

A farming machine is configured to identify and treat plants in a field. The farming machine includes one or more light sensors for measuring a characteristic of light. The one or more light sensors are coupled to the farming machine and are directed a substantially upwards orientation away from the plants. A control system adjusts settings of an image acquisition system based on a characteristic of light measured by the one or more light sensors. The image acquisition system captures an image of a plant using one or more image sensors coupled to the farming machine, the one or more image sensors directed in a substantially downwards orientation towards the plants. The control system identifies a plant in the image and actuates a treatment mechanism to treat the identified plant.

Claims (60)

1. A plant identification system comprising:

an image acquisition system configured to capture an image of a plant in a field, the image acquisition system removably couplable from a farming machine and configured for capturing an image of the plant using an image sensor directed in a downwards orientation towards the plant;

a light measurement system removably couplable from the farming machine configured to measure light incident on the light measurement system, the light measurement system measuring the incident light using a light sensor directed in an upwards orientation away from the plant;

a control system including a processor, the processor configured to:

measure, using the light measurement system, a characteristic of light incident upon the light sensor,

capture the image of the plant in the field using the image acquisition system configured to operate based on the measured characteristic of incident light, wherein capturing the image of the plant comprises adjusting a configuration of the image acquisition system by modifying one or more exposure parameters of the image acquisition system based on a difference between an actual reflectance and a perceived reflectance of the plant,

identify the plant in the image based on (1) pixels in the image identified as representing the plant and (2) image properties of the captured image corresponding to the measured characteristic of light and configuration of the image acquisition system, and

generate a control signal that, when received by a plant treatment mechanism of the farming machine, actuates the plant treatment mechanism to treat the identified plant.

2. The plant identification system of claim 1 , wherein the image acquisition system further comprises:

one or more additional image sensors, each of the one or more additional image sensors directed in the downwards orientation.

3. The plant identification system of claim 1 , wherein the light measurement system comprises one or more light sensors.

4. The plant identification system of claim 1 , wherein:

the light sensor is coupled to a top surface of the farming machine, and

the image sensor is coupled to a bottom surface of the farming machine.

5. The plant identification system of claim 1 , wherein the plant treatment mechanism is mounted to the farming machine with a mounting mechanism, the mounting mechanism having a first length that is substantially orthogonal to a direction of movement of the farming machine, and wherein the plant treatment mechanism is coupled to the mounting mechanism.

6. The plant identification system of claim 5 , wherein:

the image acquisition system is mounted to the mounting mechanism, and

the light measurement system is mounted to the mounting mechanism.

7. The plant identification system of claim 1 , wherein the light measurement system comprises:

an electronic subsystem coupled to the light sensor;

a base including a receptacle configured to retain the electronic subsystem and the light sensor, the receptacle recessed within at least one of a set of surfaces of the base; and

a cap coupled to the base wherein the cap encloses the electronic subsystem and the light sensor.

8. The plant identification system of claim 7 , wherein the image sensor is one of:

coupled to a front surface of the farming machine and directed downwards,

coupled to a bottom surface of the farming machine and directed downwards,

coupled to the bottom surface of the farming machine and titled forward,

coupled to a top surface of the farming machine and direct downwards, and

coupled to a side of the farming machine and directed downwards.

9. A farming machine comprising:

a removably couplable light measurement system coupled to the farming machine, the light measurement system configured to measure a characteristic of light;

a removably couplable image acquisition system coupled to the farming machine, the image acquisition system configured to capture an image of a plant in a field;

a plurality of plant treatment mechanisms for treating plants in the field; and

a control system for:

capturing an image of the plant in the field using the image acquisition system, wherein capturing the image comprises adjusting a configuration of the image acquisition system by modifying one or more exposure parameters of the image acquisition system based on a difference between an actual reflectance and a perceived reflectance of the plant;

identifying the plant in the image and actuating one or more of the plurality of plant treatment mechanisms to treat the identified plant based on pixels in the image identified as representing the plant.

10. The farming machine of claim 9 , wherein the image acquisition system comprises one or more image sensors, each of the image sensors facing in a downwards direction towards the plant as the farming machine moves through the field.

11. The farming machine of claim 9 , wherein the light measurement system comprises one or more light sensors.

12. A method comprising:

detecting an amount of light incident on a light sensor mounted on a farming machine passing through a field;

capturing an image of a plant in the field using an image acquisition system mounted on the farming machine, the image captured using one or more exposure parameters for the image sensor selected based, by:

adjusting the one or more exposure parameters of the image acquisition system based on a difference between an actual reflectance and a perceived reflectance of the plant;

identifying the plant in the image based on pixels in the image identified as representing the plant; and

applying, with a treatment mechanism mounted on the farming machine, a treatment to the identified plant.

13. The method of claim 12 , wherein the image sensor is orientated to face downward towards the plant in the field.

14. The method of claim 12 , wherein adjusting the one or more exposure parameters includes:

determining the difference exceeds a difference threshold; and

responsive to the difference exceeding the difference threshold, adjusting an exposure parameter of the one or more exposure parameters.

15. The method of claim 12 , wherein the one or more exposure parameters is one of: shutter speed, aperture, ISO speed, or white balance.

16. The method of claim 12 , further comprising:

evaluating a characteristic of the detected light;

determining whether the characteristic of the detected light exceeds a threshold corresponding to the characteristic; and

responsive to determining the characteristic exceeds the threshold corresponding to the characteristic, adjusting the one or more exposure parameters.

17. The method of claim 16 , wherein the characteristic is one of: light intensity or color temperature.

18. The method of claim 12 , further comprising:

determining a characteristic of light incident on a plurality of light sensors mounted on the farming machine; and

comparing the characteristic of light incident on each of the plurality of light sensors to determine a difference in the characteristic of light incident on each of the plurality of sensors.

19. The method of claim 18 , further comprising:

selecting a subset of the plurality of light sensors based on the characteristic of light incident on each of the plurality of light sensors and the difference in the characteristic of light incident on each of the plurality of sensors; and

evaluating the characteristic of light based on the subset of the plurality of light sensors.

20. The method of claim 19 , further comprising adjusting the one or more exposure parameters based on the characteristic of light evaluated by the subset of the plurality of light sensors.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2024
From: BLUE RIVER TECHNOLOGY INC.
To: DEERE & COMPANY
Reel/Frame 069164/0195 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2023
From: COLGAN, MATTHEW STEPHEN; ROSS, CHARLES MCCAULEY
To: BLUE RIVER TECHNOLOGY INC.
Reel/Frame 064465/0687 →
Continuity (3)
Continuation 18170551 · Feb 17, 2023
Continuation 16789406 · Feb 12, 2020
Related Publication 20240037676A1 · Feb 1, 2024