IP Library Granted Patent US 11,157,736
Granted Patent B2
US 11,157,736 · App. 16/259,870 · Granted Oct 26, 2021

Multispectral filters

Inventor: Phillip T Tokumaru (Thousand Oaks, CA)
Assignee: AEROVIRONMENT, INC.
G06K9/00657B64C39/024G06K9/2018G06T3/4015G06T7/00G06T7/90B64C2201/088B64C2201/123B64C2201/127G06T2207/10024G06T2207/10036G06T2207/30188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,157,736
App. No.
16/259,870
Granted
Oct 26, 2021
Kind
B2
Abstract

A method and system including: an aerial vehicle including: a first camera comprising a first sensor having at least red, green, and blue color channels, where the blue color channel is sensitive to near-infrared (NIR) wavelengths; a first optical filter disposed in front of the first sensor, wherein the first optical filter is configured to block wavelengths below green, between red and NIR, and longer wavelength NIR; a processor having addressable memory in communication with the first camera, where the processor is configured to: capture at least one image of vegetation from the first camera; provide red, green, and NIR color channels from the captured image from the first camera; and determine at least one vegetative index based on the provided red, green, and NIR color channels.

Claims (43)

1. A system comprising:

an aerial vehicle comprising:

a first camera comprising a first sensor having at least red, green, and blue color channels, wherein the blue color channel is sensitive to near-infrared (NIR) wavelengths;

a first optical filter disposed in front of the first sensor, wherein the first optical filter is configured to block wavelengths below green, between red and NIR, and longer wavelength NIR;

a second camera comprising a second sensor having at least red, green, and blue color channels;

an incident light sensor disposed distal from the first camera and the second camera, wherein the incident light sensor is configured to capture incident light data; and

a processor having addressable memory in communication with the first camera, the second camera, and the incident light sensor, wherein the processor is configured to:

capture at least one image of vegetation from the first camera;

capture at least one image of vegetation from the second camera;

provide red, green, and NIR color channels from the captured image from the first camera;

determine at least one vegetative index based on the provided red, green, and NIR color channels; and

calibrate the captured image of vegetation from the first camera and the captured image of vegetation from the second camera based on the determined at least one vegetative index and the captured incident light data.

2. The system of claim 1 wherein at least one determined vegetative index comprises a normalized difference vegetation index (NDVI).

3. The system of claim 1 wherein at least one determined vegetative index comprises a green normalized difference vegetation index (GNDVI).

4. The system of claim 1 wherein the aerial vehicle is a vertical take-off and landing (VTOL) aerial vehicle.

5. The system of claim 4 wherein the aerial vehicle is a VTOL unmanned aerial vehicle (UAV).

6. The system of claim 1 wherein the first optical filter is configured to block wavelengths under about 540 nm.

7. The system of claim 1 wherein the first optical filter is configured to block wavelengths between about 680 nm and 780 nm.

8. The system of claim 1 where the first optical filter is configured to block wavelengths above around 900 nm.

9. The system of claim 1 wherein the first optical filter is configured to allow wavelengths between about 540 nm and 680 nm and between about 780 nm and 850 nm.

10. The system of claim 1 wherein the captured at least one image is a high-resolution image.

11. The system of claim 1 wherein the first sensor comprises a Bayer filter on the first sensor.

12. The system of claim 1 wherein the captured at least one image comprises wavelengths in green, red, and NIR.

13. The system of claim 1 wherein the aerial vehicle further comprises:

a second optical filter disposed in front of the second sensor, wherein the second optical filter is configured to block wavelengths in NIR.

14. The system of claim 13 , wherein the processor is further configured to:

capture at least one image of vegetation from the second camera, wherein a field of view of the first camera is substantially the same as a field of view of the second camera, wherein the first camera is disposed proximate the second camera, and wherein the captured image from the first camera is captured at substantially the same time as the captured image from the second camera;

provide a blue color channel from the captured image from the second camera; and

determine at least one vegetative index based on the provided red, green, blue, and NIR color channels.

15. A system comprising:

a first camera comprising a first sensor having at least red, green, and blue color channels, wherein the blue color channel is sensitive to near-infrared (NIR) wavelengths;

a first optical filter disposed in front of the first sensor, wherein the first optical filter is configured to block wavelengths below green, between red and NIR, and longer wavelength NIR;

a second camera comprising a second sensor having at least red, green, and blue color channels, wherein the first camera is disposed proximate the second camera, and wherein a field of view of the first camera is substantially the same as a field of view of the second camera; and

a second optical filter disposed in front of the second sensor, wherein the second optical filter is configured to block wavelengths in NIR;

an incident light sensor, wherein the incident light sensor is disposed distal from the first camera and the second camera;

a processor having addressable memory in communication with the first camera the second camera, and the incident light sensor, wherein the processor is configured to:

capture at least one image of vegetation from the first camera;

provide red, green, and NIR color channels from the captured image from the first camera;

capture at least one image of vegetation from the second camera, wherein the captured image from the first camera is captured at substantially the same time as the captured image from the second camera;

provide a blue color channel from the captured image from the second camera;

capture an incident light data from the incident light sensor;

calibrate at least one of: the captured image from the first camera and the captured image from the second camera based on the captured incident light data; and

determine at least one vegetative index based on the provided red, green, blue, and NIR color channels.

Assignments (2)
NOTICE OF GRANT OF SECURITY INTEREST IN PATENTS Recorded Feb 19, 2021
From: AEROVIRONMENT, INC.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 055343/0926 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2019
From: TOKUMARU, PHILLIP T
To: AEROVIRONMENT, INC.
Reel/Frame 048160/0684 →
Continuity (2)
Provisional Application 62623502 · Jan 29, 2018
Related Publication 20190236358A1 · Aug 1, 2019