IP Library Granted Patent US 9,720,413
Granted Patent B1
US 9,720,413 · App. 14/977,522 · Granted Aug 1, 2017

Systems and methods for providing flight control for an unmanned aerial vehicle based on opposing fields of view with overlap

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,720,413
App. No.
14/977,522
Granted
Aug 1, 2017
Kind
B1
Abstract

This disclosure relates to providing flight control for an unmanned aerial vehicle based on opposing fields of view with overlap. The UAV may include a housing, a motor, a first image sensor, a second image sensor, a first optical element having a first field of view greater than 180 degrees, a second optical element having a second field of view greater than 180 degrees, and one or more processors. The first optical element and the second optical element may be carried by the housing such that a centerline of the second field of view is substantially opposite from a centerline of the first field of view, and a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap. Flight control for the UAV may be provided based on parallax disparity of an object within the overlapping fields of view.

Claims (44)

1. An unmanned aerial vehicle comprising:

a housing;

a motor carried by the housing, the motor configured to drive a rotor;

a first image sensor carried within the housing and configured to generate a first output signal conveying first visual information based on light that becomes incident thereon;

a second image sensor carried within the housing and configured to generate a second output signal conveying second visual information based on light that becomes incident thereon;

a first optical element configured to guide light within a first field of view to the first image sensor, the first field of view being greater than 180 degrees, the first optical element being carried by the housing and being vertically oriented such that the first field of view is directed upwards when the unmanned aerial vehicle operates leveled with respect to ground;

a second optical element configured to guide light within a second field of view to the second image sensor, the second field of view being greater than 180 degrees, the second optical element being carried by the housing such that a centerline of the second field of view is substantially opposite from a centerline of the first field of view and a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap, and being vertically oriented such that the second field of view is directed downwards when the unmanned aerial vehicle operates leveled with respect to ground, wherein the peripheral portion of the first field of view and the peripheral portion of the second field of view that overlap circumscribe the unmanned aerial vehicle and include 360 degrees of lateral directions around the unmanned aerial vehicle; and

one or more processors carried by the housing, wherein the one or more processors are configured by machine readable instructions to:

receive the first output signal and the second output signal;

determine a disparity of an object within the peripheral portion of the first field of view and the peripheral portion of the second field of view that overlap; and

provide flight control for the unmanned aerial vehicle based on the disparity.

2. The unmanned aerial vehicle of claim 1 , wherein providing flight control for the unmanned aerial vehicle based on the disparity includes operating the unmanned aerial vehicle to maintain a minimum distance between the object and/or a maximum distance from the object.

3. The unmanned aerial vehicle of claim 1 , wherein providing flight control for the unmanned aerial vehicle based on the disparity includes operating the unmanned aerial vehicle to maintain a set distance from the object.

4. The unmanned aerial vehicle of claim 1 , wherein providing flight control for the unmanned aerial vehicle based on the disparity includes operating the unmanned aerial vehicle to maintain a minimum speed and/or a maximum speed.

5. The unmanned aerial vehicle of claim 1 , wherein providing flight control for the unmanned aerial vehicle based on the disparity includes operating the unmanned aerial vehicle to maintain a set speed.

6. The unmanned aerial vehicle of claim 1 , wherein the first optical element is carried by the housing such that the centerline of the first field of view is substantially parallel to the vertical axis of the unmanned aerial vehicle.

7. The unmanned aerial vehicle of claim 1 , wherein the peripheral portion of the first field of view and the peripheral portion of the second field of view that overlap circumscribe the unmanned aerial vehicle around the vertical axis of the unmanned aerial vehicle.

8. The unmanned aerial vehicle of claim 1 , wherein the first optical element includes one or more of a standard lens, a wide-angle lens, an ultra-wide-angle lens, and/or a fisheye lens.

9. The unmanned aerial vehicle of claim 1 , wherein the second optical element includes one or more of a standard lens, a wide-angle lens, an ultra-wide-angle lens, and/or a fisheye lens.

10. A method for providing flight control for an unmanned aerial vehicle, the method comprising:

generating a first output signal conveying first visual information within a first field of view of a first optical element, the first field of view being greater than 180 degrees, wherein the first optical element is carried by an unmanned aerial vehicle and is vertical oriented such that the first field of view is directed upwards when the unmanned aerial vehicle operates leveled with respect to ground;

generating a second output signal conveying second visual information within a second field of view of a second optical element, the second field of view being greater than 180 degrees, wherein the second optical element is carried by the unmanned aerial vehicle such that a centerline of the second field of view is substantially opposite from a centerline of the first field of view and a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap, and is vertically oriented such that the second field of view is directed downwards when the unmanned aerial vehicle operates leveled with respect to ground, wherein the peripheral portion of the first field of view and the peripheral portion of the second field of view that overlap circumscribe the unmanned aerial vehicle and include 360 degrees of lateral directions around the unmanned aerial vehicle;

determining a disparity of an object within the peripheral portion of the first field of view and the peripheral portion of the second field of view that overlap; and

providing flight control for the unmanned aerial vehicle based on the disparity.

11. The method of claim 10 , wherein providing flight control for the unmanned aerial vehicle based on the disparity includes operating the unmanned aerial vehicle to maintain a minimum distance between the object and/or a maximum distance from the object.

12. The method of claim 10 , wherein providing flight control for the unmanned aerial vehicle based on the disparity includes operating the unmanned aerial vehicle to maintain a set distance from the object.

13. The method of claim 10 , wherein providing flight control for the unmanned aerial vehicle based on the disparity includes operating the unmanned aerial vehicle to maintain a minimum speed and/or a maximum speed.

14. The method of claim 10 , wherein providing flight control for the unmanned aerial vehicle based on the disparity includes operating the unmanned aerial vehicle to maintain a set speed.

15. The method of claim 10 , wherein the first optical element is carried by the housing such that the centerline of the first field of view is substantially parallel to the vertical axis of the unmanned aerial vehicle.

16. The method of claim 10 , wherein the peripheral portion of the first field of view and the peripheral portion of the second field of view that overlap circumscribe the unmanned aerial vehicle around the vertical axis of the unmanned aerial vehicle.

17. The method of claim 10 , wherein the first optical element includes one or more of a standard lens, a wide-angle lens, an ultra-wide-angle lens, and/or a fisheye lens.

18. The method of claim 10 , wherein the second optical element includes one or more of a standard lens, a wide-angle lens, an ultra-wide-angle lens, and/or a fisheye lens.

19. An unmanned aerial vehicle comprising:

a housing;

a motor carried by the housing, the motor configured to drive a rotor;

a first image sensor carried within the housing and configured to generate a first output signal conveying first visual information based on light that becomes incident thereon;

a second image sensor carried within the housing and configured to generate a second output signal conveying second visual information based on light that becomes incident thereon;

a first optical element configured to guide light within a first field of view to the first image sensor, the first field of view being greater than 180 degrees, the first optical element being carried by the housing such that a centerline of the first field of view is substantially parallel to the vertical axis of the unmanned aerial vehicle and being vertically oriented such that the first field of view is directed upwards when the unmanned aerial vehicle operates leveled with respect to ground;

a second optical element configured to guide light within a second field of view to the second image sensor, the second field of view being greater than 180 degrees, the second optical element being carried by the housing such that a centerline of the second field of view is substantially opposite from a centerline of the first field of view and a peripheral portion of the first field of view and a peripheral portion of the second field of view overlap, and being vertically oriented such that the second field of view is directed downwards when the unmanned aerial vehicle operates leveled with respect to ground, wherein the peripheral portion of the first field of view and the peripheral portion of the second field of view that overlap circumscribe the unmanned aerial vehicle around the vertical axis of the unmanned aerial vehicle and include 360 degrees of lateral directions around the unmanned aerial vehicle; and

one or more processors carried by the housing, wherein the one or more processors are configured by machine readable instructions to:

receive the first output signal and the second output signal;

determine a disparity of an object within the peripheral portion of the first field of view and the peripheral portion of the second field of view that overlap; and

provide flight control for the unmanned aerial vehicle based on the disparity.

20. The unmanned aerial vehicle of claim 19 , wherein providing flight control for the unmanned aerial vehicle based on the disparity includes operating the unmanned aerial vehicle to maintain a minimum distance between the object and/or a maximum distance from the object.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Feb 22, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 041777/0440 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2016
From: IP, SHU CHING
To: GOPRO, INC.
Reel/Frame 039915/0094 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2016
From: LEMA, PABLO; FONG, GARY; IP, MAGNUS
To: GOPRO, INC.
Reel/Frame 038578/0803 →