IP Library Granted Patent US 11,854,413
Granted Patent B2
US 11,854,413 · App. 17/512,323 · Granted Dec 26, 2023

Unmanned aerial vehicle visual line of sight control

Inventors: Volkan Gurel (San Francisco, CA); Bernard J. Michini (San Francisco, CA); Edward Dale Steakley (Cupertino, CA)
Assignee: Skydio, Inc
G08G5/006B64C39/024B64D47/08G05D1/0033G05D1/0061G05D1/0094G05D1/0274G06T5/002G06V20/64G08G5/0069H04B7/18506B64U2101/30B64U2201/10B64U2201/20G01S19/13G06T2207/10016G06T2207/10032G06T2207/20012G06T2207/30232G06T2207/30244G06V2201/10H04W4/021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,854,413
App. No.
17/512,323
Granted
Dec 26, 2023
Kind
B2
Abstract

Methods, systems and apparatus, including computer programs encoded on computer storage media for unmanned aerial vehicle visual line of sight flight operations. A UAV computer system may be configured to ensure the UAV is operating in visual line of sight of one or more ground operators. The UAV may confirm that it has a visual line of sight with the one or more user devices, such as a ground control station, or the UAV may ensure that the UAV does not fly behind or below a structure such that the ground operator would not be able to visually spot the UAV. The UAV computer system may be configured in such a way that UAV operation will maintain the UAV in visual line of sight of a base location.

Claims (34)

1. A method, comprising:

obtaining geospatial positional information of an unmanned aerial vehicle while the unmanned aerial vehicle navigates a flight path;

determining an impending loss of a visual line of sight between the unmanned aerial vehicle and a user device in communication with the unmanned aerial vehicle based on the geospatial positional information and a flight trajectory of the unmanned aerial vehicle; and

instructing the unmanned aerial vehicle to perform a flight maneuver to prevent the impending loss of the visual line of sight.

2. The method of claim 1 , wherein determining the impending loss of the visual line of sight comprises:

determining, based on a three-dimensional representation of a geographic feature or structure, that the geographic feature or structure will intersect a line between the user device and a location of the unmanned aerial vehicle according to the geospatial positional information and the flight trajectory.

3. The method of claim 1 , comprising:

responsive to determining the impending loss of the visual line of sight, outputting an alert indicating the impending loss of the visual line of sight at the user device.

4. The method of claim 1 , wherein the flight maneuver includes navigating in reverse along at least a portion of the flight path.

5. The method of claim 1 , wherein the flight maneuver includes navigating to a base location.

6. The method of claim 1 , wherein the flight maneuver includes ascending to a higher altitude.

7. The method of claim 1 , wherein the geospatial positional information indicates a speed and direction of movement of the unmanned aerial vehicle.

8. The method of claim 1 , wherein the determination of the impending loss of the visual line of sight is performed at the unmanned aerial vehicle.

9. The method of claim 1 , wherein the determination of the impending loss of the visual line of sight is performed at the user device.

10. An apparatus, comprising:

a memory; and

a processor configured to execute instructions stored in the memory to:

determine an impending loss of a visual line of sight between an unmanned aerial vehicle and a user device in communication with the unmanned aerial vehicle based on geospatial positional information of the unmanned aerial vehicle and a flight trajectory of the unmanned aerial vehicle; and

instruct the unmanned aerial vehicle to perform a flight maneuver to prevent the impending loss of the visual line of sight.

11. The apparatus of claim 10 , wherein, to determine the impending loss of the visual line of sight, the processor is configured to execute the instructions to:

determine, based on the geospatial positional information and the flight trajectory, that the unmanned aerial vehicle will enter a geofence corresponding to a geographic feature or structure that intersects a line between the user device and a location of the unmanned aerial vehicle.

12. The apparatus of claim 11 , wherein the processor is configured to execute the instructions to:

determine the geofence based on information collected by the unmanned aerial vehicle as the unmanned aerial vehicle navigates a flight path.

13. The apparatus of claim 11 , wherein the flight maneuver includes ascending to an altitude above the geographic feature or structure.

14. The apparatus of claim 10 , wherein, to determine the impending loss of the visual line of sight, the processor is configured to execute the instructions to:

compare a location of the user device and the geospatial position information against a three-dimensional representation of a geographic feature or structure that will intersect a line between the user device and the unmanned aerial vehicle.

15. The apparatus of claim 10 , wherein the geospatial positional information is periodically obtained by the user device as the unmanned aerial vehicle navigates a flight path, wherein the determination of the impending loss of the visual line of sight is performed at the user device.

16. A non-transitory computer storage medium including instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

determining an impending non-visual line of sight condition associated with an unmanned aerial vehicle and a user device in communication with the unmanned aerial vehicle based on geospatial positional information of the unmanned aerial vehicle and a flight trajectory of the unmanned aerial vehicle; and

instructing the unmanned aerial vehicle to perform a flight maneuver based on the impending non-visual line of sight condition.

17. The non-transitory computer storage medium of claim 16 , wherein the impending non-visual line of sight condition is determined at one of the unmanned aerial vehicle or the user device.

18. The non-transitory computer storage medium of claim 16 , wherein the impending non-visual line of sight condition corresponds to a prediction that a visual line of sight between the unmanned aerial vehicle and the user device will be lost.

19. The non-transitory computer storage medium of claim 16 , wherein the impending non-visual line of sight condition is determined using a three-dimensional representation of a geographic feature or structure that will intersect a line between the user device and the unmanned aerial vehicle.

20. The non-transitory computer storage medium of claim 16 , wherein the unmanned aerial vehicle navigates in an auto-piloted mode or a partially auto-piloted mode.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 17, 2022
From: AIRWARE, LLC
To: SKYDIO, INC.
Reel/Frame 059031/0617 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2022
From: GUREL, VOLKAN; MICHINI, BERNARD J.; STEAKLEY, EDWARD DALE
To: UNMANNED INNOVATION INC.
Reel/Frame 058595/0185 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2022
From: UNMANNED INNOVATION INC.
To: AIRWARE, LLC
Reel/Frame 058595/0511 →
Continuity (5)
Continuation 15449846 · Mar 3, 2017
Continuation 15094802 · Apr 8, 2016
Provisional Application 62298429 · Feb 22, 2016
Provisional Application 62292783 · Feb 8, 2016
Related Publication 20220148438A1 · May 12, 2022
Cited By (1)
US 12,682,767