IP Library Granted Patent US 11,189,180
Granted Patent B2
US 11,189,180 · App. 15/449,846 · Granted Nov 30, 2021

Unmanned aerial vehicle visual line of sight control

Inventors: Volkan Gurel (San Francisco, CA); Bernard J. Michini (Walnut Creek, CA); Edward Dale Steakley (Cupertino, CA)
Assignee: Skydio, Inc.
G08G5/006B64C39/024B64D47/08G01C21/00G05D1/0033G05D1/0061G05D1/0094G05D1/0274G06K9/00201G06T5/002G08G5/0069H04B7/18506B64C2201/127B64C2201/141B64C2201/146G01S19/13G06K2209/27G06T2207/10016G06T2207/10032G06T2207/20012G06T2207/30232G06T2207/30244H04W4/021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,189,180
App. No.
15/449,846
Granted
Nov 30, 2021
Kind
B2
Abstract

Methods, systems and apparatus, including computer programs encoded on computer storage media for unmanned aerial vehicle visual line of sight flight operations. A UAV computer system may be configured to ensure the UAV is operating in visual line of sight of one or more ground operators. The UAV may confirm that it has a visual line of sight with the one or more user devices, such as a ground control station, or the UAV may ensure that the UAV does not fly behind or below a structure such that the ground operator would not be able to visually spot the UAV. The UAV computer system may be configured in such a way that UAV operation will maintain the UAV in visual line of sight of a base location.

Claims (49)

1. A method, comprising:

obtaining three-dimensional data representing a physical structure;

presenting, via a user interface, one or more recommended launching locations for an unmanned aerial vehicle (UAV) that each provide a launching location to obtain a best or maximum visual line of sight when operating, the UAV around the structure,

determining a base location of the UAV, wherein the base location represents a launching location of the one or more recommended launching locations; and

generating a flight path for automated flight of the UAV, wherein the flight path comprises one or more waypoints for the UAV to travel to about the structure, wherein a waypoint includes a geo-spatial position, and wherein the one or more waypoints are placed about the structure to prevent a visual line of sight interruption between a position of a waypoint and a position of the base location as compared to the three-dimensional data.

2. The method of claim 1 , further comprising:

determining a visual line of sight interruption between the one or more waypoints and the base location by establishing that at least one structure represented by the three-dimensional data intersects a line between the base location and the one or more waypoints.

3. The method of claim 2 , wherein determining whether the one or more waypoints of the flight path would cause a visual line of sight interruption comprises:

disallowing a waypoint to be included as part of the flight path where the visual line of sight from the base location and the waypoint would be blocked because of the at least one structure.

4. The method of claim 2 , wherein determining whether the one or more waypoints of the flight path would cause a visual line of sight interruption comprises:

determining that an altitude of the UAV along the flight path is below a height of the structure.

5. The method of claim 1 , further comprising:

adjusting the geo-spatial position of the one or more waypoints to a higher altitude to prevent a visual line of sight interruption between the adjusted one or more waypoints and the base location.

6. The method of claim 1 , wherein the launching location includes an area around the launching location.

7. The method of claim 1 , wherein obtaining three-dimensional data representing a physical structure further comprises:

instructing the UAV to perform a scan of the structure;

receiving sensor data obtained by the UAV during the scan of the structure, wherein the sensor data includes Lidar data or digital images; and

creating a point cloud of the structure based on the obtained sensor data, wherein the point cloud is the three-dimensional data.

8. The method of claim 1 , wherein the base location is offset by a pre-determined height or by an input of a height of an operator of the UAV, such that the base location is increased in altitude.

9. The method of claim 1 , further comprising:

instructing the UAV to perform the flight path.

10. An apparatus, comprising:

one or more computer processors; and

one or more non-transitory storage media storing instructions that, when executed by the one or more computer processors, cause the one or more computer processors to:

obtain three-dimensional data representing a physical structure;

present, via a user interface, one or more recommended launching locations for an unmanned aerial vehicle (UAV)) that each provide a launching location to obtain a best or maximum visual line of sight when operating the UAV around the structure;

determine a base location of the UAV, wherein the base location represents a launching location of the one or more recommended launching locations; and

generate a flight path for automated flight of the UAV, wherein the flight path comprises one or more waypoints for the UAV to travel to about the structure, wherein a waypoint includes a geo-spatial position, and wherein the one or more waypoints are placed about the structure prevent a visual line of sight interruption between a position of a waypoint and a position of the base location as compared to the three-dimensional data.

11. The apparatus of claim 10 , wherein the instructions, when executed by the one or more computer processors, further cause the one or more computer processors to:

determine a visual line of sight interruption between the one or more waypoints and the base location by establishing that at least one structure represented by the three-dimensional data intersects a line between the base location and the one or more waypoints.

12. The apparatus of claim 11 , wherein the instructions to determine whether the one or more waypoints of the flight path would cause a visual line of sight interruption further include instructions that, when executed by the one or more computer processors, cause the one or more computer processors to:

disallow a waypoint to be included as part of the flight path where the visual line of sight from the base location and the waypoint would be blocked because of the at least one structure.

13. The apparatus of claim 11 , wherein the instructions to determine whether the one or more waypoints of the flight path would cause a visual line of sight interruption include instructions that, when executed by the one or more computer processors, cause the one or more computer processors to:

determine that an altitude of the UAV along the flight path is below a height of the structure.

14. The apparatus of claim 10 , wherein the instructions, when executed by the one or more computer processors, further cause the one or more computer processors to:

adjust the geo-spatial position of the one or more waypoints to a higher altitude prevent a visual line of sight interruption between the adjusted one or more waypoints and the base location.

15. The apparatus of claim 10 , wherein the instructions to obtain three-dimensional data representing a physical structure include instructions that, when executed by the one or more computer processors, cause the one or more computer processors to:

the UAV to perform a scan of the structure;

receive sensor data obtained by the UAV during the scan of the structure, wherein the sensor data includes Lidar data or digital images; and

create a point cloud of the structure based on the obtained sensor data, wherein the point cloud is the three-dimensional data.

16. A non-transitory storage medium storing instructions that, when executed by one or more computer processors, facilitate a performance of operations, the operations comprising:

obtaining three-dimensional data representing a physical structure;

resenting via a user interface one or more recommended launching locations for an unmanned aerial vehicle (UAV) that each provide a launching location to obtain a best or maximum visual line of sight when operating the UAV around the structure;

determining a base location of the UAV, wherein the base location represents a launching location of the one or more recommended launching locations; and

generating a flight path for automated flight of the UAV, wherein the flight path comprises one or more waypoints for the UAV to travel to about the structure, wherein a waypoint includes a geo-spatial position, and wherein the one or more waypoints are placed about the structure to prevent a visual line of sight interruption between a position of a waypoint and a position of the base location as compared to the three-dimensional data.

17. The non-transitory storage medium of claim 16 , the operations further comprising:

determining a visual line of sight interruption between the one or more waypoints and the base location by establishing that at least one structure represented by the three-dimensional data intersects a line between the base location and the one or more waypoints.

18. The non-transitory storage medium of claim 17 , wherein the operations for determining whether the one or more waypoints of the flight path would cause a visual line of sight interruption further include operations comprising:

disallowing a waypoint to be included as part of the flight path where the visual line of sight from the base location and the waypoint would be blocked because of the at least one structure.

Assignments (8)
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: HERCULES CAPITAL, INC.
To: SKYDIO, INC.
Reel/Frame 072128/0698 →
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
To: SKYDIO, INC.
Reel/Frame 072107/0066 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Nov 9, 2021
From: SKYDIO, INC.
To: HERCULES CAPITAL, INC., AS COLLATERAL AND ADMINISTRATIVE AGENT
Reel/Frame 058081/0677 →
SECURITY INTEREST Recorded Nov 8, 2021
From: SKYDIO, INC.
To: SILICON VALLEY BANK
Reel/Frame 058053/0768 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CONVEYING PARTY DATA WAS ERRONEOUSLY ENTER AS UNMMANED INNOVATIONS, INC. IT SHOULD READ UNMANNED INNOVATIONS, INC PREVIOUSLY RECORDED AT REEL: 053144 FRAME: 0591. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 15, 2020
From: UNMANNED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 053210/0586 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: AIRWARE, LLC
To: SKYDIO, INC.
Reel/Frame 053144/0633 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: UNMMANED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 053144/0591 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2017
From: GUREL, VOLKAN; MICHINI, BERNARD J.; STEAKLEY, EDWARD DALE
To: UNMANNED INNOVATION INC.
Reel/Frame 041467/0535 →
Cited By (1)
US 12,293,672