IP Library Granted Patent US 12,400,552
Granted Patent B2
US 12,400,552 · App. 18/394,152 · Granted Aug 26, 2025

Unmanned aerial vehicle visual line of sight control

Inventors: Volkan Gurel (San Francisco, CA); Bernard J. Michini (Plymouth Meeting, PA); Edward Dale Steakley (Cupertino, CA)
Assignee: Skydio, Inc.
G08G5/55B64C39/024B64D47/08G05D1/0033G05D1/0061G05D1/0094G05D1/0274G06T5/70G06V20/64G08G5/57G08G5/59H04B7/18506B64U10/13B64U20/87B64U2101/30B64U2101/32B64U2201/10B64U2201/20G01S19/13G06T2207/10016G06T2207/10032G06T2207/20012G06T2207/30232G06T2207/30244G06V2201/10H04W4/021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,400,552
App. No.
18/394,152
Granted
Aug 26, 2025
Kind
B2
Abstract

Methods, systems and apparatus, including computer programs encoded on computer storage media for unmanned aerial vehicle visual line of sight flight operations. A UAV computer system may be configured to ensure the UAV is operating in visual line of sight of one or more ground operators. The UAV may confirm that it has a visual line of sight with the one or more user devices, such as a ground control station, or the UAV may ensure that the UAV does not fly behind or below a structure such that the ground operator would not be able to visually spot the UAV. The UAV computer system may be configured in such a way that UAV operation will maintain the UAV in visual line of sight of a base location.

Claims (55)

1. A computerized method, comprising:

obtaining three-dimensional data including a physical structure;

determining a base location; and

generating a flight path for automated flight of the UAV, the flight path comprising one or more waypoints for the UAV to navigate about the physical structure, each waypoint including a geo-spatial position,

wherein the one or more waypoints are positioned about the physical structure so that a visual line of sight interruption does not occur between a position of a waypoint and a position of the base location; and

instructing the UAV to navigate in accordance with the flight path.

2. The method of claim 1 , further comprising:

determining a visual line of sight interruption between the one or more waypoints and the base location by establishing that at least one physical structure represented by the three-dimensional data intersects a line between the base location and the one or more waypoints.

3. The method of claim 2 , wherein determining whether the one or more waypoints of the flight path would cause a visual line of sight interruption further comprises:

disallowing a waypoint to be included as part of the flight path where the visual line of sight from the base location and the waypoint would be blocked because of the at least one structure.

4. The method of claim 2 , wherein determining whether the one or more waypoints of the flight path would cause a visual line of sight interruption, further comprises:

determining that an altitude of the UAV along the flight path is below a height of the structure.

5. The method of claim 1 , further comprising:

adjusting the geo-spatial position of the one or more waypoints to a higher altitude such that a visual line of sight interruption does not occur between the adjusted one or more waypoint and the base location.

6. The method of claim 1 , wherein the base location comprises a launching location of the UAV or an area around the launching location.

7. The method of claim 1 , wherein obtaining three-dimensional data representing a physical structure further comprises:

instructing the UAV to perform a scan of the structure; and

receiving sensor data obtained by the UAV during the scan of the structure, wherein the sensor data includes Lidar data or digital images; and

creating a point cloud of the structure based on the obtained sensor data, wherein the point cloud is the three-dimensional data.

8. The method of claim 1 , further comprising:

presenting, via a user interface, one or more recommended base locations for the UAV that provide a maximum visual line of sight when operating the UAV around the physical structure.

9. The method of claim 1 , wherein the base location is offset by a pre-determined height, or an input of a height of an operator of the UAV, such that the base location is increased in altitude.

10. The method of claim 1 , further comprising:

instructing the UAV to perform the flight path.

11. An apparatus comprising:

one or more memory units storing instructions that, when executed by one or more processors of an unmanned aerial vehicle (UAV), cause the one or more processors to:

obtain three-dimensional data including a physical structure;

determine a base location; and

generate a flight path for automated flight of the UAV, the flight path comprising one or more waypoints for the UAV to navigate about the physical structure, each waypoint including a geo-spatial position, wherein the one or more waypoints are positioned about the physical structure so that a visual line of sight interruption does not occur between a position of a waypoint and a position of the base location.

12. The apparatus of claim 11 , the operations further comprising:

determining a visual line of sight interruption between the one or more waypoints and the base location by establishing that at least one structure represented by the three-dimensional data intersects a line between the base location and the one or more waypoints.

13. The apparatus of claim 12 , wherein determining whether the one or more waypoints of the flight path would cause a visual line of sight interruption further comprises:

disallowing a waypoint to be included as part of the flight path where the visual line of sight from the base location and the waypoint would be blocked because of the at least one structure.

14. The apparatus of claim 12 , wherein determining whether the one or more waypoints of the flight path would cause a visual line of sight interruption, further comprises:

determining that an altitude of the UAV along the flight path is below a height of the structure.

15. The apparatus of claim 11 , the operations further comprising:

adjusting the geo-spatial position of the one or more waypoints to a higher altitude such that a visual line of sight interruption does not occur between the adjusted one or more waypoint and the base location.

16. The apparatus of claim 11 , wherein obtaining three-dimensional data representing a physical structure further comprises:

instructing the UAV to perform a scan of the structure; and

receiving sensor data obtained by the UAV during the scan of the structure, wherein the sensor data includes Lidar data or digital images; and

creating a point cloud of the structure based on the obtained sensor data, wherein the point cloud is the three-dimensional data.

17. The apparatus of claim 11 , the operations further comprising:

presenting, via a user interface, one or more recommended launching locations for the UAV that provides a launching location to obtain a best or maximum visual line of sight when operating the UAV around the structure.

18. A flight planning system comprising:

a flight description module configured to:

obtain three-dimensional data including a physical structure;

determine a base location; and

generate a flight path for automated flight of the UAV,

wherein the flight path comprises one or more waypoints for the UAV to navigate to about the structure,

wherein each waypoint includes a geo-spatial position, and

wherein the one or more waypoints are positioned about the structure so that a visual line of sight interruption does not occur between a position of a waypoint and a position of the base location as compared to the three-dimensional data.

19. The flight planning system of claim 18 , the operations further comprising:

an analysis module configured to determine a visual line of sight interruption between the one or more waypoints and the base location by establishing that at least one structure represented by the three-dimensional data intersects a line between the base location and the one or more waypoints.

20. The flight planning system of claim 19 , wherein to determine whether the one or more waypoints of the flight path would cause a visual line of sight interruption, the analysis module is further configured to:

disallow a waypoint to be included as part of the flight path where the visual line of sight from the base location and the waypoint would be blocked because of the at least one structure.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2023
From: GUREL, VOLKAN; MICHINI, BERNARD J.; STEAKLEY, EDWARD DALE
To: UNMANNED INNOVATION INC.
Reel/Frame 065941/0884 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2023
From: UNMANNED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 065941/0943 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2023
From: AIRWARE, LLC
To: SKYDIO, INC.
Reel/Frame 065942/0001 →
Continuity (6)
Continuation 17512323 · Oct 27, 2021
Continuation 15449846 · Mar 3, 2017
Continuation 15094802 · Apr 8, 2016
Provisional Application 62298429 · Feb 22, 2016
Provisional Application 62292783 · Feb 8, 2016
Related Publication 20240257654A1 · Aug 1, 2024
References Cited (105)
US 6509926B1 · Mills et al. · 2003 [cited by applicant]
US 7460148B1 · Clark et al. · 2008 [cited by applicant]
US 8477190B2 · Giuffrida et al. · 2013 [cited by applicant]
US 8721197B2 · Miyahara et al. · 2014 [cited by applicant]
US 8994578B1 · Finley et al. · 2015 [cited by applicant]
US 9127908B2 · Miralles · 2015 [cited by applicant]
US 9273981B1 · Downey et al. · 2016 [cited by applicant]
US 9412278B1 · Gong et al. · 2016 [cited by applicant]
US 9466219B1 · Stefani et al. · 2016 [cited by applicant]
US 9508263B1 · Teng et al. · 2016 [cited by applicant]
US 9563201B1 · Tofte et al. · 2017 [cited by applicant]
US 9588516B1 · Gurel et al. · 2017 [cited by applicant]
US 9618940B1 · Michini et al. · 2017 [cited by applicant]
US 9734723B1 · Bruno et al. · 2017 [cited by applicant]
US 9744665B1 · Linnell et al. · 2017 [cited by applicant]
US 9852639B2 · Teng et al. · 2017 [cited by applicant]
US 10008123B2 · Chen · 2018 [cited by applicant]
US 10762795B2 · Contreras et al. · 2020 [cited by applicant]
US 20040174434A1 · Walker et al. · 2004 [cited by applicant]
US 20040249519A1 · Frink · 2004 [cited by applicant]
US 20060148418A1 · Purkayastha et al. · 2006 [cited by applicant]
US 20080033604A1 · Margolin · 2008 [cited by applicant]
US 20080094491A1 · Hsu et al. · 2008 [cited by applicant]
US 20090041295A1 · Matsuzaka et al. · 2009 [cited by applicant]
US 20090044117A1 · Vaughan et al. · 2009 [cited by applicant]
US 20090125223A1 · Higgins · 2009 [cited by applicant]
US 20090248287A1 · Limbaugh et al. · 2009 [cited by applicant]
US 20100017046A1 · Cheung et al. · 2010 [cited by applicant]
US 20100198514A1 · Miralles · 2010 [cited by applicant]
US 20100231731A1 · Motomura et al. · 2010 [cited by applicant]
US 20110147515A1 · Miller et al. · 2011 [cited by applicant]
US 20120007982A1 · Giuffrida et al. · 2012 [cited by applicant]
US 20120021694A1 · Prince et al. · 2012 [cited by applicant]
US 20120095619A1 · Pack et al. · 2012 [cited by applicant]
US 20120176494A1 · Kamon et al. · 2012 [cited by applicant]
US 20120200703A1 · Nadir et al. · 2012 [cited by applicant]
US 20120237028A1 · Khazan et al. · 2012 [cited by applicant]
US 20130070092A1 · Miyahara et al. · 2013 [cited by applicant]
US 20130216089A1 · Chen et al. · 2013 [cited by applicant]
US 20130311009A1 · McAndrew et al. · 2013 [cited by applicant]
US 20140140575A1 · Wolf · 2014 [cited by applicant]
US 20140142787A1 · Tillotson et al. · 2014 [cited by applicant]
US 20140236388A1 · Wong et al. · 2014 [cited by applicant]
US 20140270478A1 · Chen et al. · 2014 [cited by applicant]
US 20140316614A1 · Newman · 2014 [cited by applicant]
US 20140371952A1 · Ohtomo et al. · 2014 [cited by applicant]
US 20150062339A1 · Ostrom · 2015 [cited by applicant]
US 20150111597A1 · Lavery · 2015 [cited by applicant]
US 20150142211A1 · Shehata et al. · 2015 [cited by applicant]
US 20150230150A1 · Wang et al. · 2015 [cited by applicant]
US 20150323930A1 · Downey et al. · 2015 [cited by applicant]
US 20150336669A1 · Kantor · 2015 [cited by examiner]
US 20160016663A1 · Stanek · 2016 [cited by examiner]
US 20160025457A1 · Miralles · 2016 [cited by applicant]
US 20160035224A1 · Yang et al. · 2016 [cited by applicant]
US 20160068267A1 · Liu et al. · 2016 [cited by applicant]
US 20160068268A1 · Bookless · 2016 [cited by examiner]
US 20160161258A1 · Magson et al. · 2016 [cited by applicant]
US 20160163204A1 · Raptopoulos et al. · 2016 [cited by applicant]
US 20160224766A1 · Steelberg et al. · 2016 [cited by applicant]
US 20160227259A1 · Brav et al. · 2016 [cited by applicant]
US 20160307447A1 · Johnson et al. · 2016 [cited by applicant]
US 20160328983A1 · Hutchinson et al. · 2016 [cited by applicant]
US 20160332739A1 · Wong · 2016 [cited by applicant]
US 20160335476A1 · Renkis · 2016 [cited by applicant]
US 20160335898A1 · Caplan et al. · 2016 [cited by applicant]
US 20160358432A1 · Branscomb et al. · 2016 [cited by applicant]
US 20160364579A1 · Wilmes · 2016 [cited by applicant]
US 20160373699A1 · Torres et al. · 2016 [cited by applicant]
US 20170029107A1 · Emami et al. · 2017 [cited by applicant]
US 20170083979A1 · Winn et al. · 2017 [cited by applicant]
US 20170084037A1 · Barajas Hernandez et al. · 2017 [cited by applicant]
US 20170092109A1 · Trundle et al. · 2017 [cited by applicant]
US 20170092138A1 · Trundle et al. · 2017 [cited by applicant]
US 20170109577A1 · Wang et al. · 2017 [cited by applicant]
US 20170110014A1 · Teng et al. · 2017 [cited by applicant]
US 20170148328A1 · Chan et al. · 2017 [cited by applicant]
US 20170169713A1 · Gong et al. · 2017 [cited by applicant]
US 20170187993A1 · Martch et al. · 2017 [cited by applicant]
US 20170192424A1 · Poole et al. · 2017 [cited by applicant]
US 20170199269A1 · Allen et al. · 2017 [cited by applicant]
US 20170199647A1 · Richman et al. · 2017 [cited by applicant]
US 20170229022A1 · Gurel et al. · 2017 [cited by applicant]
US 20170235018A1 · Foster et al. · 2017 [cited by applicant]
US 20170269590A1 · Feng · 2017 [cited by applicant]
US 20170293301A1 · Myslinski · 2017 [cited by applicant]
US 20170337824A1 · Chen · 2017 [cited by applicant]
US 20170357273A1 · Michini et al. · 2017 [cited by applicant]
US 20170372514A1 · Grufman et al. · 2017 [cited by applicant]
US 20180025473A1 · Contreras et al. · 2018 [cited by applicant]
US 20180025649A1 · Contreras et al. · 2018 [cited by applicant]
US 20180032088A1 · van Cruyningen · 2018 [cited by examiner]
US 20180275654A1 · Merz et al. · 2018 [cited by applicant]
US 20180314251A1 · Kamalakantha et al. · 2018 [cited by applicant]
US 20210250084A1 · Stein et al. · 2021 [cited by applicant]
US 20220148445A1 · Bauer et al. · 2022 [cited by applicant]
CN 107407915A · 2017 [cited by applicant]
CN 107409174A · 2017 [cited by applicant]
JP 2017532237A · 2017 [cited by applicant]
WO 2015102731A2 · 2015 [cited by applicant]
WO 2015126422A1 · 2015 [cited by applicant]
International Application No. PCT/US2017/016860, International Search Report, Written Opinion, 12 pages, May 30, 2017. [cited by applicant]
International Application No. PCT/US2017/018863, International Search Report, Written Opinion, 10 pages, Mar. 24, 2017. [cited by applicant]
Ruiz, J. J. et al., “A Simulation Framework To Validate The Use Of Head-Mounted Displays And Tablets For Information Exchange With The UAV Safety Pilot,” 2015 Workshop RED-UAS, pp. 336-341, Nov. 23-25, 2015. [cited by applicant]
Walden, Gregory S., “Industry's Perspective: A Few Small Steps By The FAA, But No Giant Leap,” The Air & Space Lawyer, vol. 28, No. 2, pp. 8-12, 2015. [cited by applicant]