IP Library Granted Patent US 10,761,525
Granted Patent B2
US 10,761,525 · App. 15/672,764 · Granted Sep 1, 2020

Unmanned aerial vehicle inspection system

Inventors: Brett Michael Bethke (Millbrae, CA); Hui Li (San Francisco, CA); Bernard J. Michini (San Franisco, CA)
Assignee: Skydio, Inc.
G05D1/0011B64C39/024B64D47/00B64D47/08G05D1/0094G08G5/0013G08G5/0034G08G5/0069G08G5/0086B64C2201/027B64C2201/12B64C2201/123B64C2201/146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,761,525
App. No.
15/672,764
Granted
Sep 1, 2020
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for an unmanned aerial system inspection system. One of the methods is performed by a UAV and includes obtaining, from a user device, flight operation information describing an inspection of a vertical structure to be performed, the flight operation information including locations of one or more safe locations for vertical inspection. A location of the UAV is determined to correspond to a first safe location for vertical inspection. A first inspection of the structure is performed is performed at the first safe location, the first inspection including activating cameras. A second safe location is traveled to, and a second inspection of the structure is performed. Information associated with the inspection is provided to the user device.

Claims (54)

1. A system comprising one or more processors and a computer storage media storing instructions, that when executed by the one or more processors, cause the one or more processors to perform operations associated with inspecting vertical structures, the operations performed prior to inspections of the vertical structures, and the operations comprising:

displaying, via a user interface, a representation of a vertical structure to be inspected by an unmanned aerial vehicle (UAV);

determining vertical inspection locations around the vertical structure to be inspected, the vertical inspection locations representing proposed vertical columns of flight by the UAV;

displaying, via the user interface, the vertical inspection locations being positioned about the vertical structure at which the UAV is to obtain sensor information;

generating a flight pattern based on the vertical inspection locations, the flight pattern, upon implementation by the UAV, causing the UAV to navigate around the vertical structure to a plurality of positions and orient one or more sensors of the UAV towards the vertical structure and obtain sensor information describing the vertical structure; and

transmitting, to the UAV for implementation, flight information including the flight pattern via a wireless or wired connection.

2. The system of claim 1 , wherein generating the flight pattern comprises:

determining vertical inspection locations, the vertical inspection locations being set around the vertical structure at the plurality of positions.

3. The system of claim 2 , wherein the vertical inspection locations are placed equidistant from a centroid of the vertical structure.

4. The system of claim 2 , wherein the flight pattern comprises waypoints for the vertical inspection locations and a landing waypoint, wherein the waypoints have an associated geospatial location indicating a horizontal position,

and wherein the flight pattern indicates that the UAV is to perform an inspection for each vertical inspection location that comprises the UAV navigating to an associated horizontal position at a first altitude, and while navigating along a vertical direction between the first altitude and a second altitude at the associated horizontal position, obtaining sensor information describing the vertical structure.

5. The system of claim 1 , wherein the user interface is configured to allow addition and removal of inspection locations for vertical inspection of the vertical structure.

6. The system of claim 1 , wherein the operations further comprise determining a geofence envelope boundary, the boundary surrounding the vertical inspection locations, wherein the geofence envelope boundary describes a volume of space within which the UAV can be located, wherein the volume of space is constrained below a particular altitude, and wherein the representation of the vertical structure includes a representation of the volume of space.

7. The system of claim 1 , wherein the flight pattern indicates the UAV is to navigate to an altitude, fly a pattern around the vertical structure, and while flying the pattern, obtain sensor information describing the vertical structure from the positions about the vertical structure.

8. The system of claim 7 , wherein the operations further comprise: determining a centroid of the vertical structure, wherein the pattern around the vertical structure is set at a predetermined distance from the centroid of the vertical structure.

9. The system of claim 1 , wherein the operations further comprise determining a centroid of the vertical structure, wherein the vertical inspection locations have a radius ranging from 3-20 meters from the centroid of the vertical structure.

10. The system of claim 1 , wherein the operations further comprise:

receiving input associated with adjusting the position of one or more of the vertical inspection locations.

11. A method implemented by a system comprising one or more processors, the method comprising:

displaying, via a user interface, a representation of a vertical structure to be inspected by an unmanned aerial vehicle (UAV);

determining vertical inspection locations around the vertical structure to be inspected, the vertical inspection locations representing proposed vertical columns of flight by the UAV;

displaying, via the user interface, the vertical inspection locations being positioned about the vertical structure at which the UAV is to obtain sensor information;

generating a flight pattern based on the vertical inspection locations, the flight pattern, upon implementation by the UAV, causing the UAV to navigate around the vertical structure to a plurality of positions and orient one or more sensors of the UAV towards the vertical structure and obtain sensor information describing the vertical structure; and

transmitting, to the UAV for implementation, flight information including the flight pattern via a wireless or wired connection.

12. The method of claim 11 , wherein generating the flight pattern comprises:

determining vertical inspection locations, the vertical inspection locations being set around the vertical structure at the plurality of positions.

13. The method of claim 12 , wherein the vertical inspection locations are placed equidistant from a centroid of the vertical structure.

14. The method of claim 12 , wherein the flight pattern comprises waypoints for the vertical inspection locations and a landing waypoint, wherein the waypoints have an associated geospatial location indicating a horizontal position,

and wherein the flight pattern indicates that the UAV is to perform an inspection for each vertical inspection location that comprises the UAV navigating to an associated horizontal position at a first altitude, and while navigating along a vertical direction between the first altitude and a second altitude at the associated horizontal position, obtaining sensor information describing the vertical structure.

15. The method of claim 11 , further comprising determining a geofence envelope boundary, the boundary surrounding the vertical inspection locations, wherein the UAV is configured to perform a contingency operation if the UAV determines the geofence envelope boundary has been crossed by the UAV.

16. The method of claim 15 , wherein the geofence envelope boundary describes a volume of space within which the UAV can be located, wherein the volume of space is constrained below a particular altitude, and wherein the representation of the vertical structure includes a representation of the volume of space.

17. The method of claim 11 , wherein the flight pattern indicates the UAV is to navigate to an altitude, fly a pattern around the vertical structure, and while flying the pattern, obtain sensor information describing the vertical structure from the positions about the vertical structure.

18. The method of claim 17 , further comprising: determining a centroid of the vertical structure, wherein the pattern around the vertical structure is set at a predetermined distance from the centroid of the vertical structure.

19. The method of claim 11 , further comprising determining a centroid of the vertical structure, wherein the vertical inspection locations have a radius ranging from 3-20 meters from the centroid of the vertical structure.

20. The method of claim 11 , further comprising:

receiving input associated with adjusting the position of one or more vertical inspection locations.

21. A non-transitory computer storage medium storing instructions that when executed by a system of one or more processors cause the system to perform operations comprising:

displaying, via a user interface, a representation of a vertical structure to be inspected by an unmanned aerial vehicle (UAV);

determining vertical inspection locations around the vertical structure to be inspected, the vertical inspection locations representing proposed vertical columns of flight by the UAV;

displaying, via the user interface, the vertical inspection locations being positioned about the vertical structure at which the UAV is to obtain sensor information;

generating a flight pattern based on the vertical inspection locations, the flight pattern, upon implementation by the UAV, causing the UAV to navigate around the vertical structure to a plurality of positions and orient one or more sensors of the UAV towards the vertical structure and obtain sensor information describing the vertical structure; and

transmitting, to the UAV for implementation, flight information including the flight pattern via a wireless or wired connection.

22. The computer storage medium of claim 21 , wherein generating the flight pattern comprises:

determining vertical inspection locations, the vertical inspection locations being set around the vertical structure at the plurality of positions.

23. The computer storage medium of claim 22 , wherein the vertical inspection locations are placed equidistant from a centroid of the vertical structure.

24. The computer storage medium of claim 22 , wherein the flight pattern comprises waypoints for the vertical inspection locations and a landing waypoint, wherein the waypoints have an associated geospatial location indicating a horizontal position,

and wherein the flight pattern indicates that the UAV is to perform an inspection for each vertical inspection location that comprises the UAV navigating to an associated horizontal position at a first altitude, and while navigating along a vertical direction between the first altitude and a second altitude at the associated horizontal position, obtaining sensor information describing the vertical structure.

25. The computer storage medium of claim 21 , wherein the operations further comprise determining a geofence envelope boundary, the boundary surrounding the vertical inspection locations, wherein the UAV is configured to perform a contingency operation if the UAV determines the geofence envelope boundary has been crossed by the UAV.

26. The computer storage medium of claim 25 , wherein the geofence envelope boundary describes a volume of space within which the UAV can be located, wherein the volume of space is constrained below a particular altitude, and wherein the representation of the vertical structure includes a representation of the volume of space.

27. The computer storage medium of claim 21 , wherein the flight pattern indicates the UAV is to navigate to an altitude, fly a pattern around the vertical structure, and while flying the pattern, obtain sensor information describing the vertical structure from the positions about the vertical structure.

28. The computer storage medium of claim 27 , wherein the operations further comprise: determining a centroid of the vertical structure, wherein the pattern around the vertical structure is set at a predetermined distance from the centroid of the vertical structure.

29. The computer storage medium of claim 21 , wherein the operations further comprise determining a centroid of the vertical structure, wherein the vertical inspection locations have a radius ranging from 3-20 meters from the centroid of the vertical structure.

30. The computer storage medium of claim 21 , wherein the operations further comprise:

receiving input associated with adjusting the position of one or more vertical inspection locations.

Assignments (10)
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: HERCULES CAPITAL, INC.
To: SKYDIO, INC.
Reel/Frame 072128/0698 →
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
To: SKYDIO, INC.
Reel/Frame 072107/0066 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Nov 9, 2021
From: SKYDIO, INC.
To: HERCULES CAPITAL, INC., AS COLLATERAL AND ADMINISTRATIVE AGENT
Reel/Frame 058081/0677 →
SECURITY INTEREST Recorded Nov 8, 2021
From: SKYDIO, INC.
To: SILICON VALLEY BANK
Reel/Frame 058053/0768 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2020
From: KNOBBE, MARTENS, OLSON & BEAR, LLP
To: UNMANNED INNOVATION, INC.
Reel/Frame 053739/0789 →
RELEASE OF SECURITY INTEREST Recorded Jul 16, 2020
From: KNOBBE, MARTENS, OLSON & BEAR, LLC
To: AIRWARE, LLC
Reel/Frame 053234/0634 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CONVEYING PARTY DATA WAS ERRONEOUSLY ENTER AS UNMMANED INNOVATIONS, INC. IT SHOULD READ UNMANNED INNOVATIONS, INC PREVIOUSLY RECORDED AT REEL: 053144 FRAME: 0591. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 15, 2020
From: UNMANNED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 053210/0586 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: AIRWARE, LLC
To: SKYDIO, INC.
Reel/Frame 053144/0633 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: UNMMANED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 053144/0591 →
SECURITY INTEREST Recorded Dec 20, 2018
From: UNMANNED INNOVATION, INC.
To: KNOBBE, MARTENS, OLSON & BEAR, LLP
Reel/Frame 048681/0001 →
Continuity (5)
Continuation 15268241 · Sep 16, 2016
Continuation 15059154 · Mar 2, 2016
Provisional Application 62273222 · Dec 30, 2015
Provisional Application 62294805 · Feb 12, 2016
Related Publication 20180188721A1 · Jul 5, 2018