IP Library Granted Patent US 11,203,425
Granted Patent B2
US 11,203,425 · App. 15/638,267 · Granted Dec 21, 2021

Unmanned aerial vehicle inspection system

Inventors: Mark Patrick Bauer (San Francisco, CA); Bernard J. Michini (San Francisco, CA); Brett Michael Bethke (Millbrae, CA)
Assignee: Skydio, Inc.
B64C29/0025B64C39/024G08G5/0013G08G5/0034G08G5/0065G08G5/0069G08G5/0086B64C2201/044B64C2201/086B64C2201/088B64C2201/146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,203,425
App. No.
15/638,267
Granted
Dec 21, 2021
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for an unmanned aerial system inspection system. One of the methods is performed by a UAV and includes obtaining, from a user device, flight operation information describing an inspection of a vertical structure to be performed, the flight operation information including locations of one or more safe locations for vertical inspection. A location of the UAV is determined to correspond to a first safe location for vertical inspection. A first inspection of the structure is performed is performed at the first safe location, the first inspection including activating cameras. A second safe location is traveled to, and a second inspection of the structure is performed. Information associated with the inspection is provided to the user device.

Claims (45)

1. A flight planning system comprising:

one or more computer processors; and

one or more computer storage media storing instructions that when executed by the one or more computer processors cause the one or more computer processors to:

receive, via a user interface, a selection of a type of vertical structure to be inspected;

in response to receiving the selection, present, via the user interface, a representation of a vertical structure corresponding to the selected type of vertical structure;

receive, via the user interface, input identifying one or more portions of the representation of the vertical structure to be inspected by an unmanned aerial vehicle (UAV);

present, via the user interface, an indication of the one or more portions of the representation of the vertical structure to be inspected; and

determine a flight plan to perform an inspection of a real-world vertical structure corresponding to the representation of the vertical structure, the flight plan determined, at least in part, based on the indicated portions of the representation of the vertical structure to be inspected, wherein the flight plan specifies inspection columns within a threshold distance of the real-world vertical structure, each inspection column associated with a location, a first altitude and a second altitude, and wherein the flight plan causes the UAV to navigate and obtain sensor information associated with the real-world vertical structure along a vertical direction at each location from the first altitude to the second altitude.

2. The flight planning system of claim 1 , wherein the UAV navigates to a subsequent inspection column at the first altitude after completing navigation of a particular inspection column.

3. The flight planning system of claim 1 , wherein each inspection column is indicated, by a user, as enabling the UAV to freely navigate from the first altitude along the vertical direction to the second altitude.

4. The flight planning system of claim 1 , wherein the UAV obtains the sensor information associated with the real-world vertical structure while navigating along the vertical direction at each location associated with the inspection columns.

5. The flight planning system of claim 1 , wherein the user interface presents a top-down view of the representation of the vertical structure and representations of the inspection columns set at horizontal positions around the top-down view.

6. The flight planning system of claim 5 , wherein the user interface responds to user interactions associated with moving the representations of the inspection columns, the user interactions including one or more of rotating one or more of the inspection columns a same angle about a centroid associated with the real-world vertical structure, moving one or more of the inspection columns closer to the centroid, or moving one or more of the inspection columns farther from the centroid.

7. The flight planning system of claim 6 , wherein upon receiving user interactions associated with moving the representations of the inspection columns, the flight planning system determines the flight plan based on the user interactions.

8. The flight planning system of claim 1 , wherein the indicated portions indicate a portion of the representation of the vertical structure from a particular distance from a top portion of the representation of the vertical structure to a particular distance below the top of the representation of the vertical structure.

9. The flight planning system of claim 1 , wherein the representation of the vertical structure comprises a model of the vertical structure, the model rotatable about one or more axes.

10. A method implemented by a flight planning system comprising one or more computer processors for determining flight plans to inspect vertical structures by unmanned aerial vehicles (UAVs), the method comprising:

receiving, via a user interface, a selection of a type of vertical structure to be inspected;

in response to receiving the selection, presenting via the user interface, a representation of the vertical structure corresponding to the selected type of vertical structure;

receiving, via the user interface, input identifying one or more portions of the representation of the vertical structure to be inspected by an unmanned aerial vehicle (UAV);

presenting, via the user interface, an indication of the one or more portions of the representation of the vertical structure to be inspected; and

determining a flight plan to perform an inspection of a real-world vertical structure corresponding to the representation of the vertical structure, the flight plan determined, at least in part, based on the indicated portions of the representation of the vertical structure to be inspected, wherein the flight plan specifies inspection columns within a threshold distance of the real-world vertical structure, each inspection column associated with a location, a first altitude and a second altitude, and wherein the flight plan causes the UAV to navigate and obtain sensor information associated with the real-world vertical structure along a vertical direction at each location from the first altitude to the second altitude.

11. The method of claim 10 , wherein the UAV navigates to a subsequent inspection column at the first altitude after completing navigation of a particular inspection column.

12. The method of claim 10 , wherein each inspection column is indicated, by a user, as enabling the UAV to freely navigate from the first altitude along the vertical direction to the second altitude.

13. The method of claim 10 , wherein the UAV obtains the sensor information associated with the real-world vertical structure while navigating along the vertical direction at each location associated with the inspection columns.

14. The method of claim 10 , wherein the user interface presents a top-down view of the representation of the vertical structure and representations of the inspection columns set at horizontal positions around the top-down view.

15. The method of claim 14 , wherein the user interface responds to user interactions associated with moving the representations of the inspection columns, the user interactions including one or more of rotating one or more of the inspection columns a same angle about a centroid associated with the real-world vertical structure, moving one or more of the inspection columns closer to the centroid, or moving one or more of the inspection columns farther from the centroid.

16. The method of claim 15 , wherein upon receiving user interactions associated with moving the representations of the inspection columns, the flight planning system determines the flight plan based on the user interactions.

17. The method of claim 10 , wherein the indicated portions indicate a portion of the representation of the vertical structure from a particular distance from a top portion of the vertical structure to a particular distance below the top of the representation of the vertical structure.

18. The method of claim 10 , wherein the representation of the vertical structure comprises a model of the vertical structure, the model rotatable about one or more axes.

19. A non-transitory computer storage medium comprising instructions that when executed by one or more processors, cause the one or more processors to perform operations comprising:

receiving a selection of a type of vertical structure to be inspected;

in response to receiving the selection, presenting via a user interface, a representation of the vertical structure corresponding to the selected type of vertical structure;

receiving, via the user interface, input identifying one or more portions of the representation of the vertical structure to be inspected by an unmanned aerial vehicle (UAV);

presenting, via the user interface, an indication of the one or more portions of the representation of the vertical structure to be inspected; and

determining a flight plan to perform an inspection of a real-world vertical corresponding to the representation of the vertical structure, the flight plan determined, at least in part, based on the indicated portions of the representation of the vertical structure to be inspected, wherein the flight plan specifies inspection columns within a threshold distance of the real-world vertical structure, each inspection column associated with a location, a first altitude and a second altitude, and wherein the flight plan causes the UAV to navigate and obtain sensor information associated with the real-world vertical structure along a vertical direction at each location from the first altitude to the second altitude.

20. The non-transitory computer storage medium of claim 19 , wherein the UAV navigates to a subsequent inspection column at the first altitude after completing navigation of a particular inspection column.

21. The non-transitory computer storage medium of claim 19 , wherein each inspection column is indicated, by a user, as enabling the UAV to freely navigate from the first altitude along the vertical direction to the second altitude.

22. The non-transitory computer storage medium of claim 19 , wherein the UAV obtains the sensor information associated with the real-world vertical structure while navigating along the vertical direction at each location associated with the inspection columns.

23. The non-transitory computer storage medium of claim 19 , wherein the user interface presents a top-down view of the representation of the vertical structure and representations of the inspection columns set at horizontal positions around the top-down view.

24. The non-transitory computer storage medium of claim 23 , wherein the user interface responds to user interactions associated with moving the representations of the inspection columns, the user interactions including one or more of rotating one or more of the inspection columns a same angle about a centroid associated with the real-world vertical structure, moving one or more of the inspection columns closer to the centroid, or moving one or more of the inspection columns farther from the centroid.

25. The non-transitory computer storage medium of claim 24 , wherein upon receiving user interactions associated with moving the representations of the inspection columns, the operations further comprise:

determining the flight plan based on the user interactions.

26. The non-transitory computer storage medium of claim 19 , wherein the indicated portions indicate a portion of the representation of the vertical structure from a particular distance from a top portion of the vertical structure to a particular distance below the top of the representation of the vertical structure.

27. The non-transitory computer storage medium of 19 , wherein the representation of the vertical structure comprises a model of the vertical structure, the model rotatable about one or more axes.

Assignments (11)
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
To: SKYDIO, INC.
Reel/Frame 072107/0066 →
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: HERCULES CAPITAL, INC.
To: SKYDIO, INC.
Reel/Frame 072128/0698 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Nov 9, 2021
From: SKYDIO, INC.
To: HERCULES CAPITAL, INC., AS COLLATERAL AND ADMINISTRATIVE AGENT
Reel/Frame 058081/0677 →
SECURITY INTEREST Recorded Nov 8, 2021
From: SKYDIO, INC.
To: SILICON VALLEY BANK
Reel/Frame 058053/0768 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2020
From: KNOBBE, MARTENS, OLSON & BEAR, LLP
To: UNMANNED INNOVATION, INC.
Reel/Frame 053739/0789 →
RELEASE OF SECURITY INTEREST Recorded Jul 16, 2020
From: KNOBBE, MARTENS, OLSON & BEAR, LLC
To: AIRWARE, LLC
Reel/Frame 053234/0634 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CONVEYING PARTY DATA WAS ERRONEOUSLY ENTER AS UNMMANED INNOVATIONS, INC. IT SHOULD READ UNMANNED INNOVATIONS, INC PREVIOUSLY RECORDED AT REEL: 053144 FRAME: 0591. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 15, 2020
From: UNMANNED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 053210/0586 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: AIRWARE, LLC
To: SKYDIO, INC.
Reel/Frame 053144/0633 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: UNMMANED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 053144/0591 →
SECURITY INTEREST Recorded Dec 20, 2018
From: UNMANNED INNOVATION, INC.
To: KNOBBE, MARTENS, OLSON & BEAR, LLP
Reel/Frame 048681/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2018
From: BAUER, MARK PATRICK; MICHINI, BERNARD J.; BETHKE, BRETT MICHAEL
To: UNMANNED INNOVATION, INC.
Reel/Frame 045784/0059 →
Cited By (2)
US 12,656,120 US 12,669,331