IP Library Granted Patent US 10,720,065
Granted Patent B2
US 10,720,065 · App. 16/010,052 · Granted Jul 21, 2020

Generating a mission plan for capturing aerial images with an unmanned aerial vehicle

Inventor: David Chen (San Francisco, CA)
Assignee: Skycatch, Inc.
G08G5/0034B64C39/024G05D1/0094G05D1/0202G08G5/006G08G5/0069G08G5/0086B64C2201/123B64C2201/127B64C2201/141
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,720,065
App. No.
16/010,052
Granted
Jul 21, 2020
Kind
B2
Abstract

Systems and methods are disclosed for generating a digital flight path within complex mission boundaries. In particular, in one or more embodiments, systems and methods generate flight legs that traverse a target site within mission boundaries. Moreover, one or more embodiments include systems and methods that utilize linking algorithms to connect the generated flight legs into a flight path. Moreover, one or more embodiments include systems and methods that generate a mission plan based on the flight path. In one or more embodiments, the generated mission plan enables a UAV to traverse a flight area within mission boundaries and capture aerial images with regard to the target site. Furthermore, in one or more embodiments, systems and methods capture digital aerial images of vertical surfaces of a structure by generating a reference surface and flight legs corresponding to the reference surface.

Claims (84)

1. A computer-implemented method comprising:

identifying, by at least one processor, a structure on a target site and a first three-dimensional representation of the structure;

generating, by the at least one processor, a mission plan for a UAV for capturing digital aerial images of the structure from different positions and elevations by:

identifying a vertical surface of the structure from the first three-dimensional representation of the structure;

generating a reference surface from the vertical surface by offsetting the vertical surface of the structure; and

generating a plurality of flight legs based on the reference surface;

obtaining a set of digital aerial images of the structure by causing the UAV to fly the mission plan; and

generating, by the at least one processor, a second three-dimensional representation of the structure based on the set of digital aerial images of the structure.

2. The method of claim 1 , wherein:

identifying the first three-dimensional representation of the structure comprises generating the first three-dimensional representation of the structure based on digital aerial images captured from an initial mission plan; and

generating the mission plan comprises modifying the initial mission plan based on the first three-dimensional representation of the structure.

3. The method of claim 1 , wherein identifying the structure comprises:

providing the first three-dimensional representation of the structure for display to a client device;

receiving a user interaction with the first three-dimensional representation of the structure; and

identifying the structure on the target site based on the user interaction with the first three-dimensional representation of the structure.

4. The method of claim 1 , wherein:

identifying the vertical surface of the structure comprises identifying a plurality of vertical surfaces of the structure from the first three-dimensional representation of the structure; and

generating the reference surface comprises offsetting the plurality of vertical surfaces of the structure based on a camera resolution of a camera affixed to the UAV to generate a three-dimensional shape.

5. The method of claim 4 , wherein generating the plurality of flight legs corresponding to the reference surface comprises:

projecting the three-dimensional shape to a two-dimensional space;

generating flight legs on the reference surface projected to the two-dimensional space; and

projecting the flight legs to a three-dimensional space.

6. The method of claim 1 , wherein generating the mission plan comprises:

identifying a portion of the vertical surface below a minimum flight altitude; and

determining a camera angle to capture the portion of the vertical surface below the minimum flight altitude from a position above the minimum flight altitude.

7. The method of claim 6 , wherein generating the mission plan further comprises:

determining an offset of the vertical surface based on a camera resolution of a camera affixed to the UAV and the camera angle; and

generating a flight leg based on the offset.

8. A system comprising:

at least one processor; and

at least one non-transitory computer readable storage medium storing instructions thereon that, when executed by the at least one processor, cause the system to:

identify a first three-dimensional model of a structure on a target site;

generate a mission plan for a UAV for capturing digital aerial data reflecting the structure from different positions and elevations by:

identifying a vertical surface of the structure from the first three-dimensional model of the structure;

generating a reference surface from the vertical surface by offsetting the vertical surface of the structure; and

generating a plurality of flight legs based on the reference surface;

obtaining a set of digital aerial data reflecting the structure by causing the UAV to fly the mission plan; and

generating a second three-dimensional model of the structure based on the set of digital aerial data reflecting the structure.

9. The system of claim 8 , wherein the set of digital aerial data reflecting the structure comprises a plurality of digital aerial images of the structure captured by the UAV in flying the mission plan.

10. The system of claim 8 , further comprising instructions that, when executed by the at least one processor, cause the system to identify the structure by:

providing a representation of the first three-dimensional model for display to a client device;

receiving a user interaction with the representation of the first three-dimensional model; and

identifying the structure on the target site based on the user interaction with the representation of the first three-dimensional model.

11. The system of claim 8 , further comprising instructions that, when executed by the at least one processor, cause the system to:

identify the vertical surface of the structure by identifying a plurality of vertical surfaces of the structure from the first three-dimensional model; and

generate the reference surface by offsetting the plurality of vertical surfaces of the structure to generate a three-dimensional shape.

12. The system of claim 11 , further comprising instructions that, when executed by the at least one processor, cause the system to generate the plurality of flight legs by:

projecting the three-dimensional shape to a two-dimensional space; and

generating parallel flight legs on the three-dimensional shape projected on the two-dimensional space at a leg spacing based on an amount of overlap between digital aerial images.

13. The system of claim 8 , further comprising instructions that, when executed by the at least one processor, cause the system to generate the mission plan by:

determining a first offset corresponding to a portion of the vertical surface above a minimum flight altitude; and

generating a first flight leg based on the first offset.

14. The system of claim 13 , further comprising instructions that, when executed by the at least one processor, cause the system to generate the mission plan by:

determining a camera angle to capture a digital aerial image of the portion of the vertical surface below the minimum flight altitude from a position above the minimum flight altitude;

determining a second offset of the vertical surface based on a camera resolution of a camera affixed to the UAV and the camera angle; and

generating a second flight leg based on the second offset.

15. A computer-implemented method comprising:

generating, by at least one processor, a first three-dimensional model of a target site;

identifying, by the at least one processor, a structure on the target site based on the first three-dimensional model;

generating a mission plan for a UAV to capture digital aerial data of the structure from different positions and elevations by:

identifying a vertical surface of the structure from the first three-dimensional model;

generating a reference surface by offsetting the vertical surface of the structure; and

generating a plurality of flight legs based on the reference surface; and

capturing a set of digital aerial data reflecting the structure by causing the UAV to fly the mission plan; and

generating a second three-dimensional model of the structure based on the set of digital aerial data reflecting the structure.

16. The method of claim 15 , wherein the set of digital aerial data reflecting the structure comprises a plurality of digital aerial images of the structure captured by the UAV in flying the mission plan.

17. The method of claim 15 , wherein identifying the structure comprises:

providing the first three-dimensional model for display to a client device;

receiving, via the client device, a user interaction with the first three-dimensional model; and

identifying the structure on the target site based on the user interaction with the first three-dimensional model.

18. The method of claim 15 , wherein generating the plurality of flight legs comprises:

projecting the reference surface from a three-dimensional space to a two-dimensional space;

generating flight legs on the reference surface projected on the two-dimensional space at a leg spacing based on an amount of overlap between digital aerial images; and

projecting the flight legs to the three-dimensional space.

19. The method of claim 15 , wherein generating the reference surface comprises:

determining a first offset corresponding to a portion of the vertical surface above a minimum flight altitude;

generating a first flight leg based on the first offset;

identifying a portion of the vertical surface below the minimum flight altitude;

determining a camera angle to capture a digital aerial image of the portion of the vertical surface below the minimum flight altitude from a position above the minimum flight altitude;

determining a second offset of the vertical surface based on the camera angle; and

generating a second flight leg based on the second offset.

20. The method of claim 15 , further comprising:

detecting a variation in width of the structure with respect to elevation; and

generating the reference surface such that the reference surface comprises a change in width corresponding to the variation in width of the structure.

Assignments (2)
SECURITY INTEREST Recorded Mar 6, 2024
From: SKYCATCH, INC.
To: CATERPILLAR VENTURE CAPITAL INC.
Reel/Frame 066669/0057 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 15, 2018
From: CHEN, DAVID
To: SKYCATCH, INC.
Reel/Frame 046103/0378 →
Continuity (4)
Continuation 15659133 · Jul 25, 2017
Continuation In Part 15291433 · Oct 12, 2016
Continuation 14887954 · Oct 20, 2015
Related Publication 20180301041A1 · Oct 18, 2018