IP Library Granted Patent US 11,933,613
Granted Patent B2
US 11,933,613 · App. 17/876,808 · Granted Mar 19, 2024

Ground control point assignment and determination system

Inventors: Bernard J. Michini (San Francisco, CA); Brett Michael Bethke (Millbrae, CA); Fabien Blanc-Paques (San Francisco, CA)
Assignee: Skydio, Inc.
G01C15/06B64C39/024G01C15/02G05D1/0011G05D1/0094G08G5/0013G08G5/003G08G5/0034G08G5/0069B64U10/13B64U2101/00B64U2101/30B64U2101/60B64U2201/00B64U2201/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,933,613
App. No.
17/876,808
Granted
Mar 19, 2024
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for ground control point assignment and determination. One of the methods includes receiving information describing a flight plan for the UAV to implement, the flight plan identifying one or more waypoints associated with geographic locations assigned as ground control points. A first waypoint identified in the flight plan is traveled to, and an action to designate a surface at the associated geographic location is designated as a ground control point. Location information associated with the designated surface is stored. The stored location information is provided to an outside system for storage.

Claims (48)

1. A method, comprising:

automatically determining, independent of user input, one or more locations at least partially surrounding a structure within an inspection area to designate as ground control points based on an image depicting the inspection area;

designating, using an unmanned aerial vehicle, one or more surfaces at the one or more locations as the ground control points; and

performing, using the unmanned aerial vehicle, a job associated with the inspection area including capturing one or more images of the structure using a camera of the unmanned aerial vehicle at locations proximate to the ground control points.

2. The method of claim 1 , wherein designating the one or more surfaces as the ground control points comprises:

spraying, using a spray nozzle of the unmanned aerial vehicle, fluid in one or more colors onto a surface of the one or more surfaces to designate the surface as a ground control point of the ground control points.

3. The method of claim 1 , wherein designating the one or more surfaces as the ground control points comprises:

placing, using the unmanned aerial vehicle, a physical marker onto a surface of the one or more surfaces to designate the surface as a ground control point of the ground control points.

4. The method of claim 3 , wherein the physical marker includes a sensor configured to transmit time-pulse data indicative of a distance measurement between the physical marker and another physical marker placed onto another surface of the one or more surfaces.

5. The method of claim 3 , wherein pattern information depicted on a top of the physical marker is usable to identify the physical marker within an image captured using the camera of the unmanned aerial vehicle.

6. The method of claim 3 , wherein a size of the physical marker is based on an altitude at which the unmanned aerial vehicle will perform at least a portion of the job.

7. The method of claim 1 , wherein performing the job comprises:

traveling, by the unmanned aerial vehicle, at a maximum altitude that enables the unmanned aerial vehicle to identify the one or more surfaces designated as the ground control points.

8. The method of claim 1 , wherein each of the one or more locations is determined accord to one or more features corresponding to at least one of a natural or manmade object at a fixed location within the inspection area.

9. An unmanned aerial vehicle, comprising:

one or more cameras;

one or more processors; and

one or more non-transitory storage media storing instructions that, when executed by the one or more processors, cause the one or more processors to:

automatically determine one or more locations at least partially surrounding a structure within an inspection area to designate as ground control points based on an image depicting the inspection area;

designate one or more surfaces at the one or more locations as the ground control points; and

perform a job including capturing one or more images of the structure using the one or more cameras at locations proximate to the ground control points.

10. The unmanned aerial vehicle of claim 9 , wherein, to designate the one or more surfaces as the ground control points, the one or more processors are configured to execute the instructions to:

travel to an altitude above a surface of the one or more surfaces;

at the altitude above the surface, descend toward the surface; and

perform an action to designate the surface as a ground control point of the ground control points.

11. The unmanned aerial vehicle of claim 10 , comprising:

a spray nozzle, wherein the action performed to designate the surface as the ground control point includes using the spray nozzle to spray the surface to designate the surface as the ground control point.

12. The unmanned aerial vehicle of claim 10 , wherein the action performed to designate the surface as the ground control point includes placing a physical marker on the surface.

13. The unmanned aerial vehicle of claim 10 , comprising:

one or more sensors,

wherein, to designate the one or more surfaces as the ground control points, the one or more processors are configured to execute the instructions to:

determine that the surface is flat based on a distance, measured using the one or more sensors, between the unmanned aerial vehicle and the surface.

14. The unmanned aerial vehicle of claim 9 , wherein, to automatically determine the one or more locations, the one or more processors are configured to execute the instructions to:

identify one or more features for use as the ground control points, wherein the one or more surfaces are of the one or more features.

15. The unmanned aerial vehicle of claim 9 , wherein the ground control points are used as waypoints for the performance of the job using the unmanned aerial vehicle.

16. A system, comprising:

an unmanned aerial vehicle configured to:

automatically determine, independent of user input, a location about a structure within an inspection area based on an image depicting the inspection area;

designate a surface at the location as a ground control point; and

capture one or more images of the structure at the ground control point in connection with a performance of a job within the inspection area; and

a user device in communication with the unmanned aerial vehicle.

17. The system of claim 16 , wherein the unmanned aerial vehicle designates the surface as the ground control point according to an action triggered using the user device.

18. The system of claim 16 , wherein, to designate the surface as the ground control point, the unmanned aerial vehicle is configured to:

travel to a location vertically above the surface;

descend toward the surface based on an instruction obtained from the user device; and

perform, while descended, an action to designate the surface as the ground control point.

19. The system of claim 18 , wherein the action includes spraying fluid in one or more colors onto the surface.

20. The system of claim 18 , wherein the action includes placing a physical marker onto the surface.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2022
From: MICHINI, BERNARD J.; BETHKE, BRETT MICHAEL; BLANC-PAQUES, FABIEN
To: UNMANNED INNOVATION INC.
Reel/Frame 060669/0061 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2022
From: UNMANNED INNOVATION INC.
To: AIRWARE, LLC
Reel/Frame 060669/0163 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2022
From: AIRWARE, LLC
To: SKYDIO, INC.
Reel/Frame 060669/0445 →
Continuity (5)
Continuation 15829477 · Dec 1, 2017
Continuation 15336569 · Oct 27, 2016
Continuation 15093511 · Apr 7, 2016
Provisional Application 62305428 · Mar 8, 2016
Related Publication 20220381561A1 · Dec 1, 2022
Cited By (14)
US 12,202,634 US 12,205,483 US 12,230,117 US 12,280,889 US 12,479,606 US 12,528,608 US 12,545,447 US 12,572,153 US 12,643,696 US 12,649,593 US 12,668,383 US 12,673,792 US 12,692,029 US 12,703,525