IP Library Granted Patent US 11,421,990
Granted Patent B2
US 11,421,990 · App. 15/829,477 · Granted Aug 23, 2022

Ground control point assignment and determination system

Inventors: Bernard J. Michini (San Francisco, CA); Brett Michael Bethke (Millbrae, CA); Fabien Blanc-Paques (San Francisco, CA)
Assignee: Skydio, Inc.
G01C15/06B64C39/024G01C15/02G05D1/0011G05D1/0094G08G5/003G08G5/0013G08G5/0034G08G5/0069B64C2201/027B64C2201/123B64C2201/126B64C2201/128B64C2201/14B64C2201/146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,421,990
App. No.
15/829,477
Granted
Aug 23, 2022
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for ground control point assignment and determination. One of the methods includes receiving information describing a flight plan for the UAV to implement, the flight plan identifying one or more waypoints associated with geographic locations assigned as ground control points. A first waypoint identified in the flight plan is traveled to, and an action to designate a surface at the associated geographic location is designated as a ground control point. Location information associated with the designated surface is stored. The stored location information is provided to an outside system for storage.

Claims (59)

1. A computerized method comprising:

receiving information describing a flight plan for an inspection of a property using an unmanned aerial vehicle (UAV), the flight plan identifying one or more waypoints proximate to the property;

prior to the inspection of the property, for each of the one or more waypoints:

navigating the UAV to the waypoint;

placing, by the UAV, a physical marker onto a surface at the waypoint to form an identifiable mark on the surface; and

determining a geographic location of the identifiable mark; and

capturing, using a camera of the UAV during the inspection of the property, images usable to generate rectified images associated with the inspection of the property based on the geographic locations of the identifiable marks.

2. The computerized method of claim 1 , wherein the physical marker includes fluid and placing the physical marker onto the surface comprises:

rotating a spray nozzle coupled to the UAV in a circular fashion while spraying the fluid onto the surface.

3. The computerized method of claim 1 , wherein the physical marker includes fluid and placing the physical marker onto the surface comprises:

spraying, by the UAV, the fluid in a first color onto the surface, and

spraying, by the UAV, the fluid in a second color onto the surface.

4. The computerized method of claim 1 , wherein the identifiable mark is a predetermined shape comprising one or more of a circle, x-pattern, sphere, or cross-hatch.

5. The computerized method of claim 1 , wherein the UAV comprises one or more receptacles housing one or more fluid containers and one or more actuators coupled to the fluid containers.

6. The computerized method of claim 1 , further comprising:

providing the captured images and stored location information to a photogrammetry system for processing.

7. The computerized method of claim 1 , further comprising:

receiving, via a user interface, input specifying selections of one or more locations;

determining the flight plan for the UAV based on the one or more locations; and

transmitting, to the UAV, flight information including the flight plan via a wireless or wired connection.

8. An apparatus, comprising:

one or more processors; and

one or more non-transitory storage media storing instructions that, when executed by the one or more processors, cause the one or more processors to:

receive information describing a flight plan for an inspection of a property using an unmanned aerial vehicle (UAV), the flight plan identifying one or more waypoints proximate to the property;

prior to the inspection, for each of the one or more waypoints:

navigate the UAV to the waypoint; and

place, by the UAV, a physical marker onto a surface at the waypoint to form an identifiable mark on the surface; and

capture, using a camera of the UAV during the inspection, images usable to generate rectified images associated with the inspection of the property based on geographic locations of the identifiable marks.

9. The apparatus of claim 8 , wherein the physical marker includes fluid and the instructions to place the physical marker onto the surface include instructions that, when executed by the one or more processors, cause the one or more processors to:

rotate a spray nozzle coupled to the UAV in a circular fashion while spraying the fluid onto the surface.

10. The apparatus of claim 8 , wherein the physical marker includes fluid and the instructions to place the physical marker onto the surface include instructions that, when executed by the one or more processors, cause the one or more processors to:

spray, by the UAV, the fluid in a first color onto the surface; and

spray, by the UAV, the fluid in a second color onto the surface.

11. The apparatus of claim 8 , wherein the identifiable mark is a predetermined shape comprising one or more of a circle, x-pattern, sphere or cross-hatch.

12. The apparatus of claim 8 , wherein the UAV comprises one or more receptacles housing one or more fluid containers and one or more actuators coupled to the fluid containers.

13. The apparatus of claim 8 , wherein the instructions include instructions that, when executed by the one or more processors, cause the one or more processors to:

provide the captured images and stored location information to a photogrammetry system for processing.

14. The apparatus of claim 8 , wherein the instructions include instructions that, when executed by the one or more processors, cause the one or more processors to:

receive, via a user interface, input specifying selections of one or more locations;

determine the flight plan for the UAV based on the one or more; and

transmit, to the UAV, flight information including the flight plan via a wireless or wired connection.

15. A non-transitory computer storage medium storing instructions that, when executed by one or more processors, facilitate a performance of operations, the operations comprising:

receiving information describing a flight plan for an inspection of a property using an unmanned aerial vehicle (UAV), the flight plan identifying one or more waypoints;

for each of the one or more waypoints:

navigating the UAV to the waypoint; and

placing, by the UAV, a physical marker onto a surface at the waypoint to form an identifiable mark on the surface; and

capture, using a camera of the UAV, images associated with the inspection of the property based on geographic locations of the identifiable marks.

16. The non-transitory computer storage medium of claim 15 , wherein the physical marker includes fluid and the operations for placing the physical marker onto the surface include operations comprising:

rotating a spray nozzle coupled to the UAV in a circular fashion while spraying the fluid onto the surface.

17. The non-transitory computer storage medium of claim 15 , wherein the physical marker includes fluid and the operations for placing the physical marker onto the surface include operations comprising:

spraying, by the UAV, the fluid in a first color onto the surface, and

spraying, by the UAV, the fluid in a second color onto the surface.

18. The non-transitory computer storage medium of claim 15 , wherein the identifiable mark is a predetermined shape comprising one or more of a circle, x-pattern, sphere, or cross-hatch.

19. The non-transitory computer storage medium of claim 15 , the operations further comprising:

providing the captured images and stored location information to a photogrammetry system for processing.

20. The non-transitory computer storage medium of claim 15 , the operations further comprising:

receiving, via a user interface, input specifying selections of one or more locations;

determining the flight plan for the UAV based on the one or more locations; and

transmitting, to the UAV, flight information including the flight plan via a wireless or wired connection.

Assignments (11)
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
To: SKYDIO, INC.
Reel/Frame 072107/0066 →
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: HERCULES CAPITAL, INC.
To: SKYDIO, INC.
Reel/Frame 072128/0698 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 13, 2022
From: MICHINI, BERNARD J.; BETHKE, BRETT MICHAEL; BLANC-PAQUES, FABIEN
To: UNMANNED INNOVATION, INC.
Reel/Frame 059899/0498 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Nov 9, 2021
From: SKYDIO, INC.
To: HERCULES CAPITAL, INC., AS COLLATERAL AND ADMINISTRATIVE AGENT
Reel/Frame 058081/0677 →
SECURITY INTEREST Recorded Nov 8, 2021
From: SKYDIO, INC.
To: SILICON VALLEY BANK
Reel/Frame 058053/0768 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2020
From: KNOBBE, MARTENS, OLSON & BEAR, LLP
To: UNMANNED INNOVATION, INC.
Reel/Frame 053739/0789 →
RELEASE OF SECURITY INTEREST Recorded Jul 16, 2020
From: KNOBBE, MARTENS, OLSON & BEAR, LLC
To: AIRWARE, LLC
Reel/Frame 053234/0634 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CONVEYING PARTY DATA WAS ERRONEOUSLY ENTER AS UNMMANED INNOVATIONS, INC. IT SHOULD READ UNMANNED INNOVATIONS, INC PREVIOUSLY RECORDED AT REEL: 053144 FRAME: 0591. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 15, 2020
From: UNMANNED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 053210/0586 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: UNMMANED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 053144/0591 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: AIRWARE, LLC
To: SKYDIO, INC.
Reel/Frame 053144/0633 →
SECURITY INTEREST Recorded Dec 20, 2018
From: UNMANNED INNOVATION, INC.
To: KNOBBE, MARTENS, OLSON & BEAR, LLP
Reel/Frame 048681/0001 →