IP Library Granted Patent US 9,835,453
Granted Patent B2
US 9,835,453 · App. 15/336,569 · Granted Dec 5, 2017

Ground control point assignment and determination system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,835,453
App. No.
15/336,569
Granted
Dec 5, 2017
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for ground control point assignment and determination. One of the methods includes receiving information describing a flight plan for the UAV to implement, the flight plan identifying one or more waypoints associated with geographic locations assigned as ground control points. A first waypoint identified in the flight plan is traveled to, and an action to designate a surface at the associated geographic location is designated as a ground control point. Location information associated with the designated surface is stored. The stored location information is provided to an outside system for storage.

Claims (64)

1. A ground control point marker comprising:

a top portion having a pattern thereon, the pattern configured to be recognizable in aerial images obtained by an unmanned aerial vehicle;

a Global Navigation Satellite System (GNSS) receiver, wherein the GNSS receiver obtains geospatial position information of a location where the ground control point marker is placed on a ground surface; and

a transmitter configured to wirelessly transmit the geospatial position information and an identifier of the ground control point marker to a separate computer system

wherein the top portion comprises a display with a plurality of lights, wherein the display is configured to display the pattern, and wherein the pattern comprises variable shapes, numbers, letters or figures.

2. The ground control point marker of claim 1 , wherein a shape of the ground control point marker is circular, square or rectangular.

3. The ground control point marker of claim 1 , wherein the display comprises an LED panel.

4. The ground control point marker of claim 1 , wherein the ground control point marker determines a distance to different ground control point markers, and in response to the distance being less than a threshold distance, the ground control point marker displays a pattern different from a pattern displayed on the different ground control point markers.

5. The ground control point marker of claim 1 , further comprising:

one or more sensors configured to determine information associated with the ground control point marker being level.

6. A method comprising:

placing a plurality of ground control point markers on a ground surface, each ground control point marker comprising:

a top portion having a pattern thereon, the pattern configured to be recognizable in aerial images obtained by an unmanned aerial vehicle;

a Global Navigation Satellite System (GNSS) receiver, wherein the GNSS receiver obtains geospatial position information of a location where the ground control point marker is placed on a ground surface; and

a transmitter configured to wirelessly transmit the geospatial position information and an identifier of the ground control point marker to a separate computer system,

wherein for at least one ground control point market, the top portion comprises a display configured to display the pattern, and wherein the pattern comprises variable shapes, numbers, letters or figures;

obtaining by the respective ground control point markers their respective geospatial position information; and

transmitting the respective geospatial position information and identifiers of each of the ground control point markers to a separate computer system.

7. The method of claim 6 , further comprising:

obtaining aerial images including images of the plurality of the ground control point markers; and

generating ortho-rectified imagery of the obtained aerial images using the geospatial position information of the ground control point markers.

8. The method of claim 6 , wherein a shape of a particular ground control point marker of the plurality of ground control point markers is circular, square or rectangular.

9. The method of claim 6 , wherein the pattern of a respective ground control marker is of a different pattern from the other ground control markers.

10. The method of claim 6 , wherein the display of the at least one ground control point marker comprises an LED panel.

11. The method of claim 6 , wherein a particular ground control point marker determines a distance to different ground control point markers, and in response to the distance being less than a threshold distance, the particular ground control point marker displays a pattern different from a pattern displayed on the different ground control point markers.

12. The method of claim 6 , wherein each ground control point marker further comprises:

one or more sensors configured to determine information associated with the ground control point marker being level.

13. An unmanned aerial vehicle (UAV) system comprising:

an unmanned aerial vehicle (UAV) comprising one or more processors, the UAV configured to:

place a ground control point marker on a surface, the ground control point marker being usable as a ground control point; and

the ground control point marker, the ground control point marker comprising:

an upper portion having a pattern thereon, the pattern being recognizable from an aerial view,

a Global Navigation Satellite System (GNSS) receiver, wherein the GNSS receiver obtains location information of the ground control point marker, and

a transmitter configured to receive the location information from the GNSS receiver and wirelessly transmit the location to the UAV,

wherein the upper portion comprises a display configured to display the pattern, and wherein the pattern comprises variable shapes, numbers, letters or figures.

14. The system of claim 13 , wherein the UAV is further configured to:

carry the ground control point marker to a waypoint;

descend towards the surface; and

place the ground control point marker on the surface at the waypoint.

15. The system of claim 13 , wherein the UAV is further configured to:

determine a level surface on which the UAV is to be placed; and

place the ground control point marker on the level surface.

16. The system of claim 13 ,

wherein the UAV is further configured to:

receive information, from the ground control point marker, indicating that the ground control point marker is on a level surface,

and wherein the ground control point marker further comprises:

one or more sensors configured to determine information associated with the ground control point marker being level.

17. An unmanned aerial vehicle (UAV) system comprising:

an unmanned aerial vehicle (UAV) comprising one or more processors, the UAV configured to:

place a ground control point marker on a surface,

determine, using a Global Navigation Satellite System (GNSS) receiver of the UAV, location information associated with the ground control point marker, and

provide the determined location information to an outside system for storage as being associated with a ground control point; and

the ground control point marker, the ground control point marker comprising:

an upper portion having a pattern thereon, the pattern being recognizable from an aerial view,

wherein the upper portion comprises a display configured to display the pattern, and wherein the pattern comprises variable shapes, numbers, letters or figures.

18. The system of claim 17 , wherein determining location information associated with the ground control point marker comprises:

navigating over the ground control point marker, and while navigating, receiving information indicating that the UAV is over a centroid of the ground control point marker, wherein the ground control point marker determines, using one or more sensors, a time at which the UAV is over the centroid; and

recording a timestamp associated with receiving the information.

19. The system of claim 18 , wherein the UAV obtains location information of the UAV while navigating over the ground control point marker, and wherein the UAV determines location information of the centroid of the ground control point marker based on the recorded timestamp.

20. The system of claim 17 , wherein the UAV is further configured to:

carry the ground control point marker to a waypoint;

descend towards the surface; and

place the ground control point marker on the surface at the waypoint.

21. The system of claim 17 , wherein the UAV comprises a Global Navigation Satellite System receiver, and wherein the receiver comprises a Real Time Kinetic (RTK) receiver or a Post Processing Kinetic (PPK) receiver.

Assignments (11)
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: HERCULES CAPITAL, INC.
To: SKYDIO, INC.
Reel/Frame 072128/0698 →
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
To: SKYDIO, INC.
Reel/Frame 072107/0066 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Nov 9, 2021
From: SKYDIO, INC.
To: HERCULES CAPITAL, INC., AS COLLATERAL AND ADMINISTRATIVE AGENT
Reel/Frame 058081/0677 →
SECURITY INTEREST Recorded Nov 8, 2021
From: SKYDIO, INC.
To: SILICON VALLEY BANK
Reel/Frame 058053/0768 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2020
From: KNOBBE, MARTENS, OLSON & BEAR, LLP
To: UNMANNED INNOVATION, INC.
Reel/Frame 053739/0789 →
RELEASE OF SECURITY INTEREST Recorded Jul 16, 2020
From: KNOBBE, MARTENS, OLSON & BEAR, LLC
To: AIRWARE, LLC
Reel/Frame 053234/0634 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CONVEYING PARTY DATA WAS ERRONEOUSLY ENTER AS UNMMANED INNOVATIONS, INC. IT SHOULD READ UNMANNED INNOVATIONS, INC PREVIOUSLY RECORDED AT REEL: 053144 FRAME: 0591. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 15, 2020
From: UNMANNED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 053210/0586 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: AIRWARE, LLC
To: SKYDIO, INC.
Reel/Frame 053144/0633 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: UNMMANED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 053144/0591 →
SECURITY INTEREST Recorded Dec 20, 2018
From: UNMANNED INNOVATION, INC.
To: KNOBBE, MARTENS, OLSON & BEAR, LLP
Reel/Frame 048681/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2016
From: MICHINI, BERNARD J.; BETHKE, BRETT MICHAEL; BLANC-PAQUES, FABIEN
To: UNMANNED INNOVATION, INC.
Reel/Frame 040201/0856 →