IP Library Granted Patent US 11,557,057
Granted Patent B2
US 11,557,057 · App. 17/206,031 · Granted Jan 17, 2023

Ground control point center determination

Inventor: Damien Grosgeorge (Paris, FR)
Assignee: Skydio, Inc.
G06T7/74G06V20/13G01C11/00G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,557,057
App. No.
17/206,031
Granted
Jan 17, 2023
Kind
B2
Abstract

Methods, systems and apparatus, including computer programs encoded on computer storage media for determining a center location of a ground control point used in aerial surveys. Machine learning models are used to identify in digital images pixel coordinates of the ground control point identified in the digital images. These image pixel coordinates are used in photogrammetric processing and software.

Claims (51)

1. A system comprising one or more processors comprising hardware, the one or more processors configured to perform the operations comprising:

receiving geo-spatial locations of one or more ground control points used in an aerial survey;

receiving digital images obtained by an unmanned aerial vehicle (UAV), the digital images including an aerial view depicting at least one of the ground control points; segmenting the digital images into one or more groups, wherein a group includes digital images for a particular ground control point;

processing each group of digital images, the processing comprising:

identifying a center location of a ground control point in a particular image; and

determining a pixel coordinate of the center location of the ground control point; and

performing photogrammetric processing on the received digital images using the determined pixel coordinates of the ground control points identified in the digital images.

2. The system of claim 1 , the operations further comprising:

generating a dataset including the pixel coordinate identifying the center location of a ground control point found in the image.

3. The system of claim 1 , the operations further comprising:

associating the determined pixel coordinate with a geo-spatial location of a ground control point.

4. The system of claim 1 , wherein each digital image has an associated geo-spatial coordinate of where the digital image was taken by the UAV.

5. The system of claim 1 , wherein each digital image has an associated yaw, pitch and roll value of the UAV, when the UAV captured the respective digital image.

6. The system of claim 1 , the operations further comprising:

generating a geo-rectified 3D model, or composite image, based on the aerial images using the pixel coordinates of the ground control points.

7. The system of claim 1 , the operations further comprising:

determining a quality score of the image, and discarding the image from determining a pixel coordinate if the quality score does not a threshold value.

8. A computerized method performed by a system comprising one or more processors, the method comprising:

receiving geo-spatial locations of one or more ground control points used in an aerial survey;

receiving digital images obtained by an unmanned aerial vehicle (UAV), the digital images including an aerial view depicting at least one of the ground control points;

segmenting the digital images into groups, wherein a group includes digital images for a particular ground control point;

processing each group of digital images, the processing comprising:

identifying a center location of a ground control point in a particular image; and

determining a pixel coordinate of the center location of the ground control point; and

performing photogrammetric processing on the received digital images using the determined pixel coordinates of the ground control points identified in the digital images.

9. The method of claim 8 , further comprising:

generating a dataset including the pixel coordinate identifying the center location of a ground control point found in the image.

10. The method of claim 8 , further comprising:

associating the determined pixel coordinate with a geo-spatial location of a ground control point.

11. The method of claim 8 , wherein each digital image has an associated geo-spatial coordinate of where the digital image was taken by the UAV.

12. The method of claim 8 , wherein each digital image has an associated yaw, pitch and roll value of the UAV, when the UAV captured the respective digital image.

13. The method of claim 8 , further comprising:

generating a geo-rectified 3D model, or composite image, based on the aerial images using the pixel coordinates of the ground control points.

14. The method of claim 8 , further comprising:

determining a quality score of the image, and discarding the image from determining a pixel coordinate if the quality score does not a threshold value.

15. A non-transitory computer storage medium comprising instructions that when executed by one or more processors, cause the processors to perform operations comprising:

receiving geo-spatial locations of one or more ground control points used in an aerial survey;

receiving digital images obtained by an unmanned aerial vehicle (UAV), the digital images including an aerial view depicting at least one of the ground control points;

segmenting the digital images into groups, wherein a group includes digital images for a particular ground control point;

processing each group of digital images, the processing comprising:

identifying a center location of a ground control point in a particular image; and

determining a pixel coordinate of the center location of the ground control point; and

performing photogrammetric processing on the received digital images using the determined pixel coordinates of the ground control points identified in the digital images.

16. The non-transitory computer storage medium of claim 15 , the operations further comprising:

generating a dataset including the pixel coordinate identifying the center location of a ground control point found in the image.

17. The non-transitory computer storage medium of claim 15 , the operations further comprising:

associating the determined pixel coordinate with a geo-spatial location of a ground control point.

18. The non-transitory computer storage medium of claim 15 , wherein each digital image has an associated geo-spatial coordinate of where the digital image was taken by the UAV.

19. The non-transitory computer storage medium of claim 15 , wherein each digital image has an associated yaw, pitch and roll value of the UAV, when the UAV captured the respective digital image.

20. The non-transitory computer storage medium of claim 15 , the operations further comprising:

generating a 3D surface model, or a composite image, based on the aerial images using the determined pixel coordinates of the ground control points.

Assignments (7)
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: HERCULES CAPITAL, INC.
To: SKYDIO, INC.
Reel/Frame 072128/0698 →
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
To: SKYDIO, INC.
Reel/Frame 072107/0066 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2023
From: UNMANNED INNOVATION INC.
To: AIRWARE, LLC
Reel/Frame 062748/0449 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2023
From: AIRWARE, LLC
To: SKYDIO, INC.
Reel/Frame 062748/0625 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2023
From: GROSGEORGE, DAMIEN
To: UNMANNED INNOVATION INC.
Reel/Frame 062748/0309 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Nov 9, 2021
From: SKYDIO, INC.
To: HERCULES CAPITAL, INC., AS COLLATERAL AND ADMINISTRATIVE AGENT
Reel/Frame 058081/0677 →
SECURITY INTEREST Recorded Nov 8, 2021
From: SKYDIO, INC.
To: SILICON VALLEY BANK
Reel/Frame 058053/0768 →
Continuity (3)
Continuation 15971470 · May 4, 2018
Provisional Application 62501401 · May 4, 2017
Related Publication 20210407126A1 · Dec 30, 2021