IP Library Granted Patent US 12,033,350
Granted Patent B2
US 12,033,350 · App. 18/064,982 · Granted Jul 9, 2024

Ground control point center determination

Inventor: Damien Grosgeorge (Paris, FR)
Assignee: Skydio, Inc.
G06T7/73G06T7/74G06V10/82G06V20/13G06V20/17G01C11/00G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,033,350
App. No.
18/064,982
Granted
Jul 9, 2024
Kind
B2
Abstract

Methods, systems and apparatus, including computer programs encoded on computer storage media for determining a center location of a ground control point used in aerial surveys. Machine learning models are used to identify in digital images pixel coordinates of the ground control point identified in the digital images. These image pixel coordinates are used in photogrammetric processing and software.

Claims (45)

1. A computing apparatus comprising:

one or more computer-readable storage media; and

program instructions stored on the one or more computer-readable storage media that, when executed by one or more processors, direct an aerial vehicle to a least:

segment digital images obtained by the aerial vehicle into one or more groups corresponding to one or more ground control point depicted in the digital images;

identify a center location of a ground control point in a particular digital image of at least one of the one or more groups; and

determine a pixel coordinate of the center location of the ground control point.

2. The computing apparatus of claim 1 , wherein the program instructions, when executed by the one or more processors, are further configured to direct the aerial vehicle to:

generate a dataset including the pixel coordinate identifying the center location of the ground control point in the particular digital image.

3. The computing apparatus of claim 1 , wherein the program instructions, when executed by the one or more processors, are further configured to direct the aerial vehicle to:

associating the determined pixel coordinate with a geo-spatial location of the ground control point.

4. The computing apparatus of claim 1 , wherein at least one digital image of the digital images has an associated geo-spatial coordinate indicating a location of where the digital image was captured by the aerial vehicle.

5. The computing apparatus of claim 1 , wherein at least one digital image of the digital images has an associated yaw, pitch, and roll value of the aerial vehicle at the time when the aerial vehicle captured the digital image.

6. The computing apparatus of claim 1 , wherein the program instructions, when executed by the one or more processors, are further configured to direct the aerial vehicle to:

generate a geo-rectified 3D model, or composite image, based on the digital images using the pixel coordinate.

7. The computing apparatus of claim 1 , wherein the program instructions, when executed by the one or more processors, are further configured to direct the aerial vehicle to:

determine a quality score associated with the particular digital image; and

discard the particular digital image from determining a pixel coordinate if the quality score does not meet a threshold value.

8. A method comprising:

segmenting digital images obtained by an aerial vehicle into groups corresponding to one or more ground control points depicted in the digital images;

identifying a center location of a ground control point in a particular digital image of at least one of the groups; and

determining a pixel coordinate of the center location of the ground control point.

9. The method of claim 8 , further comprising:

generating a dataset including the pixel coordinate that identifies the center location of the ground control point in the particular digital image.

10. The method of claim 8 , further comprising:

associating the determined pixel coordinate with a geo-spatial location of the ground control point.

11. The method of claim 8 , wherein at least one digital image of the digital images has an associated geo-spatial coordinate indicating a location where the digital image was captured by the aerial vehicle.

12. The method of claim 8 , wherein at least one digital image of the digital images has an associated yaw, pitch, and roll value of the aerial vehicle at the time when the aerial vehicle captured the digital image.

13. The method of claim 8 , further comprising:

generating a geo-rectified 3D model, or composite image, based on the digital images using the pixel coordinate.

14. The method of claim 8 , further comprising:

determining a quality score associated with the particular digital image; and

discarding the particular digital image from determining a pixel coordinate if the quality score does not meet a threshold value.

15. An aerial vehicle comprising:

a processing system configured to:

segment digital images obtained by the aerial vehicle into groups, wherein a group includes digital images for a particular control point;

identify a center location of a ground control point in a particular digital image; and

determine a pixel coordinate of the center location of the ground control point.

16. The aerial vehicle of claim 15 , wherein the processing system is further configured to:

generate a dataset including the pixel coordinate identifying the center location of the ground control point in the particular digital image.

17. The aerial vehicle of claim 15 , wherein the processing system is further configured to:

associate the determined pixel coordinate with a geo-spatial location of the ground control point.

18. The aerial vehicle of claim 15 , wherein at least one digital image of the digital images has an associated geo-spatial coordinate indicating a location of where the digital image was captured by the aerial vehicle.

19. The aerial vehicle of claim 15 , wherein at least one digital image of the digital images has an associated yaw, pitch and roll value of the aerial vehicle at the time when the aerial vehicle captured the digital image.

20. The aerial vehicle of claim 15 , wherein the processing system is further configured to:

generating a 3D surface model, or a composite image, based on the digital images using the pixel coordinate.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2023
From: GROSGEORGE, DAMIEN
To: UNMANNED INNOVATION INC.
Reel/Frame 062748/0309 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2023
From: UNMANNED INNOVATION INC.
To: AIRWARE, LLC
Reel/Frame 062748/0449 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2023
From: AIRWARE, LLC
To: SKYDIO, INC.
Reel/Frame 062748/0625 →
Continuity (4)
Continuation 17206031 · Mar 18, 2021
Continuation 15971470 · May 4, 2018
Provisional Application 62501401 · May 4, 2017
Related Publication 20230186511A1 · Jun 15, 2023