IP Library › Granted Patent US 10,984,552
Granted Patent B2
US 10,984,552 · App. 16/523,651 · Granted Apr 20, 2021

Method, apparatus, and system for recommending ground control points for image correction

Inventors: David Johnston Lawlor (Chicago, IL); Anish Mittal (San Francisco, CA); Zhanwei Chen (Richmond, CA)
Assignee: HERE Global B.V.
G06T7/74G01C11/34G06T7/80G06T7/97G06T2207/10032
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,984,552
App. No.
16/523,651
Granted
Apr 20, 2021
Kind
B2
Abstract

An approach is provided for automatically recommending ground control points or any other feature points for image correction (e.g., satellite image correction). The approach, for example, involves collecting a plurality of images depicting a geographic area of interest. The approach also involves processing the plurality of images to detect one or more candidate feature points (e.g., ground control points or other features detectable in the images). The approach further involves performing a feature correspondence of the one or more candidate feature points across the plurality of images. The approach also involves triangulating respective locations of the one or more candidate feature points based on the feature correspondence. The approach further involves filtering the one or more candidate feature points based on the respective locations. The approach further involves providing the filtered one or more candidate feature points as an output comprising one or more recommended feature points.

Claims (56)

1. A method comprising:

collecting a plurality of images depicting a geographic area of interest;

processing the plurality of images to detect one or more candidate ground control points;

performing a feature correspondence of the one or more candidate ground control points across the plurality of images;

triangulating respective locations of the one or more candidate ground control points based on the feature correspondence;

filtering the one or more candidate ground control points based on the respective locations; and

providing the filtered one or more candidate ground control points as an output comprising one or more recommended ground control points.

2. The method of claim 1 , wherein the filtering of the one or more candidate ground control points comprises filtering out the one or more candidate ground control points associated with the respective locations determined to be within an area that is outside of a collectible range.

3. The method of claim 1 , wherein the filtering of the one or more candidate ground control points comprises filtering out the one or more candidate ground control points associated with the respective locations determined to be within an area that has a positioning accuracy below a threshold accuracy.

4. The method of claim 1 , further comprising:

determining a number of the one or more candidate ground control points,

wherein the filtering of the one or more candidate ground control points is further based on the number.

5. The method of claim 1 , further comprising:

determining a geographic distribution of the one or more candidate ground control points for a camera model adjustment,

wherein the filtering of the one or more candidate ground control points is further based on the geographic distribution.

6. The method of claim 5 , wherein the camera model adjustment comprises adjusting one or more camera pose parameters, optical characteristic parameters, or a combination thereof of at least one camera used to capture the plurality of images.

7. The method of claim 5 , wherein the geographic distribution maximizes respective geographic distances between the one or more sampled candidate ground control points.

8. The method of claim 5 , wherein the geographic distribution distributes the one or more sampled candidate ground control points around a boundary of the geographic area of interest.

9. The method of claim 1 , further comprising:

initiating a sampling of the one or more recommended ground control points in the output; and

reporting the respective locations, corresponding images of the plurality of images, or a combination thereof of the sampled one or more recommended ground control points.

10. The method of claim 9 , further comprising:

retrieving a set of the plurality of images within a threshold distance of the reported respective locations based on determining that the plurality of images is from a source with a location accuracy above a threshold accuracy; and

initiating a detection, a marking, or a combination thereof of the sampled one or more recommended ground control points in the set of the plurality of images.

11. The method of claim 1 , wherein the plurality of images includes top-down imagery.

12. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

collect a plurality of images depicting a geographic area of interest;

process the plurality of images to detect one or more candidate feature points;

perform a feature correspondence of the one or more candidate feature points across the plurality of images;

triangulate respective locations of the one or more candidate feature points based on the feature correspondence;

filter the one or more candidate feature points based on the respective locations; and

provide the filtered one or more candidate feature points as an output comprising one or more recommended feature points.

13. The apparatus of claim 12 , wherein the filter of the one or more candidate feature points comprises filtering out the one or more candidate feature points associated with the respective locations determined to be within an area that is outside of a collectible range.

14. The apparatus of claim 12 , wherein the filter of the one or more candidate feature points comprises filtering out the one or more candidate feature points associated with the respective locations determined to be within an area that has a positioning accuracy below a threshold accuracy.

15. The apparatus of claim 12 , wherein the apparatus is further caused to:

determine a number of the one or more candidate feature points,

wherein the filter of the one or more candidate feature points is further based on the number.

16. The apparatus of claim 12 , wherein the apparatus is further caused to:

determine a geographic distribution of the one or more candidate feature points for a camera model adjustment,

wherein the filter of the one or more candidate feature points is further based on the geographic distribution.

17. A non-transitory computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the following steps:

collecting a plurality of top-down images depicting a geographic area of interest;

processing the plurality of top-down images to detect one or more candidate ground control points;

performing a feature correspondence of the one or more candidate ground control points across the plurality of top-down images;

triangulating respective locations of the one or more candidate ground control points based on the feature correspondence;

filtering the one or more candidate ground control points based on the respective locations; and

providing the filtered one or more candidate ground control points as an output comprising one or more recommended ground control points.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the filtering of the one or more candidate ground control points comprises filtering out the one or more candidate ground control points associated with the respective locations determined to be within an area that is outside of a collectible range.

19. The non-transitory computer-readable storage medium of claim 17 , wherein the filtering of the one or more candidate ground control points comprises filtering out the one or more candidate ground control points associated with the respective locations determined to be within an area that has a positioning accuracy below a threshold accuracy.

20. The non-transitory computer-readable storage medium of claim 17 , wherein the apparatus is further caused to perform:

determining a number of the one or more candidate ground control points; and

determining a geographic distribution of the one or more candidate ground control points for a camera model adjustment,

wherein the filtering of the one or more candidate ground control points is further based on the number and the geographic distribution.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2019
From: LAWLOR, DAVID JOHNSTON; MITTAL, ANISH; CHEN, ZHANWEI
To: HERE GLOBAL B.V.
Reel/Frame 049890/0904 →
Continuity (1)
Related Publication 20210027487A1 · Jan 28, 2021