IP Library Granted Patent US 10,223,816
Granted Patent B2
US 10,223,816 · App. 14/622,026 · Granted Mar 5, 2019

Method and apparatus for generating map geometry based on a received image and probe data

Inventors: Ole Henry Dorum (Chicago, IL); Ian Endres (Naperville, IL)
Assignee: HERE Global B.V.
G06T11/20G01C11/04G01C21/32G06K9/00651
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,223,816
App. No.
14/622,026
Granted
Mar 5, 2019
Kind
B2
Abstract

A method, apparatus and computer program product are provided for generating map geometry based on a received image and probe data. A method is provided including receiving a first image and probe data associated with the first image, categorizing pixels of the first image based on the probe data, and generating a map geometry based on the pixel categorization of the first image.

Claims (59)

1. A method comprising: receiving, by at least one processor, a first image associated with image location data, wherein the first image was captured by an image capturing device; receiving, by the at least one processor, a plurality of instances of probe data, wherein (a) each instance of the probe data comprises probe location data determined by a positioning system of a mobile device, (b) the mobile device is coupled to a vehicle, and (c) the image capturing device is a distinct device from the mobile device and the image capturing device is not coupled to the vehicle;

associating, by the at least one processor, the plurality of instances of probe data with the first image based on the probe location data correlating to at least a portion of the image location data;

correlating, by the at least one processor, each instance of probe data with at least one pixel of the first image based on the image location data and the probe location data corresponding to the instance of probe data;

generating, by the at least one processor, a probe data density map indicating; a probe data density of one or more pixels of the first image based on the correlation of the one or more instances of probe data with pixels of the first image, wherein the probe data density of a pixel of the first image corresponds to a number of instances of probe data that are correlated with the pixel;

categorizing, by the at least one processor, pixels of the first image based on the correlation of instances of probe data with the pixels and the probe data density map; and

generating, by the at least one processor; a map geometry based on pixel categorization of the first image.

2. The method of claim 1 further comprising:

receiving a second image;

categorizing pixels of the second image based on the categorization of the pixels of the first image; and

generating a map geometry based on pixel categorization of the second image.

3. The method of claim 1 , further comprising;

determining a target center based on probe data density, and

wherein the categorizing pixels is based on the target center.

4. The method of claim 1 , wherein the categorizing pixels comprises categorizing pixels as target pixels and non-target pixels.

5. The method of claim 1 further comprising:

determining a target confidence value of pixels of the first image based on the probe data, and

wherein the categorizing pixels is based on the target confidence value of the respective pixel satisfying a predetermined target confidence value threshold.

6. The method of claim 1 , further comprising:

updating or generating map data based on the map geometry.

7. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and computer program code configured to, with the processor, cause the apparatus to at least:

receive a first image associated with image location data, wherein the first image was captured by an image capturing device;

receive a plurality of instances of probe data, wherein (a) each instance of the probe data comprises probe location data determined by a positioning system of a mobile device, (b) the mobile device is coupled to a vehicle, and (c) the image capturing device is a distinct device from the mobile device and the image capturing device is not coupled to the vehicle;

associate the plurality of instances of probe data with the first image based on the probe location data correlating to at least a portion of the image location data;

correlate each instance of probe data with at least one pixel of the first image based on the image location data and the probe location data corresponding to the instance of probe data;

generate a probe data density map indicating a probe data density of one or more pixels of the first image based on the correlation of the one or more instances of probe data with pixels of the first image, wherein the probe data density of a pixel of the first image corresponds to a number of instances of probe data that are correlated with the pixel;

categorize pixels of the first image based on the correlation of instances of probe data with the pixels and the probe data density map; and

generate a map geometry based on pixel categorization of the first image.

8. The apparatus of claim 7 , wherein the at least one memory and the computer program code are further configured to:

receive a second image;

categorize pixels of the second image based on the categorization of the pixels of the first image; and

generate a map geometry based on pixel categorization of the second image.

9. The apparatus of claim 7 , wherein the at least one memory and the computer program code are further configured to:

determine a target center based on probe data density, and

wherein the categorizing pixels is based on the target center.

10. The apparatus of claim 7 , wherein the categorizing pixels comprises categorizing pixels as target pixels and non-target pixels.

11. The apparatus of claim 7 , wherein the at least one memory and the computer program code are further configured to:

determine a target confidence value of pixels of the first image based on the probe data, and

wherein the categorizing pixels is based on the target confidence value of the respective pixel satisfying a predetermined target confidence value threshold.

12. The apparatus of claim 7 , wherein the at least one memory and the computer program code are further configured to:

update or generate map data based on the map geometry.

13. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-executable program code portions stored therein, the computer-executable program code portions comprising program code instructions configured to:

receive a first image associated with image location data, wherein the first image was captured by an image capturing device;

receive a plurality of instances of probe data, wherein (a) each instance of the probe data comprises probe location data determined by a positioning system of a mobile device, (b) the mobile device is coupled to a vehicle, and (c) the image capturing device is a distinct device from the mobile device and the image capturing device is not coupled to the vehicle;

associate the plurality of instances of probe data with the first image based on the probe location data correlating to at least a portion of the image location data;

correlate each instance of probe data with at least one pixel of the first image based on the image location data and the probe location data corresponding to the instance of probe data;

generate a probe data density map indicating a probe data density of one or more pixels of the first image based on the correlation of the one or more instances of probe data with pixels of the first image, wherein the probe data density of a pixel of the first image corresponds to a number of instances of probe data that are correlated with the pixel;

categorize pixels of the first image based on the correlation of instances of probe data with the pixels and the probe data density map; and

generate a map geometry based on pixel categorization of the first image.

14. The computer program product of claim 13 , wherein the computer-executable program code portions further comprise program code instructions configured to:

receive a second image;

categorize pixels of the second image based on the categorization of the pixels of the first image; and

generate a map geometry based on pixel categorization of the second image.

15. The computer program product of claim 13 , wherein the computer-executable program code portions further comprise program code instructions configured to:

determine a target center based on probe data density, and

wherein the categorizing pixels is based on the target center.

16. The computer program product of claim 13 , wherein the categorizing pixels comprises categorizing pixels as target pixels and non-target pixels.

17. The computer program product of claim 13 , wherein the computer-executable program code portions further comprise program code instructions configured to:

determine a target confidence value of pixels of the first image based on the probe data, and

wherein the categorizing pixels is based on is based on the target confidence value of the respective pixel satisfying a predetermined target confidence value threshold.

Assignments (3)
CHANGE OF ADDRESS Recorded Apr 4, 2017
From: HERE GLOBAL B.V.
To: HERE GLOBAL B.V.
Reel/Frame 042153/0445 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE CITY PREVIOUSLY RECORDED AT REEL: 034960 FRAME: 0391. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 21, 2015
From: DORUM, OLE HENRY; ENDRES, IAN
To: HERE GLOBAL B.V.
Reel/Frame 035475/0107 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2015
From: DORUM, OLE HENRY; ENDRES, IAN
To: HERE GLOBAL B.V.
Reel/Frame 034960/0391 →
Continuity (1)
Related Publication 20160239983A1 · Aug 18, 2016