IP Library Granted Patent US 12,406,332
Granted Patent B2
US 12,406,332 · App. 17/940,648 · Granted Sep 2, 2025

Method, apparatus, user interface, and computer program product for identifying map objects or road attributes based on imagery

Inventors: Amarnath Nayak (Mumbai, IN); Sandeep Belgaonkar (Thane, IN)
Assignee: HERE GLOBAL B. V.
G06T5/50G06F16/29G06V20/10G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,332
App. No.
17/940,648
Granted
Sep 2, 2025
Kind
B2
Abstract

A method, apparatus, user interface, and computer program product are provided to receive an aerial image of a geographic region, identify at least one potential map object within the aerial image, determine at least one shadow area associated with the at least one potential map object within the aerial image, identify at least one camera proximate to the location of the at least one potential map object, capture image data of the area proximate to the least one potential map object via the at least one camera, and generate location data for the at least one map object or a road attribute based at least in part on the aerial image and image data of the area proximate to the least one potential map object or road attribute.

Claims (26)

1. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and computer program code configured to, with the processor, cause the apparatus to at least:

receive an aerial image of a geographic region;

identify at least one potential map object within the aerial image;

determine at least one shadow area associated with the at least one potential map object within the aerial image;

identify at least one traffic camera proximate to the location of the at least one potential map object;

capture proximate image data of the least one potential map object via the at least one traffic camera;

generate location data for the at least one map object based at least in part on the aerial image and proximate image data of the least one potential map object, and

generate routing data in response to the location data generated for at least one map object, wherein the routing data generated is used to navigate an autonomous vehicle to the geographic region within which the potential map object has been located.

2. The apparatus of claim 1 , wherein the aerial image of the geographic region comprises an image of a portion of a building, wherein causing the apparatus to identify objects within the aerial image comprises causing the apparatus to identify rooftop objects on a roof of the building within the aerial image.

3. The apparatus of claim 2 , wherein causing the apparatus to determine shadow areas associated with the map objects within the aerial image comprises causing the apparatus to determine shadow areas associated with the rooftop objects based, at least in part, on image analysis of the rooftop objects.

4. The apparatus of claim 1 , wherein at least one camera is an automated vehicle camera or drone camera.

5. The apparatus of claim 1 , wherein the apparatus, in response to the location data generated for at least one map object, generates alerts.

6. The apparatus of claim 1 , wherein the autonomous vehicle's camera system is used to capture additional image data of the area proximate to the potential map object.

7. The apparatus claim 6 , wherein the apparatus generates the location data for at least one map object or road attribute from image data captured by at least two cameras.

8. The apparatus of claim 1 , wherein the location of at least one road attribute is identified within one shadow area associated with the at least one potential map object by image analysis of the proximate image data of the least one potential map object.

9. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-executable program code portions stored therein, the computer-executable program code portions comprising program code instructions configured to:

receive an aerial image of a geographic region;

identify at least one potential map object within the aerial image;

determine at least one shadow area associated with the at least one potential map object within the aerial image;

identify at least one traffic camera proximate to the location of the at least one potential map object;

capture proximate image data of the area of the at least one potential map object via the at least one traffic camera; and

generate location data for the at least one map object or a road attribute based at least in part on the aerial image and proximate image data of the area of the least one potential map object, and

generate routing data in response to the location data generated for at least one map object, wherein the routing data generated is used to navigate an autonomous vehicle to the geographic region within which the potential map object has been located.

10. The computer program product of claim 9 , wherein the aerial image of the geographic region comprises an image of a building, wherein the program code instructions to identify objects within the aerial image comprise program code instructions to identify rooftop objects on a roof of the building within the aerial image.

11. The computer program product of claim 10 , wherein the program code instructions to determine shadow areas associated with the objects within the aerial image comprise program code instructions to determine shadow areas associated with the rooftop objects based on image analysis of the rooftop objects.

12. The computer program product of claim 9 , wherein the program code instructions configured to generate location data, in response to the location data generated for at least one map object or road attribute, further utilize the location data to generate routing data and alerts.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 10, 2022
From: NAYAK, AMARNATH; BELGAONKAR, SANDEEP
To: HERE GLOBAL B.V.
Reel/Frame 061054/0955 →
Continuity (1)
Related Publication 20240087092A1 · Mar 14, 2024
References Cited (16)
US 10089529B2 · Larson · 2018 [cited by examiner]
US 11669998B2 · Lee · 2023 [cited by examiner]
US 20100254595A1 · Miyamoto · 2010 [cited by examiner]
US 20150324989A1 · Smith · 2015 [cited by examiner]
US 20190164313A1 · Ma · 2019 [cited by examiner]
US 20210208601A1 · Di Loreto · 2021 [cited by examiner]
CN 113538357A · 2021 [cited by applicant]
DE 102017001814A1 · 2019 [cited by applicant]
EP 1975565B1 · 2018 [cited by applicant]
WO WO2012034637A1 · 2012 [cited by applicant]
He Y, Ma L, Cui J, Yan Z, Xing G, Wang S, Hu Q, Pan C. AutoMatch: Leveraging Traffic Camera to Improve Perception and Localization of Autonomous Vehicles. InProceedings of the 20th ACM Conference on Embedded Networked S… [cited by examiner]
Ibarra-Arenado M, Tjahjadi T, Pérez-Oria J, Robla-Gómez S, Jiménez-Avello A. Shadow-based vehicle detection in urban traffic. Sensors. Apr. 27, 2017;17(5):975. (Year: 2017). [cited by examiner]
Zhu M, Zhang S, Zhong Y, Lu P. Peng H, Lenneman J. Monocular 3d vehicle detection using uncalibrated traffic cameras through homography. In2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) … [cited by examiner]
Leitloff J, Rosenbaum D, Kurz F, Meynberg O, Reinartz P. An operational system for estimating road traffic information from aerial images. Remote Sensing. Nov. 13, 2014;6(11):11315-41. (Year: 2014). [cited by examiner]
Karaduman M, Cinar A, Eren H. UAV traffic patrolling via road detection and tracking in anonymous aerial video frames. Journal of Intelligent & Robotic Systems. Aug. 15, 2019;95(2):675-90. (Year: 2019). [cited by examiner]
Barra-Arenado, et al., “Shadow Detection in Still Road Images Using Chrominance Properties of Shadows and Spectral Power Distribution of the Illumination,” University of Cantabria and University of Warwick, Sensors (Bas… [cited by applicant]