IP Library Granted Patent US 9,418,446
Granted Patent B2
US 9,418,446 · App. 14/470,382 · Granted Aug 16, 2016

Method and apparatus for determining a building location based on a building image

Inventors: Xin Chen (Evanston, IL); Andi Zang (Chicago, IL)
Assignee: Nokia Technologies Oy
G06T7/40G06K9/4604G06K9/6202
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,418,446
App. No.
14/470,382
Granted
Aug 16, 2016
Kind
B2
Abstract

A method, apparatus and computer program product are provided for determining a building location based on a building image. In the context of a method, the method includes receiving an image including at least one building, extracting building texture features from the image, and receiving reference building texture features. The method also includes determining, using a processor, building texture features comparisons between building texture features and reference building texture features which satisfy a predetermined match threshold and determining a matching building location based upon the building texture features comparison.

Claims (56)

1. A method comprising:

receiving an image, wherein the image comprises a cluster of buildings, wherein the image is taken from a facing position with respect to the cluster of buildings;

extracting building texture features from the image;

receiving reference building texture features;

determining, using a processor, building texture features comparisons between building texture features of the cluster of buildings and reference building texture features which satisfy a predetermined match threshold;

determining a matching building locations based upon the building texture features comparisons;

determining a back projection so as to include a position in which the buildings in the image most accurately satisfy the matching building locations; and

determining a camera position dependent upon the back projection that is based on the matching building locations and the building texture features comparisons.

2. The method of claim 1 further comprising:

detecting building face blocks in the image; and

detecting edges within building face blocks;

wherein the building texture features comprise detected edges and are extracted from the building face blocks.

3. The method of claim 1 further comprising:

determining the camera position based on the building locations and the back projection.

4. The method of claim 3 further comprising:

initializing an application based on the camera position.

5. The method of claim 2 , wherein extracting building features further comprises:

aligning and normalizing the building face blocks.

6. The method of claim 1 , wherein building texture features comprise, window distribution, window area, window density, characters, or building color.

7. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and computer program code configured to, with the processor, cause the apparatus to at least:

receive an image, wherein the image comprises a cluster of buildings, wherein the image is taken from a facing position with respect to the cluster of buildings;

extract building texture features from the image;

receive reference building texture features;

determine building texture features comparisons between building texture features of the cluster of buildings and reference building texture features which satisfy a predetermined match threshold;

determine a matching building location based upon the building texture features comparisons;

determine a back projection so as to include a position in which the buildings in the image most accurately satisfy the matching building locations; and

determine a camera position dependent upon the back projection that is based on the matching building locations and the building texture features comparisons.

8. The apparatus of claim 7 , wherein the at least one memory and the computer program code are further configured to:

detect building face blocks in the image; and

detect edges within building face blocks;

wherein the building texture features comprise detected edges and are extracted from the building face blocks.

9. The apparatus of claim 7 , wherein the at least one memory and the computer program code are further configured to:

determine the camera position based on the building locations and the back projection.

10. The apparatus of claim 9 , wherein the at least one memory and the computer program code are further configured to:

initialize an application based on the camera position.

11. The apparatus of claim 8 , wherein extracting building features further comprises:

aligning and normalizing the building face blocks.

12. The apparatus of claim 1 , wherein building texture features comprise, window distribution, window area, window density, characters, or building color.

13. At least one non-transitory computer-readable storage medium storing a computer program product having computer-executable program code portions stored therein, the computer-executable program code portions comprising program code instructions configured to:

receive an image, wherein the image comprises a cluster of buildings, wherein the image is taken from a facing position with respect to the cluster of buildings;

extract building texture features from the image;

receive reference building texture features;

determine building texture features comparisons between building texture features of the cluster of buildings and reference building texture features which satisfy a predetermined match threshold;

determine a matching building location based upon the building texture features comparisons;

determine a back projection so as to include a position in which the buildings in the image most accurately satisfy the matching building locations; and

determine a camera position dependent upon the back projection that is based on the matching building locations and the building texture features comparisons.

14. The at least one non-transitory computer-readable storage medium of claim 13 , wherein the computer-executable program code portions further comprise program code instructions configured to:

detect building face blocks in the image; and

detect edges within building face blocks;

wherein the building texture features comprise detected edges and are extracted from the building face blocks.

15. The at least one non-transitory computer-readable storage medium of claim 13 , wherein the computer-executable program code portions further comprise program code instructions configured to:

determine the camera position based on the building locations and the back projection.

16. The at least one non-transitory computer-readable storage medium of claim 15 , wherein the computer-executable program code portions further comprise program code instructions configured to:

initialize an application based on the camera position.

17. The at least one non-transitory computer-readable storage medium of claim 14 , wherein extracting building features further comprises:

aligning and normalizing the building face blocks.

Assignments (12)
PATENT SECURITY AGREEMENT Recorded Aug 6, 2024
From: RPX CORPORATION; RPX CLEARINGHOUSE LLC
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 068328/0674 →
RELEASE OF LIEN ON PATENTS Recorded Aug 5, 2024
From: BARINGS FINANCE LLC
To: RPX CORPORATION
Reel/Frame 068328/0278 →
PATENT SECURITY AGREEMENT Recorded Apr 22, 2023
From: RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 063429/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: PROVENANCE ASSET GROUP LLC
To: RPX CORPORATION
Reel/Frame 059352/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: NOKIA US HOLDINGS INC.
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058363/0723 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: CORTLAND CAPITAL MARKETS SERVICES LLC
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058983/0104 →
ASSIGNMENT AND ASSUMPTION AGREEMENT Recorded Feb 14, 2019
From: NOKIA USA INC.
To: NOKIA US HOLDINGS INC.
Reel/Frame 048370/0682 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2017
From: NOKIA TECHNOLOGIES OY; NOKIA SOLUTIONS AND NETWORKS BV; ALCATEL LUCENT SAS
To: PROVENANCE ASSET GROUP LLC
Reel/Frame 043877/0001 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP LLC
To: NOKIA USA INC.
Reel/Frame 043879/0001 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP, LLC
To: CORTLAND CAPITAL MARKET SERVICES, LLC
Reel/Frame 043967/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 034781/0200 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2014
From: CHEN, XIN; ZANG, ANDI
To: NOKIA CORPORATION
Reel/Frame 033836/0931 →
Continuity (1)
Related Publication 20160063732A1 · Mar 3, 2016