IP Library Granted Patent US 8,878,865
Granted Patent B2
US 8,878,865 · App. 13/624,816 · Granted Nov 4, 2014

Three-dimensional map system

Inventors: Adam J. Altman (Los Altos, CA); Matthew Boyer (Los Altos, CA); Vineet Bhatawadekar (Los Altos, CA)
Assignee: Hover, Inc.
G06T17/05G06T19/20G09B29/106G06T2219/2024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,878,865
App. No.
13/624,816
Granted
Nov 4, 2014
Kind
B2
Abstract

A method of operating a three-dimensional (3D) map system including: receiving an image and a geo-location tag of the image; determining a building model for a physical building corresponding to an object captured in the image based on the geo-location tag; mapping, on a region-by-region basis, the image to a stored facade of the building model; and mapping, on a pixel-by-pixel basis, the image to the stored facade of the building model for displaying the image as a new facade of the building.

Claims (51)

1. A method of operating a three-dimensional (3D) map system comprising:

an image mapper system configured for:

receiving an image and a geo-location tag of the image;

determining a building model for a physical building corresponding to an object captured in the image based on the geo-location tag;

mapping, on a region-by-region basis, the image to a stored facade of the building model; and

mapping, on a pixel-by-pixel basis, the image to the stored facade of the building model for displaying the image as a new facade of the building.

2. The method of claim 1 , wherein determining the building model includes determining the building model based on color distributions of the image and the stored facade.

3. The method of claim 1 , wherein mapping on a pixel-by-pixel basis includes mapping first pixels in a first region of the image to second pixels in a corresponding first region of the stored facade.

4. The method of claim 1 , wherein:

receiving the image includes receiving a camera orientation of when the image was taken; and

determining includes determining the building model based on the camera orientation.

5. The method of claim 1 , further comprising ranking likelihood of neighboring buildings having been captured in the image.

6. The method of claim 5 , wherein ranking the likelihood includes matching color distributions, texture, region-by-region similarity, pixel-by-pixel similarity, or any combination thereof, between the image and the stored facade.

7. A method of operating a three-dimensional (3D) map system comprising:

an image mapper system configured for:

receiving a photograph image and a geo-location tag of the photograph image;

processing the photograph image to remove an obstruction object;

determining a building model for a physical building corresponding to an object in the photograph image based on the geo-location tag;

mapping, on a region-by-region basis, the photograph image to a stored facade of the building model; and

mapping, on a pixel-by-pixel basis, the photograph image to the stored facade of the building model for displaying the photograph image as a new facade of the building model.

8. The method of claim 7 , further comprising calculating a certainty probability that a region of the photograph image is mapped to a region of the building model.

9. The method of claim 8 , further comprising highlighting the region of the photograph image on an alert display when the certainty probability is below a threshold.

10. The method of claim 9 , further comprising:

providing an input box in the alert display to capture a comment regarding mismatch of the highlighted region; and

displaying the highlighted region on a viewer display along with the comment.

11. The method of claim 7 , further comprising calculating a certainty probability that a pixel of the photograph image is mapped to a pixel of the building model.

12. The method of claim 7 , further comprising calculating a likelihood of the physical building having been captured in the photograph image.

13. The method of claim 7 , wherein processing the photograph image to remove the obstruction object includes classifying the obstruction object.

14. The method of claim 7 , wherein mapping, on a region-by-region basis, the photograph image includes resizing a region size of the region-by-region basis.

15. A three-dimensional (3D) map system comprising:

a non-transitory storage medium;

a processor;

a collection module for receiving a photograph image and a geo-location tag of the photograph image;

a selection module, coupled to the collection module, for determining a building model for a physical building corresponding to an object captured in the photograph image based on the geo-location tag;

a region match module, coupled to the selection module, for mapping, on a region-by-region basis, the photograph image to a stored facade of the building model;

a pixel match module, coupled to the region match module, for mapping, on a pixel-by-pixel basis, the photograph image to the stored facade of the building model for displaying the photograph image as a new facade of the building; and

wherein the modules are hardware circuitries or stored instructions on the non-transitory storage medium for execution by the processor.

16. The system of claim 15 , wherein further comprising a render module for updating the photograph image as the new facade of the building in real-time.

17. The system of claim 15 , wherein the pixel match module is for mapping the photograph image irrespective of camera angles of the photograph image and the stored facade.

18. A three-dimensional (3D) map system comprising:

a collection means for receiving a photograph image and a geo-location tag of the photograph image;

a selection means, coupled to the collection means, for determining a building model for a physical building corresponding to an object captured in the photograph image based on the geo-location tag;

a region match means, coupled to the selection means, for mapping, on a region-by-region basis, the photograph image to a stored facade of the building model; and

a pixel match means, coupled to the region match means, for mapping, on a pixel-by-pixel basis, the photograph image to the stored facade of the building model for displaying the photograph image as a new facade of the building.

19. The system of claim 18 , further comprising a render means for displaying a 3D map to a viewer station including a rendered display of the building model and the new facade.

20. The system of claim 19 , wherein the render means is for highlighting a regional mismatch based on mapping of the region match means.

21. The system of claim 19 , wherein the render means is for displaying a social network feed of a tagged user account on the new facade, the tagged user account having been tagged on a geo-location basis.

22. The system of claim 19 , wherein the render means is for providing a communication channel linked to a tenant of the physical building through the 3D map.

23. The system of claim 19 , wherein the render means is for displaying an advertisement linked to a tenant of the physical building through the 3D map.

24. The system of claim 19 , wherein the render means is for providing a measurement utility for measuring physical dimensions of the physical building.

25. The system of claim 19 , wherein the render means is for providing an inspection utility for detecting structural changes to the physical building.

Assignments (9)
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 061622/0741 →
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 061622/0761 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 056423/0189 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 056423/0179 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 056423/0199 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 056423/0222 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 25, 2020
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 052229/0972 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 25, 2020
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 052229/0986 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2013
From: ALTMAN, ADAM J.; BOYER, MATTHEW; BHATAWADEKAR, VINEET
To: HOVER, INC.
Reel/Frame 030083/0447 →
Continuity (2)
Provisional Application 61537485 · Sep 21, 2011
Related Publication 20130069944A1 · Mar 21, 2013