IP Library Granted Patent US 10,657,714
Granted Patent B2
US 10,657,714 · App. 16/186,163 · Granted May 19, 2020

Method and system for displaying and navigating an optimal multi-dimensional building model

Inventors: Manish Upendran (San Francisco, CA); Adam J. Altman (San Francisco, CA)
Assignee: HOVER, Inc.
G06T19/00G06K9/00214G06K9/00637G06T15/04G06T15/20G06T17/05G06T2200/08G06T2210/04G06T2210/56
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,657,714
App. No.
16/186,163
Granted
May 19, 2020
Kind
B2
Abstract

A method and system is provided for automatic generation and navigation of optimal views of facades of multi-dimensional building models based on where and how the original images were captured. The system and method allows for navigation and visualization of facades of individual or multiple building models in a multi-dimensional building model visualization system.

Claims (69)

1. A method of calculating an optimal camera position within a multi-dimensional building model, the method comprises:

defining a look angle based at least partially on information obtained from a camera used during image capture of a building;

defining a field of view by defining up, down, left and right angles which define an extent of the building;

calculating a camera first main axis and a second main axis of the building to define camera orientation within the multi-dimensional building model;

calculating the optimal camera position based on the look angle, the field of view and the camera orientation; and

storing the optimal camera position in computer storage.

2. The method of claim 1 , wherein the information obtained from a camera used during image capture of a building includes camera position.

3. The method of claim 2 , wherein the camera position is represented by camera metadata.

4. The method of claim 3 , wherein the camera metadata includes one or more instances of contextual information about a sequence of the image capture of the building, the one or more instances of contextual information including any of:

GPS Latitude Ref;

GPS Longitude Ref;

GPS Altitude;

GPS Dilution of Precision;

GPS Img (image) Direction Ref (reference);

GPS Img (image) Direction;

metadata for gravity; or

metadata for the camera orientation.

5. The method of claim 4 , wherein the sequence of the image capture of the building includes image capture starting at a front side, with a counter-clockwise or clockwise capture to sequentially capture images of one or more of: front right corner, right side, back left corner, back side, back right corner, side, front left corner in the sequence of the image capture with a name associated with images in the sequence of the image capture.

6. The method of claim 5 , wherein, if any image of the sequence of the image capture is recaptured, an image capture sequence number is preserved.

7. The method of claim 5 further comprises determining a first look angle based on a first image in the sequence of the image capture.

8. The method of claim 4 , wherein the one or more instances of contextual information are included with each image captured during the sequence of the image capture of the building via an EXIF (exchangeable image file) format tag or separately via a metadata file.

9. The method of claim 4 further comprises determining the look angle based on the one or more instances of contextual information including any of:

an arbitrary height relative to a roof of a building;

a corner of a building;

architectural features plotted in sequence;

a specific altitude above the multi-dimensional building model;

labeled locations; or

arbitrary factors used to locate the image capture of the building as it depends on local building constraints wherein an optimal view includes an unobstructed view.

10. The method of claim 2 further comprises plotting default look angles for the multi-dimensional building model based on an initial camera position.

11. A computing device for calculating an optimal camera position within a multi-dimensional building model, the computing device comprises:

an interface,

computer memory, and

a view processor for processing an optimal view of a multi-dimensional building model, the view processor configured to:

define a look angle based at least partially on information obtained from a camera used during image capture of a building;

define a field of view by defining up, down, left and right angles which define an extent of the building;

calculate a camera first main axis and a second main axis of the building to define camera orientation within the multi-dimensional building model;

calculate the optimal camera position based on the look angle, the field of view and the camera orientation; and

store the optimal camera position in the computer memory.

12. The computing device of claim 11 , wherein the information obtained from a camera used during image capture of a building includes camera position.

13. The computing device of claim 12 , wherein the camera position is represented by camera metadata.

14. The computing device of claim 13 , wherein the camera metadata includes one or more instances of contextual information about a sequence of the image capture of the building, the one or more instances of contextual information including any of:

GPS Latitude Ref;

GPS Longitude Ref;

GPS Altitude;

GPS Dilution of Precision;

GPS Img (image) Direction Ref (reference);

GPS Img (image) Direction;

metadata for gravity; or

metadata for the camera orientation.

15. The computing device of claim 14 , wherein the sequence of the image capture of the building includes image capture starting at a front side, with a counter-clockwise or clockwise capture to sequentially capture images of one or more of: front right corner, right side, back left corner, back side, back right corner, side, front left corner in the sequence of the image capture with a name associated with images in the sequence of the image capture.

16. The computing device of claim 15 , wherein, if any image of the sequence of the image capture is recaptured, an image capture sequence number is preserved.

17. The computing device of claim 14 , wherein the one or more instances of contextual information is included with each image captured during the sequence of the image capture of the building via an EXIF (exchangeable image file) format tag or separately via a metadata file.

18. A system for calculating an optimal camera position within a multi-dimensional building model, the system comprises:

a processor for processing imagery of a multi-dimensional building model, the processor configured to:

define a look angle based at least partially on position information obtained from a camera used during image capture of a building;

define a field of view by defining up, down, left and right angles which define an extent of the building;

calculate a camera first main axis and a second main axis of the building to define camera orientation within the multi-dimensional building model;

calculate the optimal camera position based on the look angle, the field of view and the camera orientation; and

store the optimal camera position in computer memory.

19. The system of claim 18 , wherein the position information includes one or more of:

GPS Latitude Ref;

GPS Longitude Ref;

GPS Altitude;

GPS Dilution of Precision;

GPS Img (image) Direction Ref (reference);

GPS Img (image) Direction;

metadata for gravity;

metadata for camera orientation; or

or an image capture sequence number.

Assignments (9)
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 061622/0741 →
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 061622/0761 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 056423/0189 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 056423/0199 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 056423/0222 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 056423/0179 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 25, 2020
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 052229/0986 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 25, 2020
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 052229/0972 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 27, 2018
From: UPENDRAN, MANISH; ALTMAN, ADAM J.
To: HOVER INC.
Reel/Frame 047592/0289 →
Continuity (5)
Continuation 15721062 · Sep 29, 2017
Continuation In Part 15255952 · Sep 2, 2016
Continuation 14339992 · Jul 24, 2014
Provisional Application 61858241 · Jul 25, 2013
Related Publication 20190114834A1 · Apr 18, 2019
Cited By (1)
US 12,657,826