IP Library Granted Patent US 10,776,999
Granted Patent B2
US 10,776,999 · App. 15/255,807 · Granted Sep 15, 2020

Generating multi-dimensional building models with ground level images

Inventors: Shaohui Sun (Mountain View, CA); Ioannis Pavlidis (Redwood City, CA); Adam J. Altman (San Francisco, CA)
Assignee: Hover Inc.
G06T17/05G06F3/14G06K9/00214G06K9/00637G06T15/04G06T15/20G06T17/00G06T19/003G06T19/20G06T2200/08G06T2200/24G06T2207/10028G06T2210/04G06T2210/56G06T2219/2008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,776,999
App. No.
15/255,807
Granted
Sep 15, 2020
Kind
B2
Abstract

A system and method is provided for generating textured 3D building models from ground-level imagery. Ground-level images for the sides/corners of building objects are collected for identification of key architectural features, corresponding key façade geometry planes, and generation of a 3D building façade geometry. The 3D building model is properly geo-positioned, scaled and textured.

Claims (17)

1. A system for generating a scaled multi-dimensional building model, the system comprising:

a computer system for receiving, from a wireless capture device, a plurality of ground-level images of an entire single building captured by the wireless capture device circumnavigating the entire single building;

an image database for storing and retrieving the plurality of ground-level images of the entire single building;

an image processor, operative with the image database, to:

construct a textured contiguous multi-dimensional building model of the entire single building by processing external surfaces of the entire single building identified within the plurality of ground-level images, wherein the processing includes at least defining boundaries for a plurality of planar surfaces of the entire single building by recognition of building vertices, correlating and aligning the plurality of planar surfaces to one another along the defined boundaries to form a contiguous multi-dimensional model, and re-texturing the plurality of planar surfaces with imagery from the plurality of ground-level images of an entire single building, and wherein the external surfaces include one or more architectural features;

scale the imagery re-textured contiguous multi-dimensional building model using a scaling factor based on a comparison of dimensional ratios of the one or more architectural features, as identified in the plurality of captured ground-level images, to known dimensional ratios of industry standard architectural features, wherein the scaling factor is based on dimensional ratios of a plurality of architectural features as identified in the plurality of captured ground-level images; and

a viewer device for displaying the constructed imagery re-textured contiguous multi-dimensional building model.

2. The system of claim 1 , wherein the one or more architectural features include roofing surfaces or roof intersection vertices.

3. The system of claim 1 , wherein the one or more architectural features include one or more of: ground intersection vertices, bay window vertices, or overhanging vertices.

4. The system of claim 1 , further comprising identifying the one or more architectural features by matching to stored libraries of known architectural features.

5. A method for generating a multi-dimensional building model, the method comprising:

receiving, from a smartphone, a plurality of ground-level images of an entire single building captured from multiple angles and distances around the entire single building;

wirelessly uploading and storing, in computer memory, the plurality of ground-level images received from the smartphone;

creating a textured contiguous multi-dimensional building model by constructing a plurality of facades of the entire single building based on the plurality of ground-level images, the plurality of facades including all sides and roof of the entire single building, wherein the constructing includes at least defining boundaries for a plurality of facades of the entire single building by recognition of building vertices, correlating and aligning the facades to one another along the defined boundaries to form a contiguous multi-dimensional model, and re-texturing the facades with imagery from the plurality of ground-level images of an entire single building;

determining scale of the imagery re-textured contiguous multi-dimensional building model using a scaling factor based on comparing dimensional ratios of one or more building architectural features located within one or more of the plurality of facades to known dimensional ratios of industry standard architectural features;

reconstructing the imagery re-textured contiguous multi-dimensional building model from the determined scale; and

sending, to a touch screen, the reconstructed imagery re-textured contiguous multi-dimensional building model.

Assignments (9)
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 061622/0741 →
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 061622/0761 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 056423/0189 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 056423/0179 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 056423/0199 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 056423/0222 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 25, 2020
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 052229/0972 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 25, 2020
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 052229/0986 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2017
From: SUN, SHAOHUI; PAVLIDIS, IOANNIS; ALTMAN, ADAM J.
To: HOVER INC.
Reel/Frame 041537/0753 →
Continuity (3)
Continuation 14339127 · Jul 23, 2014
Provisional Application 61857302 · Jul 23, 2013
Related Publication 20160371875A1 · Dec 22, 2016
Cited By (1)
US 12,657,826