IP Library Granted Patent US 11,812,138
Granted Patent B2
US 11,812,138 · App. 18/089,425 · Granted Nov 7, 2023

Automated guide for image capturing for 3D model creation

Inventors: Manish Upendran (San Francisco, CA); William Castillo (San Carlos, CA); Derek Halliday (Oakland, CA)
Assignee: Hover Inc.
H04N23/64G06T17/00H04N23/633H04N23/661G06T2200/08G06T2200/24G06T2200/28G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,812,138
App. No.
18/089,425
Granted
Nov 7, 2023
Kind
B2
Abstract

An image capture system provides automated prompts for aiding a user in capturing images for use in 3D model creation. While a user is preparing to capture an image, the system provides visual indications that indicate whether a quality-based condition is satisfied. Based on the visual indications, a user can determine whether an image, if captured, would likely be suitable for use in creating a 3D model. Determining if the quality-based condition is satisfied may include monitoring output generated by one or more sensors and comparing the output against a threshold value. Additionally, the system may analyze the visual content or metadata associated with an image to determine if the quality-based condition is satisfied and request user input to further identify certain image features that were identified by the system.

Claims (32)

1. A method for directing capture of images for creating 3D models of a building object, comprising:

receiving an image frame for quality analysis;

identifying one or more features of the building object within the image frame;

generating a bounding box for the identified feature;

determining, by one or more processors, whether a quality-based condition for the image frame is satisfied, wherein determining whether the quality-based condition is satisfied comprises detecting that the bounding box is disposed within the image frame; and

providing one or more prompts associated with the image frame based on a status of the quality-based condition.

2. The method of claim 1 , wherein the bounding box surrounds a building.

3. The method of claim 2 , wherein the building comprises a door, a window, and a roof.

4. The method of claim 1 , wherein the one or more features comprise a roof facet.

5. The method of claim 1 , where the one or more features comprise a roof line.

6. The method of claim 1 , wherein the one or more features comprise a gable.

7. The method of claim 1 , wherein the one or more features comprise a corner of the building object.

8. The method of claim 1 , wherein detecting the bounding box is disposed within the image frame comprises detecting that the entirety of the bounding box is within the image frame.

9. The method of claim 1 , further comprising storing the image frame based on satisfying the quality-based condition.

10. The method of claim 1 , wherein the image frame is captured by a device.

11. The method of claim 10 , wherein the one or more prompts are provided as a visual indicator on the device.

12. Non-transitory computer storage media storing instructions that when executed by one or more processors, cause the one or more processors to perform operations comprising:

receiving an image frame for quality analysis;

identifying one or more features of a building object within the image frame;

generating a bounding box for the identified feature;

determining, by one or more processors, whether a quality-based condition for the image frame is satisfied, wherein determining whether the quality-based condition is satisfied comprises detecting that the bounding box is disposed within the image frame; and

providing one or more prompts associated with the image frame based on a status of the quality-based condition.

13. The non-transitory computer storage media of claim 12 , wherein the bounding box surrounds a building.

14. The non-transitory computer storage media of claim 13 , wherein the building comprises a door, a window, and a roof.

15. The non-transitory computer storage media of claim 12 , wherein the one or more features comprise a roof facet.

16. The non-transitory computer storage media of claim 12 , where the one or more features comprise a roof line.

17. The non-transitory computer storage media of claim 12 , wherein the one or more features comprise a gable.

18. The non-transitory computer storage media of claim 12 , wherein the one or more features comprise a corner of the building object.

19. The non-transitory computer storage media of claim 12 , wherein detecting the bounding box is disposed within the image frame comprises detecting that the entirety of the bounding box is within the image frame.

20. The non-transitory computer storage media of claim 12 , further comprising storing the image frame based on satisfying the quality-based condition.

21. The non-transitory computer storage media of claim 12 , wherein the image frame is captured by a device.

22. The non-transitory computer storage media of claim 21 , wherein the one or more prompts are provided as a visual indicator on the device.

Continuity (5)
Continuation 17700235 · Mar 21, 2022
Continuation 17010625 · Sep 2, 2020
Continuation 16450717 · Jun 24, 2019
Continuation 15404044 · Jan 11, 2017
Related Publication 20230171485A1 · Jun 1, 2023
Cited By (2)
US 12,684,230 US 12,695,982