IP Library Granted Patent US 10,991,158
Granted Patent B2
US 10,991,158 · App. 16/683,168 · Granted Apr 27, 2021

Real-time processing of captured building imagery

Inventors: William Castillo (Belmont, CA); Manish Upendran (San Francisco, CA); Ajay Mishra (Palo Alto, CA); Adam J. Altman (San Francisco, CA)
Assignee: Hover Inc.
G06T17/05G06T7/0002G06T17/00G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,991,158
App. No.
16/683,168
Granted
Apr 27, 2021
Kind
B2
Abstract

Systems and methods are disclosed for guiding image capture of a subject by determining a location of the subject and presenting on a display graphical guides representative of perspective views of the subject to be captured. Images of the subject may then be captured and additional graphical guides are presented to the user for display for additional images to be captured. Images may be captured in a predetermined sequence of graphical guides or responsive to a user input or camera information. Captured images may be uploaded to a system for additional processing.

Claims (80)

1. A method of directing image capture, the method comprising:

determining a location for a subject to be captured by an image capture device;

presenting, on a display of the image capture device, a plurality of camera perspective overlays related to the subject type;

receiving a selection of a first camera perspective overlay from the plurality of camera perspective overlays;

capturing a first image of the subject concurrent with alignment, on the display, of the first camera perspective overlay to the subject;

receiving a selection of a second camera perspective overlay from the plurality of camera perspective overlays;

capturing a second image of the subject concurrent with alignment, on the display, of the second camera perspective overlay to the subject; and

transmitting at least the captured first and second images of the subject to an image processing system.

2. The method of claim 1 , further comprising associating an orientation of the first image with the first camera perspective overlay.

3. The method of claim 1 , further comprising associating an orientation of the second image with the second camera perspective overlay.

4. The method of claim 1 , further comprising creating, from at least the first and second images of the subject, a 3D model of the subject.

5. The method of claim 1 , wherein the image capture device is a digital camera.

6. The method of claim 1 , wherein the plurality of camera perspective overlays is presented as a circumferential sequence of views relative to the subject.

7. The method of claim 1 , wherein selection of the first camera perspective overlay is responsive to a first position of the image capture device relative to the subject.

8. The method of claim 1 , wherein selection of the first camera perspective overlay is responsive to a first perspective view of the subject from the image capture device.

9. The method of claim 1 , wherein selection of the second camera perspective overlay is responsive to a second position of image capture device relative to the subject.

10. The method of claim 1 , wherein selection of the second camera perspective overlay is responsive to a second perspective view of the subject from the image capture device.

11. The method of claim 1 , wherein selection of the second camera perspective overlay is responsive to a user selection.

12. An image capture device comprising:

an interface;

a display;

a local memory; and

a processing module operably coupled to the interface and the local memory, wherein the processing module comprises executable instructions to cause an image capture device to:

determine a location for a subject to be captured by the image capture device;

present, on the display of the image capture device, a plurality of camera perspective overlays related to the subject type;

receive a selection of a first camera perspective overlay from the plurality of camera perspective overlays;

capture a first image of the subject concurrent with alignment, on the display, of the first camera perspective overlay to the subject;

receive a selection of a second camera perspective overlay from the plurality of camera perspective overlays;

capture a second image of the subject concurrent with alignment, on the display, of the second camera perspective overlay to the subject; and

transmit at least the captured first and second images of the subject to an image processing system.

13. The image capture device of claim 12 , wherein the processing module further comprises executable instructions that further cause the image capture device to: associate an orientation of the first image with the first camera perspective overlay.

14. The image capture device of claim 12 , wherein the processing module further comprises executable instructions that further cause the image capture device to: associate an orientation of the second image with the second camera perspective overlay.

15. The image capture device of claim 12 , wherein the processing module further comprises executable instructions that further cause the image capture device to: select the first camera perspective overlay in response to a user selection.

16. The image capture device of claim 12 , wherein the processing module further comprises executable instructions that further cause the image capture device to: select the first camera perspective overlay in response to a first perspective view of the subject from the image capture device.

17. The image capture device of claim 12 , wherein the processing module further comprises executable instructions that further cause the image capture device to: select the first camera perspective overlay in response to a first position of the image capture device.

18. The image capture device of claim 12 , wherein the processing module further comprises executable instructions that further cause the image capture device to: select the second camera perspective overlay in response to a user selection.

19. The image capture device of claim 12 , wherein the processing module further comprises executable instructions that further cause the image capture device to: select the second camera perspective overlay in response to a second perspective view of the subject from the image capture device.

20. The image capture device of claim 12 , wherein the processing module further comprises executable instructions that further cause the image capture device to: select the second camera perspective overlay in response to a second position of the image capture device.

21. The method of claim 1 , wherein selection of the first camera perspective overlay is responsive to a user selection.

22. The system of claim 12 , wherein the image capture device is a digital camera.

23. A method of directing image capture, the method comprising:

determining a location for a subject to be captured by an image capture device;

presenting, on a display of the image capture device, at least one overlay guide from a plurality of overlay guides related to the subject type depicting an orientation between the image capture device and the subject;

receiving a selection of a first overlay guide;

capturing a first image of the subject concurrent with alignment of the first overlay guide to the subject on the display;

receiving a selection of a second overlay guide;

capturing a second image of the subject concurrent with alignment of the second overlay guide to the subject on the display; and

transmitting the captured first and second images of the subject to an image processing system.

24. The method of claim 23 , wherein the image capture device is a digital camera.

25. The method of claim 23 , further comprising associating the orientation of the first overlay guide with the first image.

26. The method of claim 23 , further comprising associating the orientation of the second overlay guide with the second image.

27. The method of claim 23 , further comprising creating, from at least one of the first or second images of the subject, a 3D model of the subject.

28. The method of claim 23 , wherein selection of the first overlay guide is responsive to a user selection.

29. The method of claim 23 , wherein selection of the second overlay guide is responsive to a user selection.

30. The method of claim 23 , wherein selection of the first overlay guide is responsive to a first position of the image capture device relative to the subject.

31. The method of claim 23 , wherein selection of the first overlay guide is responsive to a first perspective view of the subject from the image capture device.

32. The method of claim 23 , wherein selection of the second overlay guide is responsive to a second position of image capture device relative to the subject.

33. The method of claim 23 , wherein selection of the second overlay guide is responsive to a second perspective view of the subject from the image capture device.

34. A system comprising:

an interface;

a display;

a local memory; and

a processing module operably coupled to the interface and the local memory, wherein the processing module comprises executable instructions to cause an image capture device to:

determine a location for a subject to be captured by the image capture device;

present, on the display of the image capture device, at least one overlay guide from a plurality of overlay guides related to the subject depicting an orientation between the image capture device and the subject;

receive a selection of a first overlay guide;

capture a first image of the subject concurrent with alignment of the first overlay guide to the subject on the display;

receive a selection of a second overlay guide;

capture a second image of the subject concurrent with alignment of the second overlay guide to the subject on the display; and

transmit the captured first and second images of the subject to an image processing system.

35. The system of claim 34 , wherein the image capture device is a digital camera.

36. The system of claim 34 , wherein the processing module further comprises executable instructions that further cause the image capture device to: associate the orientation of the first overlay guide with the first image.

37. The system of claim 34 , wherein the processing module further comprises executable instructions that further cause the image capture device to: associate the orientation of the second overlay guide with the second image.

38. The system of claim 34 , wherein the processing module further comprises executable instructions that further cause the image capture device to: select the first overlay guide in response to a user selection.

39. The system of claim 34 , wherein the processing module further comprises executable instructions that further cause the image capture device to: select the second overlay guide in response to a user selection.

40. The system of claim 34 , further comprising creating, from at least one of the first or second images of the subject, a 3D model of the subject.

41. The system of claim 34 , wherein selection of the first overlay guide is responsive to a first position of the image capture device relative to the subject.

42. The system of claim 34 , wherein selection of the first overlay guide is responsive to a first perspective view of the subject from the image capture device.

43. The system of claim 34 , wherein selection of the second overlay guide is responsive to a second position of image capture device relative to the subject.

44. The system of claim 34 , wherein selection of the second overlay guide is responsive to a second perspective view of the subject from the image capture device.

Assignments (9)
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 061622/0741 →
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 061622/0761 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 056423/0189 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 056423/0222 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 056423/0199 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 056423/0179 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2020
From: UPENDRAN, MANISH; CASTILLO, WILLIAM; MISHRA, AJAY; ALTMAN, ADAM J
To: HOVER, INC
Reel/Frame 052442/0204 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 25, 2020
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 052229/0972 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 25, 2020
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 052229/0986 →
Continuity (5)
Continuation 16555070 · Aug 29, 2019
Continuation 15942733 · Apr 2, 2018
Continuation In Part 15166587 · May 27, 2016
Provisional Application 62168460 · May 29, 2015
Related Publication 20200098171A1 · Mar 26, 2020
Cited By (3)
US 12,657,826 US 12,684,230 US 12,695,982