IP Library Granted Patent US 8,422,825
Granted Patent B1
US 8,422,825 · App. 12/265,656 · Granted Apr 16, 2013

Method and system for geometry extraction, 3D visualization and analysis using arbitrary oblique imagery

Inventors: Neophytos Neophytou (Glen Cove, NY); Marc L. Herbert (Wantagh, NY); James L. Pittel (Glen Head, NY)
Assignee: Hover Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,422,825
App. No.
12/265,656
Granted
Apr 16, 2013
Kind
B1
Abstract

Embodiments of the invention relate to the visualization of geographical information and the combination of image information to generate geographical information. Specifically, embodiments of the invention relate to a process and system for correlating oblique images data and terrain data without extrinsic information about the oblique imagery. Embodiments include a visualization tool to allow simultaneous and coordinated viewing of the correlated imagery. The visualization tool may also provide distance and measuring, three-dimensional lens, structure identification, path finding, visibility and similar tools to allow a user to determine distance between imaged objects.

Claims (60)

1. A method of operation of a computer system comprising:

receiving a set of tie points for a first image captured by a camera;

iterating through sets of camera parameters for the first image;

calculating a least squares fit value for each of the sets of camera parameters;

selecting a set of camera parameters from the sets with a least error in the least squares fit value;

calculating two-dimensional coordinates for the pixel of the first image based on an overlapping area of an orthorectified image; and

calculating a geo-location for a pixel of the first image using the selected set of camera parameters for constructing a three-dimensional image on a display;

wherein the fist image is an oblique image.

2. The method of claim 1 , further comprising:

calculating three-dimensional coordinates for the pixel of the first image based on the two-dimensional coordinates and the set of camera parameters.

3. The method of claim 1 , further comprising:

adjusting a tie point automatically to a nearest corner.

4. The method of claim 1 , further comprising:

reverse-projecting a terrain model corresponding to the first image by a graphics processor unit.

5. The method of claim 1 , further comprising:

texture-mapping a portion of the first image onto an orthogonal image that is draped over a three-dimensional terrain model.

6. The method of claim 1 , further comprising:

matching a pattern identified in the first image in one other image by transforming the pattern to the image space of the one other image and comparing a texture of the pattern with the one other image.

7. The method of claim 1 , further comprising:

identifying a set of walls for a structure in the first image based on an identified rooftop.

8. The method of claim 1 , further comprising:

providing rooftop identification tools including line drawing, circle drawing and rectangle drawing.

9. A non-transitory computer-readable medium having a set of instructions stored therein which when executed cause a machine to perform a set of operations comprising:

receiving a set of tie points for a first image;

iterating through sets of camera parameters for the first image;

calculating a least squares fit value for each of the sets plurality of camera parameters;

selecting a set of camera parameters from the sets with a least error in the least squares fit value; and

calculating two-dimensional coordinates for the pixel of the first image based on an overlapping area of an orthorectified image;

calculating a geo-location for a pixel of the first image using the selected set of camera parameters;

wherein the first image is an oblique image.

10. The machine readable medium of claim 9 , having further instructions stored therein, which when executed cause the machine to perform the set of operations further comprising:

calculating three-dimensional coordinates for the pixel of the first image based on the two-dimensional coordinates and the set of camera parameters.

11. The machine readable medium of claim 9 , having further instructions stored therein, which when executed cause the machine to perform the set of operations further comprising:

adjusting a tie point automatically to a nearest corner.

12. The machine readable medium of claim 9 , having further instructions stored therein, which when executed cause the machine to perform the set of operations further comprising:

reverse-projecting a terrain model corresponding to the first image by a graphics processor unit.

13. The machine readable medium of claim 9 , having further instructions stored therein, which when executed cause the machine to perform the set of operations further comprising:

texture-mapping a portion of the first image onto an orthogonal image that is draped over a three-dimensional terrain model.

14. The machine readable medium of claim 9 , having further instructions stored therein, which when executed cause the machine to perform the set of operations further comprising:

matching a pattern identified in the first image in one other image by transforming the pattern to the image space of the one other image and comparing a texture of the pattern with the one other image.

15. The machine readable medium of claim 9 , having further instructions stored therein, which when executed cause the machine to perform the set of operations further comprising:

identifying a set of walls for a structure in the first image based on an identified rooftop.

16. The machine readable medium of claim 9 , having further instructions stored therein, which when executed cause the machine to perform the set of operations further comprising:

providing rooftop identification tools including line drawing, circle drawing and rectangle drawing.

17. A non-transitory storage system including software modules, comprising:

a visualization tool implemented on the non-transitory storage system for receiving a set of tie points for a first image, the first image being an oblique image;

a camera solver component implemented on the non-transitory storage system for:

iterating through a plurality of camera parameters for the first image,

calculating a least squares fit value for each of the plurality of camera parameters, and

selecting a set of camera parameters with a least error in the least squares fit value; and

pixel mapping component implemented on the non-transitory storage system for:

calculating a geo-location for a pixel of the first image using the set of camera parameters, and

calculating two-dimensional coordinates for the pixel of the first image based on an overlapping area of an orthorectified image.

18. A geocoding and visualization apparatus for constructing a 3D map on a display device from camera captured images, comprising:

means for receiving a set of tie points for a first image, the first image being an oblique image;

means for iterating through a plurality of camera parameters for the first image;

means for calculating a least squares fit value for each of the plurality of camera parameters;

means for selecting a set of camera parameters with a least error in the least squares fit value;

means for calculating a geo-location for a pixel of the first image using the set of camera parameters; and

means for calculating two-dimensional coordinates for the pixel of the first image based on an overlapping area of an orthorectified image.

Assignments (12)
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 061622/0741 →
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 061622/0761 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 056423/0179 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 056423/0189 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 056423/0199 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 056423/0222 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 25, 2020
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 052229/0972 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 25, 2020
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 052229/0986 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2013
From: BRANDT, WILLIAM A.
To: NORTH VECTOR, INC.
Reel/Frame 029820/0101 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2013
From: NORTH VECTOR, INC.
To: HOVER INC.
Reel/Frame 029820/0170 →
CHANGE OF NAME Recorded Sep 11, 2012
From: INTELEPIX, LLC
To: NORTH VECTOR, INC.
Reel/Frame 028938/0588 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 6, 2008
From: NEOPHYTOU, NEOPHYTOS; HERBERT, MARC L.; PITTEL, JAMES L.
To: INTELEPIX, LLC
Reel/Frame 021799/0708 →