IP Library Granted Patent US 8,452,125
Granted Patent B2
US 8,452,125 · App. 13/317,499 · Granted May 28, 2013

Mosaic oblique images and methods of making and using same

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,452,125
App. No.
13/317,499
Granted
May 28, 2013
Kind
B2
Abstract

A system, including a computer system running image processing software, receives an identification of a desired area to be imaged and collected into an oblique-mosaic image, creates a mathematical model of a virtual camera having a sensor higher in elevation from which the source oblique images were captured and looking down at an oblique angle, the mathematical model having an oblique-mosaic pixel map for the sensor of the desired area encompassing multiple source images, determines geographic coordinates for pixels, and selects source oblique images of the geographic coordinates captured at an oblique angle and compass direction similar to the oblique angle and compass direction of the virtual camera. The computer system reprojects at least one source oblique image pixel of the area to be imaged for each pixel included in the oblique-mosaic pixel map to create the oblique-mosaic image.

Claims (32)

1. A system comprising:

a computer system running image processing software that when executed by the computer system causes the computer system to:

receive an identification of a desired geographical area to be imaged and collected into an oblique-mosaic image;

create a mathematical model of a virtual camera looking down at an oblique angle, the mathematical model having an oblique-mosaic pixel map of the desired geographical area encompassing multiple source images;

assign a surface location to each pixel included in the oblique-mosaic pixel map;

select source oblique images of geographic coordinates captured at an oblique angle and compass direction similar to the oblique angle and compass direction of the virtual camera;

create a ground elevation model of the ground and vertical structures within the oblique-mosaic pixel map using overlapping source images; and

reproject source oblique image pixels of the area to be imaged for pixels included in the oblique-mosaic pixel map using the ground elevation model to thereby create an oblique-mosaic image of the desired area.

2. The system of claim 1 , wherein the virtual camera has a perspective, and wherein the image processing software further causes the computer system to project each pixel through the perspective of the virtual camera to determine a corresponding surface location for each pixel in the oblique-mosaic pixel map.

3. The system of claim 1 , wherein multiple source oblique images represent a same surface location.

4. The system of claim 3 , wherein the image processing software further causes the computer system to compare the pixels of each source oblique image that represent the same surface location to determine which source pixel is most representative of the surface location, the more representative pixel to be included in the oblique-mosaic image.

5. The system of claim 1 , wherein each pixel included in the oblique-mosaic pixel map is reprojected to match a size and shape of a represented surface location as taken from the elevation, compass direction, and oblique angle of the virtual camera.

6. The system of claim 1 , wherein the image processing software further causes the computer system to remove effects of elevation from the source oblique images prior to reprojection and then to add the effects of elevation to the oblique-mosaic image after reprojection.

7. The system of claim 1 , wherein lean of vertical structures within the oblique-mosaic image is minimized.

8. The system of claim 7 , wherein minimizing lean of vertical structures is defined further as matching vertical structures in multiple source oblique images and shifting pixels apparent location in at least one of the source oblique images by a relative height above a ground model.

9. The system of claim 1 , wherein metadata is stored with the oblique-mosaic image.

10. A system comprising:

a computer system running image processing software that when executed by the computer system causes the computer system to:

receive an identification of a desired geographical area to be imaged and collected into an oblique-mosaic image;

create a mathematical model of a virtual camera looking down at an oblique angle, the mathematical model having an oblique-mosaic pixel map of the desired geographical area encompassing multiple source oblique images;

determine geographic coordinates for pixels included in the oblique-mosaic pixel map;

select source oblique images of the geographic coordinates captured at an oblique angle and compass direction similar to the oblique angle and compass direction of the virtual camera;

create a ground elevation model of the ground and vertical structures within the oblique-mosaic pixel map using overlapping source images; and

reproject, using the ground elevation model to define a ground surface and surfaces of vertical structures within the desired geographical area, at least one source oblique image pixel of the selected source oblique images of the area to be imaged from a vantage point of the virtual camera for pixels included in the oblique-mosaic pixel map to thereby create a geo-referenced oblique-mosaic image of the desired geographical area.

11. The system of claim 10 , wherein the virtual camera has a perspective, and wherein the image processing software further causes the computer system to project each pixel through the perspective of the virtual camera to determine a corresponding surface location for each pixel in the oblique-mosaic pixel map.

12. The system of claim 10 , wherein multiple source oblique images represent a same surface location.

13. The system of claim 12 , wherein the image processing software further causes the computer system to compare the pixels of each source oblique image that represent a same surface location to determine which source pixel is most representative of the surface location, the more representative pixel to be included in the oblique-mosaic image.

14. The system of claim 10 , wherein the pixel is reprojected to match a size and shape of the represented surface location as taken from the elevation, compass direction, and oblique angle of the virtual camera.

15. The system of claim 10 , wherein the image processing software further causes the computer system to remove effects of elevation from the source oblique images prior to reprojection and then to add the effects of elevation to the oblique-mosaic image after reprojection.

16. The system of claim 10 , wherein lean of vertical structures within the oblique mosaic image is minimized.

17. The system of claim 16 , wherein minimizing lean of vertical structures is defined further as matching vertical structures in multiple source oblique images and shifting pixels apparent location in at least one of the source oblique images by a relative height above a ground model.

18. The system of claim 10 , wherein metadata is stored with the oblique-mosaic image.

Assignments (10)
RELEASE OF SECURITY INTEREST Recorded Apr 14, 2025
From: HPS INVESTMENT PARTNERS, LLC
To: PICTOMETRY INTERNATIONAL CORP.
Reel/Frame 070828/0266 →
RELEASE OF FIRST LIEN SECURITY INTEREST IN PATENTS Recorded Apr 9, 2025
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.
Reel/Frame 070786/0022 →
FIRST LIEN SECURITY AGREEMENT Recorded Mar 28, 2025
From: EAGLE VIEW TECHNOLOGIES, INC.; PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 070671/0078 →
RELEASE OF FIRST LIEN SECURITY INTEREST IN PATENTS Recorded Aug 29, 2018
From: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
To: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.
Reel/Frame 046970/0875 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Aug 23, 2018
From: PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 046919/0065 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Aug 14, 2018
From: PICTOMETRY INTERNATIONAL CORP.
To: HPS INVESTMENT PARTNERS, LLC,
Reel/Frame 046823/0755 →
RELEASE OF SECOND LIEN SECURITY INTEREST Recorded Sep 22, 2017
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.
Reel/Frame 043955/0128 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jul 20, 2015
From: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 036130/0873 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jul 20, 2015
From: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 036130/0899 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2014
From: SCHULTZ, STEPHEN; GIUFFRIDA, FRANK D.; GRAY, ROBERT L.
To: PICTOMETRY INTERNATIONAL CORP.
Reel/Frame 031925/0724 →