IP Library Granted Patent US 11,087,506
Granted Patent B2
US 11,087,506 · App. 16/806,347 · Granted Aug 10, 2021

System and process for color-balancing a series of oblique images

Inventors: Stephen L. Schultz (West Henrietta, NY); Frank D. Giuffrida (Honeoye Falls, NY); Robert Gray (Canandiagua, NY)
Assignee: Pictometry International Corp.
G06T11/001G06K9/0063G06T5/001G06T7/90H04N1/6077H04N1/6083G06T2207/10024G06T2207/10032
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,087,506
App. No.
16/806,347
Granted
Aug 10, 2021
Kind
B2
Abstract

Image processing systems and methods are disclosed, including an image processing system comprising a computer running image processing software causing the computer to: divide an oblique aerial image into a plurality of sections, choose reference aerial image(s), having a consistent color distribution, for a first section and a second section; create a color-balancing transformation for the first and second sections of the oblique aerial image such that the first color distribution of the first section matches the consistent color distribution of the chosen reference aerial image and the second color distribution of the second section matches the consistent color distribution of the chosen reference aerial image; color-balance pixel(s) in the first and section sections of the oblique aerial image, such that at least one color-balancing transformation of the first and second sections matches the consistent color distribution of the reference aerial image(s).

Claims (33)

1. An image processing system, comprising:

a computer having image processing software that, when executed by the computer, causes the computer to:

divide an oblique aerial image into a plurality of sections, wherein a first section of the plurality of sections has a first color distribution and a second section of the plurality of sections has a second color distribution, the first color distribution differing from the second color distribution, and wherein each of the first section and the second section has pixels, each pixel having one or more color band;

choose one or more reference aerial image, having a consistent color distribution, for the first section and the second section by automatically matching at least a portion of geographic information of the one or more reference aerial image with at least a portion of geographic information of the first section and the second section;

create one or more first color-balancing transformation for one or more color band for the first section of the oblique aerial image, to match the first color distribution of the first section to the consistent color distribution of the chosen reference aerial image;

color-balance one or more pixel in the first section of the oblique aerial image using the one or more first color-balancing transformation, such that the first color distribution of the first section matches the consistent color distribution of the chosen reference aerial image;

create one or more second color-balancing transformation for the one or more color band for the second section of the oblique aerial image, to match the second color distribution of the second section to the consistent color distribution of the chosen reference aerial image; and

color-balance one or more pixel in the second section of the oblique aerial image using the one or more second color-balancing transformation, such that the second color distribution of the second section matches the consistent color distribution of the chosen reference aerial image.

2. The image processing system of claim 1 , wherein creating one or more color-balancing transformation for one or more color band for the first section and the second section of the oblique aerial image comprises creating a corresponding color-balancing transformation for each color band in a color space of the first section and the second section.

3. The image processing system of claim 1 , wherein creating one or more color-balancing transformation for one or more color band for the first section comprises creating two color-balancing transformations for two color bands for the first section, wherein color-balancing one or more pixel in the first section further comprises combining the two color-balancing transformations into a single pixel color value.

4. The image processing system of claim 1 , wherein the one or more color band comprises a red color band.

5. The image processing system of claim 1 , wherein the one or more color band comprises a blue color band.

6. The image processing system of claim 1 , wherein the one or more color band comprises a green color band.

7. The image processing system of claim 1 , wherein the first color distribution of the first section of the oblique aerial image is caused by first specular reflections and the second color distribution of the second section of the oblique aerial image is caused by second specular reflections.

8. The image processing system of claim 1 , wherein a difference between the first color distribution of the first section of the oblique aerial image and the second color distribution of the second section of the oblique aerial image is based on differing path length distances between a first location of a first point in the first section and a camera when the oblique aerial image was captured and a second location of a second point in the second section and the camera when the oblique aerial image was captured.

9. The image processing system of claim 1 , wherein the one or more reference aerial image comprises a nadir aerial image.

10. The image processing system of claim 1 , wherein the one or more reference aerial image comprises another oblique aerial image.

11. An image processing method for color-balancing oblique images, comprising:

dividing, with a computer running image processing software, an oblique aerial image into a plurality of sections, wherein a first section of the plurality of sections has a first color distribution and a second section of the plurality of sections has a second color distribution, the first color distribution differing from the second color distribution, and wherein each of the first section and the second section has pixels, each pixel having at least one color band;

choosing, with the computer, one or more reference aerial image, having a consistent color distribution, for the first section and the second section by automatically matching at least a portion of geographic information of the one or more reference aerial image with at least a portion of geographic information of the first section and the second section;

creating, with the computer, one or more first color-balancing transformation for one or more color band for the first section of the oblique aerial image, to match the first color distribution of the first section to the consistent color distribution of the chosen reference aerial image;

color-balancing, with the computer, one or more pixel in the first section of the oblique aerial image using the one or more first color-balancing transformation, such that the first color distribution of the first section matches the consistent color distribution of the chosen reference aerial image;

creating, with the computer, one or more second color-balancing transformation for the one or more color band for the second section of the oblique aerial image, to match the second color distribution of the second section to the consistent color distribution of the chosen reference aerial image; and

color-balancing, with the computer, one or more pixel in the second section of the oblique aerial image using the one or more second color-balancing transformation, such that the second color distribution of the second section matches the consistent color distribution of the chosen reference aerial image.

12. The image processing method of claim 11 , wherein creating one or more color-balancing transformation for one or more color band for the first section and the second section of the oblique aerial image comprises creating a corresponding color-balancing transformation for each color band in a color space of the first section and the second section.

13. The image processing method of claim 11 , wherein creating one or more color-balancing transformation for one or more color band for the first section comprises creating two color-balancing transformations for two color bands for the first section, wherein color-balancing one or more pixel in the first section further comprises combining the two color-balancing transformations into a single pixel color value.

14. The image processing method of claim 11 , wherein the one or more color band comprises a red color band.

15. The image processing method of claim 11 , wherein the one or more color band comprises a blue color band.

16. The image processing method of claim 11 , wherein the one or more color band comprises a green color band.

17. The image processing method of claim 11 , wherein the first color distribution of the first section of the oblique aerial image is caused by first specular reflections and the second color distribution of the second section of the oblique aerial image is caused by second specular reflections.

18. The image processing method of claim 11 , wherein a difference between the first color distribution of the first section of the oblique aerial image and the second color distribution of the second section of the oblique aerial image is based on differing path length distances between a first location of a first point in the first section and a camera when the oblique aerial image was captured and a second location of a second point in the second section and the camera when the oblique aerial image was captured.

19. The image processing method of claim 11 , wherein the one or more reference aerial image comprises a nadir aerial image.

20. The image processing method of claim 11 , wherein the one or more reference aerial image comprises another oblique aerial image.

Assignments (4)
RELEASE OF FIRST LIEN SECURITY INTEREST IN PATENTS Recorded Apr 9, 2025
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.
Reel/Frame 070786/0022 →
FIRST LIEN SECURITY AGREEMENT Recorded Mar 28, 2025
From: EAGLE VIEW TECHNOLOGIES, INC.; PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 070671/0078 →
FIRST LIEN PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Feb 3, 2025
From: EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.; PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC. AS COLLATERAL AGENT
Reel/Frame 070096/0485 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 2, 2020
From: SCHULTZ, STEPHEN L.; GIUFFRIDA, FRANK D.; GRAY, ROBERT L.
To: PICTOMETRY INTERNATIONAL CORP.
Reel/Frame 051980/0297 →
Continuity (7)
Continuation 16191232 · Nov 14, 2018
Continuation 15357490 · Nov 21, 2016
Continuation 14632732 · Feb 26, 2015
Continuation 14153772 · Jan 13, 2014
Continuation 13181259 · Jul 12, 2011
Continuation 11871740 · Oct 12, 2007
Related Publication 20200202583A1 · Jun 25, 2020