IP Library Granted Patent US 9,355,456
Granted Patent B2
US 9,355,456 · App. 13/807,551 · Granted May 31, 2016

Method, apparatus and computer program product for compensating eye color defects

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,355,456
App. No.
13/807,551
Granted
May 31, 2016
Kind
B2
Abstract

A red-eye detection and correction method includes computing a first difference image based on a difference between red pixel intensity and green pixel intensity of a set of pixels. The set of pixels are associated with a first eye region of an image. The method further includes processing the first difference image for computing at least one gradient and at least one projection associated with the at least one gradient. Furthermore, the method includes determining at least one central point based on the at least one projection; and thereafter computing the first eye color defect region based on the at least one central point and a plurality of red pixels of the set of pixels. The method also includes mapping an eye color defect location information computed from a low resolution image to be applicable on the original high resolution image, thereby avoiding recomputation.

Claims (61)

1. A method comprising:

computing a first difference image based on a difference between red pixel intensity and green pixel intensity of a set of pixels, the set of pixels being associated with a first eye region of an image, wherein the first eye region comprises a plurality of quadrantal regions; and the set of pixels comprise at least one pixel of an eye color defect region of at least one of the plurality of quadrantal regions of the first eye region and at least one pixel from a non-defect eye portion of the at least one of the plurality of quadrantal regions of the first eye region;

processing the first difference image for computing at least one gradient and at least one projection associated with one or more gradient, wherein the one or more gradient comprises a first order gradient in a first direction and a first order gradient in a second direction different than the first direction;

determining at least one central point based on the at least one projection; and

computing the first eye color defect region based on the at least one central point and a plurality of red pixels of the set of pixels.

2. The method of claim 1 , wherein the image is a low resolution (LR) image.

3. The method of claim 1 , wherein the at least one projection comprises at least one horizontal projection, and at least one vertical projection associated with the at least one gradient.

4. The method of claim 1 , wherein determining the at least one central point comprises determining at least one significant peak of the at least one projection, and wherein a pixel location corresponding to the at least one significant peak is the at least one central point of the first eye color defect region.

5. The method of claim 1 further comprising performing one or more verifications of a presence of a first eye color defect in the first eye color defect region when the first eye color defect region is computed.

6. The method of claim 5 further comprising determining a confidence indicator for indicating presence of the first eye color defect at the first eye color defect region,

wherein the first eye color defect is determined to be present in the first eye color defect region when the confidence indicator is more than a first predetermined threshold, and

wherein the first eye color defect is determined to be absent in the first eye color defect region when the confidence indicator is less than a second predetermined threshold.

7. A method comprising:

determining a first eye color defect region in a low resolution (LR) image, the LR image being produced from a high resolution (HR) image, wherein the first eye color defect region comprises a plurality of quadrantal regions;

determining an eye color defect information for the LR image, the eye color defect information comprising a set of identifiers associated with a plurality of first peripheral portions of the first eye color defect region in the LR image, wherein the set of identifiers comprises at least one intensity value of an eye defect portion of at least one of the plurality of quadrantal regions of the first eye color defect region and at least one intensity value of a non-defect eye portion of the at least one of the plurality of quadrantal regions of the first eye color defect region;

mapping the eye color defect information computed from the LR image to be applicable on the HR image, the HR image comprising:

a second eye color defect region corresponding to the at least one of the plurality of quadrantal regions of the first eye color defect region in the LR image; and

a plurality of second peripheral portions of the second eye color defect region corresponding to a plurality of first peripheral portions of the first eye color defect region; and

processing the HR image to identify an eye color defect in at least one of the plurality of the second peripheral portions based on the set of identifiers.

8. An apparatus comprising:

at least one processor; and

at least one memory comprising computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:

compute a first difference image based on a difference between red pixel intensity and green pixel intensity of a set of pixels, the set of pixels being associated with a first eye region of an image, wherein the first eye region comprises a plurality of quadrantal regions; and the set of pixels comprise at least one pixel of an eye color defect region of at least one of the plurality of quadrantal regions of the first eye region and at least one pixel from a non-defect eye portion of the at least one of the plurality of quadrantal regions of the first eye region;

process the first difference image for computing at least one gradient and at least one projection associated with one of more gradient, wherein the one or more gradient comprises a first order gradient in a first direction and a first order gradient in a second direction different than the first direction;

determine at least one central point based on the at least one projection; and

compute the first eye color defect region based on the at least one central point and a plurality of red pixels of the set of pixels.

9. The apparatus of claim 8 , wherein the image is a low resolution (LR) image.

10. The apparatus of claim 8 , wherein the at least one projection comprises at least one horizontal projection, and at least one vertical projection associated with the at least one gradient.

11. The apparatus of claim 8 , wherein the apparatus is further caused, at least in part, to determine the at least one central point by determining at least one significant peak of the at least one projection, and wherein a pixel location corresponding to the at least one significant peak being the at least one central point of the first eye color defect region.

12. The apparatus of claim 8 , wherein the apparatus is further caused, at least in part, to perform one or more verifications of a presence of a first eye color defect in the first eye color defect region when the first eye color defect region is computed.

13. The apparatus of claim 12 , wherein the apparatus is further caused, at least in part, to determine a confidence indicator for indicating presence of a first eye color defect at the first eye color defect region,

wherein the first eye color defect is determined to be present in the first eye color defect region when the confidence indicator is more than a first predetermined threshold, and

wherein the first eye color defect is determined to be absent in the first eye color defect region when the confidence indicator is less than a second predetermined threshold.

14. An apparatus comprising:

at least one processor; and

at least one memory comprising computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:

determine a first eye color defect region in a low resolution (LR) image, the LR image being produced from a high resolution (HR) image, wherein the first eye color defect region comprises a plurality of quadrantal regions;

determine an eye color defect information for the LR image, the eye color defect information comprising a set of identifiers associated with a plurality of first peripheral portions of the first eye color defect region in the LR image, wherein the set of identifiers comprises at least one intensity value of an eye defect portion of at least one of the plurality of quadrantal regions of the first eye color defect region and at least one intensity value of a non-defect eye portion of the at least one of the plurality of quadrantal regions of the first eye color defect region;

map the eye color defect information computed from the LR image to be applicable on the HR image, the HR image comprising:

a second eye color defect region corresponding to the at least one of the plurality of quadrantal regions of the first eye color defect region in the LR image; and

a plurality of second peripheral portions of the second eye color defect region corresponding to a plurality of first peripheral portions of the first eye color defect region; and

process the HR image to identify an eye color defect in at least one of the plurality of the second peripheral portions based on the set of identifiers.

15. A computer program product comprising at least one non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium comprising a set of instructions, which, when executed by one or more processors, cause an apparatus to at least perform:

computing a first difference image based on a difference between red pixel intensity and green pixel intensity of a set of pixels, the set of pixels being associated with a first eye region of an image, wherein the first eye region comprises a plurality of quadrantal regions; and the set of pixels comprise at least one pixel of an eye color defect region of at least one of the plurality of quadrantal regions of the first eye region and at least one pixel from a non-defect eye portion of the at least one of the plurality of quadrantal regions of the first eye region;

processing the first difference image for computing at least one gradient and at least one projection associated with one of more gradient, wherein the one or more gradient comprises a first order gradient in a first direction and a first order gradient in a second direction different than the first direction;

determining at least one central point based on the at least one projection; and

computing the first eye color defect region based on the at least one central point and a plurality of red pixels of the set of pixels.

16. The computer program product of claim 15 , wherein the image is a LR image.

17. The computer program product of claim 15 , wherein the at least one projection comprises at least one horizontal projection, and at least one vertical projection associated with the at least one gradient.

18. The computer program product of claim 15 , wherein the apparatus is further caused, at least in part, to determine the at least one central point by determining at least one significant peak of the at least one projection, and wherein a pixel location corresponding to the at least one significant peak being the at least one central point of the first eye color defect region.

19. The computer program product of claim 15 , wherein the apparatus is further caused, at least in part, to perform one or more verifications of a presence of a first eye color defect in the first eye color defect region when the first eye color defect region is computed.

20. The computer program product of claim 19 , wherein the apparatus is further caused, at least in part, to determine a confidence indicator for indicating presence of the first eye color defect at the first eye color defect region,

wherein the first eye color defect is determined to be present in the first eye color defect region when the confidence indicator is more than a first predetermined threshold, and

wherein the first eye color defect is determined to be absent in the first eye color defect region when the confidence indicator is less than a second predetermined threshold.

21. A computer program product comprising at least one non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium comprising a set of instructions, which, when executed by one or more processors, cause an apparatus to at least perform:

determining a first eye color defect region in a low resolution (LR) image, the LR image being produced from a high resolution (HR) image, wherein the first eye color defect region comprises a plurality of quadrantal regions;

determining an eye color defect information for the LR image, the eye color defect information comprising a set of identifiers associated with a plurality of first peripheral portions of the first eye color defect region in the LR image, wherein the set of identifiers comprises at least one intensity value of an eye defect portion of at least one of the plurality of quadrantal regions of the first eye color defect region and at least one intensity value of a non-defect eye portion of the at least one of the plurality of quadrantal regions of the first eye color defect region;

mapping the eye color defect information computed from the LR image to be applicable on the HR image, the HR image comprising:

a second eye color defect region corresponding to the at least one of the plurality of quadrantal regions of the first eye color defect region in the LR image; and

a plurality of second peripheral portions of the second eye color defect region corresponding to a plurality of first peripheral portions of the first eye color defect region; and

processing the HR image to identify an eye color defect in at least one of the plurality of the second peripheral portion based on the set of identifiers.

Assignments (12)
PATENT SECURITY AGREEMENT Recorded Aug 6, 2024
From: RPX CORPORATION; RPX CLEARINGHOUSE LLC
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 068328/0674 →
RELEASE OF LIEN ON PATENTS Recorded Aug 5, 2024
From: BARINGS FINANCE LLC
To: RPX CORPORATION
Reel/Frame 068328/0278 →
PATENT SECURITY AGREEMENT Recorded Apr 22, 2023
From: RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 063429/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: PROVENANCE ASSET GROUP LLC
To: RPX CORPORATION
Reel/Frame 059352/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: NOKIA US HOLDINGS INC.
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058363/0723 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: CORTLAND CAPITAL MARKETS SERVICES LLC
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058983/0104 →
ASSIGNMENT AND ASSUMPTION AGREEMENT Recorded Feb 14, 2019
From: NOKIA USA INC.
To: NOKIA US HOLDINGS INC.
Reel/Frame 048370/0682 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2017
From: NOKIA TECHNOLOGIES OY; NOKIA SOLUTIONS AND NETWORKS BV; ALCATEL LUCENT SAS
To: PROVENANCE ASSET GROUP LLC
Reel/Frame 043877/0001 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP LLC
To: NOKIA USA INC.
Reel/Frame 043879/0001 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP, LLC
To: CORTLAND CAPITAL MARKET SERVICES, LLC
Reel/Frame 043967/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 035468/0824 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2013
From: S-V, BASAVARAJ; GOVINDARAO, KRISHNA; MUNINDER, VELDANDI; MISHRA, PRANAV
To: NOKIA CORPORATION
Reel/Frame 030384/0515 →