IP Library Granted Patent US 7,295,686
Granted Patent B2
US 7,295,686 · App. 10/671,770 · Granted Nov 13, 2007

Method of processing red eye in digital images

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,295,686
App. No.
10/671,770
Granted
Nov 13, 2007
Kind
B2
Abstract

In a method of processing red eye in digital images, a skin area is first determined in an image. Then all inner boundaries within the skin area are picked up. The inner boundaries are matched with an eyelid quadratic curve to determine the location of the eyelid area. Red pixels within the eyelid area are then detected and filled up. A quadratic curve model can be further used to localize an iris area within the eyelid area to improve the precision of red eye localization as well as the processing speed.

Claims (33)

1. A method of processing red eye in digital images, comprising:

detecting a skin color area in an image;

picking up all boundaries within the detected skin color area;

detecting one boundary within the skin color area that matches with an eyelid quadratic curve to determine an eyelid area;

detecting red color pixels in the eyelid area; and

filling up the detected red color pixels with a predetermined color, thereby eliminating the red eye in the image.

2. The processing method of claim 1 , wherein detecting a skin color area in the image further comprises:

converting the image into an HIS format;

marking pixels with HIS values within the skin color area as skin color pixels; and

marking the continuous area composed by the skin color pixels as a skin color area.

3. The processing method of claim 1 , picking up all boundaries within the detected skin color area further comprises:

converting the skin color area into a gray scale image;

calculating a gradient of the gray scale image;

comparing the gradient values between two adjacent rows of pixels; and

marking as being part of a boundary the pixels for which the gradient value is greater than a gradient threshold reference.

4. The processing method of claim 1 , wherein picking up all boundaries within the detected skin color is performed by marking detected edges as boundaries.

5. The processing method of claim 1 , wherein picking up all boundaries within the detected skin color further comprises:

detecting a visage area within the skin color area; and

picking up all boundaries within the visage area.

6. The processing method of claim 5 , wherein detecting a visage area within the skin color area further comprises:

calculating a number of pixels and a number of pixel rows inside the skin color area; and

marking as a visage area a closed area of the skin color area that has the number of pixels and the number of pixel rows respectively greater than a pixel number reference and a pixel row number reference.

7. The processing method of claim 1 , wherein determining the eyelid area further comprises:

according to a expression of the eyelid quadratic curve, determining upper and lower eyelid quadratic curves;

calculating a horizontal coordinate error between respective apexes of the upper and lower eyelid curves; and

if the horizontal coordinate error is smaller than an apex reference value, an area enclosed by the upper and lower eyelid quadratic curve is an eyelid area.

8. The processing method of claim 1 , wherein a expression of the eyelid quadratic curve is:

Y=aX 2 +bX+c,

wherein if 0.01<−a<0.05 the eyelid quadratic curve is an upper eyelid quadratic curve, and if 0.01<a<0.05 the eyelid quadratic curve is a lower eyelid quadratic curve.

9. The processing method of claim 1 , further including detecting inner boundaries of the eyelid area that match with an iris quadratic curve to determine an iris area.

10. The processing method of claim 9 , wherein a expression of the iris quadratic curve is:

X=aY 2 +bY+c,

wherein if a>0 the iris quadratic curve is a left iris quadratic curve, and if a<0 the iris quadratic curve is a right iris quadratic curve.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2006
From: DESTINY TECHNOLOGY CORPORATION
To: PRIMAX ELECTRONICS LTD.
Reel/Frame 018342/0543 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2003
From: WU, SHANG-YUN
To: DESTINY TECHNOLOGY CORPORATION
Reel/Frame 014548/0853 →