IP Library Granted Patent US 8,520,094
Granted Patent B2
US 8,520,094 · App. 13/159,505 · Granted Aug 27, 2013

Flicker detecting circuit and method in image sensor

Inventors: Pyeong-Woo Lee (Chungcheongbuk-do, KR); Chae-Sung Kim (Chungcheongbuk-do, KR); Jeong-Guk Lee (Chungcheongbuk-do, KR)
Assignee: Intellectual Ventures II LLC
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,520,094
App. No.
13/159,505
Granted
Aug 27, 2013
Kind
B2
Abstract

A circuit includes a luminance average value output unit for extracting luminance values from pixel data of the first and the second frames to generate first luminance average values for pixel lines of the first frame and second luminance average values for pixel lines of the second frame, a flicker curve generating unit for subtracting the second luminance average values from the first luminance average values, thereby generating a flicker curve, and a flicker detecting unit for extracting a plurality of local minimum points from the flicker curve, calculating a distance between each two neighboring local minimum points of the extracted local minimum points, and determining whether the flicker is present based on the distances and the frequency numbers of the distances.

Claims (81)

1. A method, comprising:

determining, based on chrominance values of a first frame and a second frame, an estimated motion between the first frame including a plurality of lines and the second frame including a plurality of lines;

generating a flicker curve based on a change between lines of the first frame and corresponding lines of the second frame, wherein correspondence between lines of the first frame and lines of the second frame is based on the estimated motion; and

detecting flicker based on the flicker curve.

2. The method of claim 1 , wherein said determining an estimated motion comprises:

determining a plurality of first chrominance average values, each first chrominance average value corresponding to an average of chrominance values in a respective line of the first frame;

determining a plurality of second chrominance average values, each second chrominance average value corresponding to an average of chrominance values in a respective line of the second frame; and

estimating an offset between the second frame and the first frame based on the plurality of first chrominance average values and the plurality of second chrominance average values.

3. A method, comprising:

determining an estimated motion between a first frame including a plurality of lines and a second frame including a plurality of lines;

generating a flicker curve based on a change between lines of the first frame and corresponding lines of the second frame, wherein correspondence between lines of the first frame and lines of the second frame is based on the estimated motion;

detecting flicker based on the flicker curve; and

adjusting an exposure time based on the flicker detected.

4. The method of claim 3 , wherein said determining an estimated motion comprises:

determining a plurality of first average values, each first average value corresponding to an average of values in a respective line of the first frame;

determining a plurality of second average values, each second average value corresponding to an average of values in a respective line of the second frame; and

estimating an offset between the second frame and the first frame based on the plurality of first average values and the plurality of second average values.

5. The method of claim 3 , wherein said determining an estimated motion comprises:

determining a first absolute difference between the plurality of lines of the first frame and corresponding lines of the second frame using a first correspondence between lines of the first frame and lines of the second frame;

determining a second absolute difference between the plurality of lines of the first frame and corresponding lines of the second frame using a second correspondence between lines of the first frame and lines of the second frame; and

estimating an offset between the second frame and the first frame based on the first absolute difference and the second absolute difference.

6. The method of claim 3 , wherein said determining an estimated motion comprises:

determining a plurality of absolute differences between the plurality of lines of the first frame and corresponding lines of the second frame, wherein each absolute difference is determined based on a different correspondence between lines of the first frame and lines of the second frame; and

estimating an offset between the second frame and the first frame based on the plurality of absolute differences.

7. The method of claim 3 , wherein said determining an estimated motion comprises:

determining a plurality of absolute differences between the plurality of lines of the first frame and corresponding lines of the second frame, wherein each absolute difference is determined based on a different correspondence between lines of the first frame and lines of the second frame;

identifying a minimum absolute difference of the plurality of absolute differences; and

estimating an offset between the second frame and the first frame based on the identified minimum absolute difference and its associated correspondence between lines of the first frame and lines of the second frame.

8. An apparatus, comprising:

a motion estimating unit configured to determine, based on chrominance values of a first frame and a second frame, an estimated motion between the first frame including a plurality of lines and the second frame including a plurality of lines;

a flicker curve generating unit configured to generate a flicker curve based on a change between lines of the first frame and corresponding lines of the second frame, wherein the correspondence between lines of the first frame and lines of the second frame is based on the estimated motion; and

a flicker detecting unit configured to detect flicker based on the flicker curve.

9. The apparatus of claim 8 , further comprising:

a storage unit configured to store a plurality of first chrominance average values, each first chrominance average value corresponding to an average of chrominance values in a respective line of the first frame; and

another storage unit configured to store a plurality of second chrominance average values, each second chrominance average value corresponding to an average of chrominance values in a respective line of the second frame;

wherein the motion estimating unit is further configured to estimate an offset between the second frame and the first frame based on the plurality of first chrominance average values from the storage unit and the plurality of second chrominance average values from the other storage unit.

10. The apparatus of claim 9 , wherein the motion estimating unit is further configured to:

determine a first absolute difference between the plurality of first chrominance average values and corresponding second chrominance average values based on a first correspondence between lines of the first frame and lines of the second frame;

determine a second absolute difference between the plurality of first chrominance average values and corresponding second chrominance average values based on a second correspondence between lines of the first frame and lines of the second frame; and

estimate an offset between the second frame and the first frame based on the first absolute difference and the second absolute difference.

11. The apparatus of claim 9 , wherein the motion estimating unit is further configured to:

determine a plurality of absolute differences between the plurality of first chrominance average values from the first storage area and corresponding second chrominance average values from the second storage area;

determine each absolute difference based on a different correspondence between lines of the first frame and lines of the second frame; and

estimate an offset between the second frame and the first frame based on the plurality of absolute differences.

12. The apparatus of claim 9 , wherein the motion estimating unit is further configured to:

determine a plurality of absolute differences between the plurality of first chrominance average values from the first storage area and corresponding second chrominance average value from the second storage area;

determine each absolute difference based on a different correspondence between lines of the first frame and lines of the second frame;

identify a minimum absolute difference of the plurality of absolute differences; and

estimate an offset between the second frame and the first frame based on the identified minimum absolute difference and its associated correspondence between lines of the first frame and lines of the second frame.

13. An apparatus, comprising:

a motion estimating unit configured to determine an estimated motion between a first frame including a plurality of lines and a second frame including a plurality of lines;

a flicker curve generating unit configured to generate a flicker curve based on a change between lines of the first frame and corresponding lines of the second frame, wherein the correspondence between lines of the first frame and lines of the second frame is based on the estimated motion;

a flicker detecting unit configured to detect flicker based on the flicker curve; and

an automatic exposure device configured to adjust an exposure time in response to a flicker state detecting signal;

wherein the flicker detecting unit is further configured to generate the flicker state detecting signal in response to detecting flicker based on the flicker curve.

14. The apparatus of claim 13 , further comprising:

a storage unit configured to store a plurality of first average values, each first average value corresponding to an average of values in a respective line of the first frame; and

another storage unit configured to store a plurality of second average values, each second average value corresponding to an average of values in a respective line of the second frame;

wherein the motion estimating unit is further configured to estimate an offset between the second frame and the first frame based on the plurality of first average values from the storage unit and the plurality of second average values from the other storage unit.

15. An apparatus, comprising:

an image sensor configured to consecutively capture a first frame comprising a plurality of first lines and a second frame comprising a plurality of second lines;

a chrominance average value generation unit configured determine a chrominance average value for each line of the plurality of first lines and for each line of the plurality of second lines;

a motion estimating unit configured to determine an estimated motion between the first frame and the second frame based on the chrominance average values for the plurality of first lines and the chrominance average values for the plurality of second lines;

a flicker curve generating unit configured to generate a flicker curve based on a change between lines of the first frame and corresponding lines of the second frame, wherein the correspondence between lines of the first frame and lines of the second frame is based on the estimated motion; and

a flicker detecting unit configured to detect flicker based on the flicker curve.

16. The apparatus of claim 15 , further comprising:

an automatic exposure device configured to adjust an exposure time in response to a flicker state detecting signal;

wherein the flicker detecting unit is further configured to generate the flicker state detecting signal in response to detecting flicker based on the flicker curve.

17. The apparatus of claim 15 , further comprising:

a storage unit configured to store the chrominance average values for the plurality of first lines; and

another storage unit configured to store the chrominance average values for the plurality of second lines.

18. The apparatus of claim 15 , wherein the motion estimating unit is further configured to estimate an offset between the second frame and the first frame based on the chrominance average values for the plurality of first lines and the chrominance average values for the plurality of second lines.

19. The apparatus of claim 15 , wherein the motion estimating unit is further configured to:

determine a plurality of absolute differences between the chrominance average values for the plurality of first lines and corresponding chrominance average values for the plurality of second lines;

determine each absolute difference based on a different correspondence between the plurality of first lines and the plurality of second lines; and

estimate an offset between the second frame and the first frame based on the plurality of absolute differences.

20. The apparatus of claim 15 , wherein the motion estimating unit is further configured to:

determine a plurality of absolute differences between the chrominance average values for the plurality of first lines and corresponding chrominance average values for the plurality of second lines;

determine each absolute difference based on a different correspondence between the plurality of first lines and the plurality of second lines;

identify a minimum absolute difference of the plurality of absolute differences; and

estimate an offset between the second frame and the first frame based on the identified minimum absolute difference and its associated correspondence between the plurality of first lines and the plurality of second lines.

Assignments (5)
CHANGE OF NAME Recorded Dec 18, 2024
From: TP-LINK USA CORPORATION
To: TP-LINK SYSTEMS INC.
Reel/Frame 069715/0940 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2024
From: INTELLECTUAL VENTURES ASSETS 192 LLC
To: TP-LINK USA CORPORATION
Reel/Frame 067142/0902 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2024
From: INTELLECTUAL VENTURES II LLC
To: INTELLECTUAL VENTURES ASSETS 192 LLC
Reel/Frame 066791/0849 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2024
From: MAGNACHIP SEMICONDUCTOR, LTD.
To: CROSSTEK CAPITAL, LLC
Reel/Frame 066698/0521 →
MERGER Recorded Jul 22, 2011
From: CROSSTEK CAPITAL, LLC
To: INTELLECTUAL VENTURES II LLC
Reel/Frame 026637/0632 →
Priority Claims (1)
KR 10-2005-0127857 · Dec 22, 2005 · national
Continuity (2)
Continuation 11642597 · Dec 21, 2006
Related Publication 20110242359A1 · Oct 6, 2011