IP Library Granted Patent US 10,735,669
Granted Patent B2
US 10,735,669 · App. 16/104,298 · Granted Aug 4, 2020

Method of flicker reduction

Inventors: Andrew Dewhurst (Barrow-Upon-Soar, GB); David Hanwell (Stapleford, GB)
Assignee: Apical Ltd.
H04N5/2357H04N5/2355
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,735,669
App. No.
16/104,298
Granted
Aug 4, 2020
Kind
B2
Abstract

A method for reducing artefacts caused by the presence of flicker during image capture. The method comprises performing image capture to produce image capture data corresponding to an image capture scene, the image capture data including a first image having a first exposure and a second image having a second exposure. The image capture data is processed to: (a) detect a discrepancy in the second image with respect to the first image; and (b) determine flicker indication data indicative of a presence of flicker in the second image. The discrepancy is corrected in dependence upon the flicker indication to produce a flicker-reduced version of the second image.

Claims (60)

1. A method for reducing artefacts caused by the presence of flicker during image capture, the method comprising:

performing image capture to produce image capture data corresponding to an image capture scene, the image capture data including a first image having a first exposure and a second image having a second exposure;

processing the image capture data to:

(a) detect a discrepancy in the second image with respect to the first image; and

(b) determine flicker indication data indicative of a presence of flicker in the second image;

determining from the flicker indication data whether the discrepancy is due to the presence of flicker in the second image;

if the discrepancy is determined to be due to the presence of flicker in the second image, applying a flicker reduction correction to said second image, the flicker reduction correction comprising processing the image capture data to correct the discrepancy in said second image to produce a flicker-reduced version of the second image; and

if the discrepancy is determined not to be due to the presence of flicker in the second image, not applying the flicker reduction correction to said second image.

2. The method according to claim 1 , wherein determining said flicker indication data comprises calculating at least one parameter indicative of a likelihood of flicker being present in the second image, the at least one parameter comprising a parameter calculated in dependence on the detected discrepancy.

3. The method according to claim 2 , wherein:

the first image is a video frame of a first sequence of video frames;

the second image is a video frame of a second sequence of video frames; and

the at least one parameter comprises a parameter calculated from a detected discrepancy between a prior video frame of the first sequence and a corresponding prior video frame of the second sequence.

4. The method according to claim 2 , wherein:

the first image is a video frame of a first sequence of video frames;

the second image is a video frame of a second sequence of video frames; and

the at least one parameter comprises a parameter calculated from a detected discrepancy between the second image and a flicker-reduced version of a prior video frame of the second sequence.

5. The method according to claim 3 , wherein the correcting of the discrepancy in said second image comprises combining said second image with a flicker-reduced version of said prior video frame of the second sequence.

6. The method according to claim 3 , wherein the method is performed in real time to produce a flicker-reduced version of the second sequence.

7. The method according to claim 1 , wherein the second exposure is smaller than the first exposure.

8. The method according to claim 1 , comprising:

capturing the first image with a first array of image sensor pixels; and

capturing the second image with a second array of image sensor pixels, the pixels of the second array having a lower sensitivity than the pixels of the first array.

9. The method according to claim 1 , comprising forming an output high dynamic range image based on the first image and the flicker-reduced version of the second image.

10. The method according to claim 9 , comprising forming the output high dynamic range image based on the flicker indication data.

11. The method according to claim 1 , comprising detecting the discrepancy between the first and second images based on a predicted version of one of the first and second images, the predicted version being based on the other of the first and second images.

12. The method according to claim 11 , comprising:

if the discrepancy is determined not to be due to the presence of flicker in the second image, applying a motion correction to said second image.

13. The method according to claim 1 , wherein the first image is captured over a number of flicker cycles which exceeds a threshold number for the first image to be substantially resilient to flicker.

14. The method according to claim 1 , wherein the first image is captured over at least ten flicker cycles.

15. The method according to claim 1 , wherein the second image is captured over a smaller number of flicker cycles than the first image.

16. An apparatus for reducing artefacts caused by the presence of flicker during image capture, the apparatus comprising:

a receiver configured to receive image capture data corresponding to an image capture scene, the image capture data including a first image having a first exposure and a second image having a second exposure; and

a processor configured to process the image capture data to:

(a) detect a discrepancy in the second image with respect to the first image; and

(b) determine flicker indication data indicative of a presence of flicker in the second image,

the processor being configured to:

determine from the flicker indication data whether the discrepancy is due to the presence of flicker in the second image;

if the discrepancy is determined to be due to the presence of flicker in the second image, apply a flicker reduction correction to said second image, the flicker reduction correction comprising processing the image capture data to correct the discrepancy in said second image to produce a flicker-reduced version of the second image; and

if the discrepancy is determined not to be due to the presence of flicker in the second image, not apply the flicker reduction correction to said second image.

17. The apparatus according to claim 16 , wherein:

the first image is a video frame of a first sequence of video frames;

the second image is a video frame of a second sequence of video frames; and

determining said flicker indication data comprises calculating at least one parameter indicative of a likelihood of flicker being present in the second image, the at least one parameter comprising a parameter calculated from a detected discrepancy between a prior video frame of the first sequence and a corresponding prior video frame of the second sequence.

18. The apparatus according to claim 16 , wherein:

the first image is a video frame of a first sequence of video frames;

the second image is a video frame of a second sequence of video frames; and

the at least one parameter comprises a parameter calculated from a detected discrepancy between the second image and a flicker-reduced version of a prior video frame of the second sequence.

19. A non-transitory computer-readable storage medium comprising a set of computer-readable instructions stored thereon which, when executed by at least one processor, cause the at least one processor to:

receive image capture data corresponding to an image capture scene, the image capture data including a first image having a first exposure and a second image having a second exposure;

process the image capture data to:

(a) detect a discrepancy in the second image with respect to the first image; and

(b) determine flicker indication data indicative of a presence of flicker in the second image;

determine from the flicker indication data whether the discrepancy is due to the presence of flicker in the second image;

if the discrepancy is determined to be due to the presence of flicker in the second image, apply a flicker reduction correction to said second image, the flicker reduction correction comprising processing the image capture data to correct the discrepancy in said second image to produce a flicker-reduced version of the second image; and

if the discrepancy is determined not to be due to the presence of flicker in the second image, not apply the flicker reduction correction to said second image.

20. The non-transitory computer-readable storage medium according to claim 19 , wherein:

the first image is a video frame of a first sequence of video frames;

the second image is a video frame of a second sequence of video frames; and

determining said flicker indication data comprises calculating at least one parameter indicative of a likelihood of flicker being present in the second image, the at least one parameter comprising a parameter calculated from a detected discrepancy between a prior video frame of the first sequence and a corresponding prior video frame of the second sequence.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2022
From: APICAL LIMITED
To: ARM LIMITED
Reel/Frame 061300/0471 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2018
From: HANWELL, DAVID; DEWHURST, ANDREW
To: APICAL LIMITED
Reel/Frame 046768/0561 →
Priority Claims (1)
GB 1713279.6 · Aug 18, 2017 · national
Continuity (1)
Related Publication 20190058823A1 · Feb 21, 2019
Cited By (1)
US 12,231,780