IP Library Granted Patent US 10,863,155
Granted Patent B2
US 10,863,155 · App. 16/231,772 · Granted Dec 8, 2020

Reduction of banding artifacts in image processing

Inventor: Romain Gounelle (Haut de Seine, FR)
Assignee: GoPro, Inc.
H04N9/646H04N5/20H04N5/2254H04N5/23216H04N5/232933H04N5/243H04N9/68
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,863,155
App. No.
16/231,772
Granted
Dec 8, 2020
Kind
B2
Abstract

An image capture device may detect and repair banding artifacts in a video. The image capture device may include an image sensor and an image processor. The image sensor may capture a frame that includes a sinusoidal light waveform banding artifact. The image processor may detect a sinusoidal light waveform in the frame. The image processor may perform a sinusoidal regression. The image processor may obtain an inverted gain map. The image processor may apply the inverted gain map to the frame. The image processor may output the frame.

Claims (40)

1. A method comprising:

detecting a sinusoidal light waveform in a frame that includes a banding artifact;

obtaining a gain map based on the sinusoidal light waveform;

obtaining an inverted gain map based on the gain map via a sinusoidal regression based on a timing of the frame and a frequency of the sinusoidal light waveform;

applying the inverted gain map to the frame to repair the banding artifact to obtain a repaired frame; and

outputting the repaired frame.

2. The method of claim 1 , further comprising:

applying a subsequent inverted gain map to a subsequent frame, wherein the subsequent inverted gain map is based on the frequency of the sinusoidal light waveform.

3. The method of claim 1 , wherein the sinusoidal light waveform is detected based on image content data.

4. The method of claim 1 , wherein the sinusoidal light waveform is detected based on luminance data of the frame.

5. The method of claim 1 , wherein the sinusoidal light waveform is detected based on a timing of each frame based on a sensor configuration.

6. The method of claim 5 , wherein the sensor configuration includes a clock.

7. The method of claim 5 , wherein the sensor configuration includes a PLL divider.

8. The method of claim 1 further comprising:

performing a temporal subtraction to remove noise data from the frame.

9. The method of claim 1 , wherein the sinusoidal light waveform is detected based on infrared (IR) sensor data.

10. An image capture device comprising:

an image sensor configured to capture a frame that includes a sinusoidal light waveform banding artifact; and

an image processor configured to:

detect a sinusoidal light waveform in the frame;

perform a sinusoidal regression based on a timing of the frame and a frequency of the sinusoidal light waveform;

obtain an inverted gain map;

apply the inverted gain map to the frame; and

output the frame.

11. The image capture device of claim 10 , wherein the image processor is further configured to match an ambient light to a known light pulse frequency based on a location of the image capture device.

12. The image capture device of claim 10 , wherein the image processor is further configured to apply a subsequent inverted gain map to a subsequent frame, wherein the subsequent inverted gain map is based on the frequency of the sinusoidal light waveform.

13. The image capture device of claim 10 , wherein the frequency is 50 Hz or 60 Hz.

14. The image capture device of claim 10 , wherein the image processor is configured to perform the sinusoidal regression to synchronize a respective inverted gain map with each subsequent frame based on a timing of each subsequent frame and the frequency of the sinusoidal light waveform.

15. The image capture device of claim 10 , wherein the image processor is configured to apply each respective inverted gain map to a respective subsequent frame.

16. A method comprising:

detecting a sinusoidal light waveform in a first frame of a plurality of frames;

determining a frequency of the sinusoidal light waveform;

performing a sinusoidal regression to obtain a first inverted gain map for the first frame, wherein the sinusoidal regression is based on a timing of the first frame and the frequency of the sinusoidal light waveform;

applying the first inverted gain map to the first frame; and

applying a respective inverted gain map to each of the plurality of frames, wherein each respective gain map is based on a timing of each respective frame of the plurality of frames and the frequency of the sinusoidal light waveform.

17. The method of claim 16 , wherein the sinusoidal light waveform is detected based on luminance data of the first frame.

18. The method of claim 16 further comprising:

performing a temporal subtraction to remove noise data from the first frame.

19. The method of claim 16 , wherein the sinusoidal light waveform is detected based on infrared (IR) sensor data.

20. The method of claim 16 , wherein the frequency is 50 Hz or 60 Hz.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2019
From: GOUNELLE, ROMAIN
To: GOPRO, INC.
Reel/Frame 048556/0205 →
SECURITY INTEREST Recorded Mar 5, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 048508/0728 →
Continuity (1)
Related Publication 20200204772A1 · Jun 25, 2020
Cited By (1)
US 1,122,334