IP Library Granted Patent US 10,757,384
Granted Patent B2
US 10,757,384 · App. 16/043,487 · Granted Aug 25, 2020

Desaturation control

Inventors: Bruno César Douady-Pleven (Bures-sur-Yvette, FR); Thomas Nicolas Emmanuel Veit (Meudon, FR); Marc Lebrun (Issy-les-Moulineaux, FR)
Assignee: GoPro, Inc.
H04N9/646G06T5/002G06T5/50G06T7/90H04N9/04517G06T2207/10024G06T2207/20182
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,757,384
App. No.
16/043,487
Granted
Aug 25, 2020
Kind
B2
Abstract

Image signal processing may include desaturation control, which may include adaptive desaturation control. Image signal processing with desaturation control may include obtaining, by an image signal processor, from an image sensor, an input image signal representing an input image, obtaining, by the image signal processor, color correction information for the input image, obtaining a color corrected image based on the input image using color correction with desaturation control such that inaccurate colorization of the color corrected image is minimized, and outputting the color corrected image.

Claims (54)

1. A non-transitory computer-readable storage medium, comprising executable instructions that, when executed by a processor, facilitate performance of operations, comprising:

obtaining, by an image signal processor, from an image sensor, an input image signal representing an input image;

obtaining, by the image signal processor, color correction information for the input image;

obtaining a color corrected image based on the input image using color correction with desaturation control such that inaccurate colorization of the color corrected image is minimized, wherein obtaining the color corrected image includes:

obtaining a color corrected pixel based on an input pixel from the input image using color correction with desaturation control such that inaccurate colorization of the color corrected pixel is minimized;

in response to a determination that, for the input pixel, the color correction information includes a blue component correction coefficient and a red component correction coefficient that is less than one and is less than the blue component correction coefficient, desaturation control includes desaturation control proportional to the red color channel;

in response to a determination that, for the input pixel, the color correction information includes a red component correction coefficient and a blue component correction coefficient that is less than one and is less than the red component correction coefficient, desaturation control includes desaturation control proportional to the blue color channel; and

including the color corrected pixel in the color corrected image; and

outputting the color corrected image.

2. The non-transitory computer-readable storage medium of claim 1 , wherein:

obtaining the color corrected pixel based on the input pixel from the input image using color correction with desaturation control include:

obtaining a desaturation control color corrected pixel using desaturation control based on the input pixel; and

obtaining an adaptive desaturation control color corrected pixel using adaptive desaturation control based on the desaturation control color corrected pixel, such that inaccurate color brightness increase is minimized; and

including the color corrected pixel in the color corrected image includes including the adaptive desaturation control color corrected pixel in the color corrected image.

3. The non-transitory computer-readable storage medium of claim 2 , wherein obtaining the adaptive desaturation control color corrected pixel using adaptive desaturation control includes adaptive desaturation control based on a ratio between a green color channel value of the input pixel and a green color channel value of the desaturation control color corrected pixel.

4. The non-transitory computer-readable storage medium of claim 2 , wherein obtaining the adaptive desaturation control color corrected pixel using adaptive desaturation control includes obtaining the adaptive desaturation control color corrected pixel in response to a determination that, for the input pixel, the color correction information includes a blue component correction coefficient and a red component correction coefficient, wherein at least one of the blue component correction coefficient or the red component correction coefficient is less than one.

5. The non-transitory computer-readable storage medium of claim 2 , wherein obtaining the adaptive desaturation control color corrected pixel using adaptive desaturation control includes omitting obtaining the adaptive desaturation control color corrected pixel in response to a determination that, for the input pixel, the color correction information includes a blue component correction coefficient and a red component correction coefficient, wherein the blue component correction coefficient is at least one and the red component correction coefficient is at least one.

6. A method comprising:

obtaining, by an image signal processor, from an image sensor, an input image signal representing an input image;

obtaining, by the image signal processor, color correction information for the input image;

obtaining a color corrected image based on the input image using color correction with desaturation control such that inaccurate colorization of the color corrected image is minimized wherein obtaining the color corrected image includes:

obtaining a color corrected pixel based on an input pixel from the input image using color correction with desaturation control such that inaccurate colorization of the color corrected pixel is minimized;

in response to a determination that, for the input pixel, the color correction information includes a blue component correction coefficient and a red component correction coefficient that is less than one and is less than the blue component correction coefficient, desaturation control includes desaturation control proportional to the red color channel;

in response to a determination that, for the input pixel, the color correction information includes a red component correction coefficient and a blue component correction coefficient that is less than one and is less than the red component correction coefficient, desaturation control includes desaturation control proportional to the blue color channel; and

including the color corrected pixel in the color corrected image; and

outputting the color corrected image.

7. The method of claim 6 , wherein:

obtaining the color corrected pixel based on the input pixel from the input image using color correction with desaturation control include:

obtaining a desaturation control color corrected pixel using desaturation control based on the input pixel; and

obtaining an adaptive desaturation control color corrected pixel using adaptive desaturation control based on the desaturation control color corrected pixel, such that inaccurate color brightness increase is minimized; and

including the color corrected pixel in the color corrected image includes including the adaptive desaturation control color corrected pixel in the color corrected image.

8. The method of claim 7 , wherein obtaining the adaptive desaturation control color corrected pixel using adaptive desaturation control includes adaptive desaturation control based on a ratio between a green color channel value of the input pixel and a green color channel value of the desaturation control color corrected pixel.

9. The method of claim 7 , wherein obtaining the adaptive desaturation control color corrected pixel using adaptive desaturation control includes obtaining the adaptive desaturation control color corrected pixel in response to a determination that, for the input pixel, the color correction information includes a blue component correction coefficient and a red component correction coefficient, wherein at least one of the blue component correction coefficient or the red component correction coefficient is less than one.

10. The method of claim 7 , wherein obtaining the adaptive desaturation control color corrected pixel using adaptive desaturation control includes omitting obtaining the adaptive desaturation control color corrected pixel in response to a determination that, for the input pixel, the color correction information includes a blue component correction coefficient and a red component correction coefficient, wherein the blue component correction coefficient is at least one and the red component correction coefficient is at least one.

11. An apparatus comprising:

an image sensor;

an image signal processor configured to:

obtain, from the image sensor, an input image signal representing an input image;

obtain color correction information for the input image;

obtain a color corrected image based on the input image using color correction with desaturation control such that inaccurate colorization of the color corrected image is minimized, wherein the processor is configured to obtain the color corrected image by:

obtaining a color corrected pixel based on an input pixel from the input image using color correction with desaturation control such that inaccurate colorization of the color corrected pixel is minimized;

in response to a determination that, for the input pixel, the color correction information includes a blue component correction coefficient and a red component correction coefficient that is less than one and is less than the blue component correction coefficient, desaturation control includes desaturation control proportional to the red color channel;

in response to a determination that, for the input pixel, the color correction information includes a red component correction coefficient and a blue component correction coefficient that is less than one and is less than the red component correction coefficient, desaturation control includes desaturation control proportional to the blue color channel; and

including the color corrected pixel in the color corrected image; and

output the color corrected image.

12. The apparatus of claim 11 , wherein the processor is configured to:

obtain the color corrected pixel based on the input pixel from the input image using color correction with desaturation control by:

obtaining a desaturation control color corrected pixel using desaturation control based on the input pixel; and

obtaining an adaptive desaturation control color corrected pixel using adaptive desaturation control based on the desaturation control color corrected pixel, such that inaccurate color brightness increase is minimized; and

include the color corrected pixel in the color corrected image by including the adaptive desaturation control color corrected pixel in the color corrected image.

13. The apparatus of claim 12 , wherein the processor is configured to obtain the adaptive desaturation control color corrected pixel using adaptive desaturation control includes adaptive desaturation control based on a ratio between a green color channel value of the input pixel and a green color channel value of the desaturation control color corrected pixel.

14. The apparatus of claim 12 , wherein the processor is configured to obtain the adaptive desaturation control color corrected pixel using adaptive desaturation control by:

obtaining the adaptive desaturation control color corrected pixel in response to a determination that, for the input pixel, the color correction information includes a blue component correction coefficient and a red component correction coefficient, wherein at least one of the blue component correction coefficient or the red component correction coefficient is less than one; and

omitting obtaining the adaptive desaturation control color corrected pixel in response to a determination that the blue component correction coefficient is at least one and the red component correction coefficient is at least one.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
SECURITY INTEREST Recorded Dec 3, 2018
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 047713/0309 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2018
From: DOUADY-PLEVEN, BRUNO CÉSAR; VEIT, THOMAS NICOLAS EMMANUEL; LEBRUN, MARC
To: GOPRO, INC.
Reel/Frame 046486/0670 →
Continuity (2)
Provisional Application 62564429 · Sep 28, 2017
Related Publication 20190098274A1 · Mar 28, 2019