IP Library Granted Patent US 9,761,152
Granted Patent B2
US 9,761,152 · App. 14/715,520 · Granted Sep 12, 2017

Method for harmonizing colors, corresponding computer program and device

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,761,152
App. No.
14/715,520
Granted
Sep 12, 2017
Kind
B2
Abstract

A method for harmonizing colors of an original image is disclosed. The method comprises: computing a saliency map of the original image, for each of a plurality of color harmonic schemes: determining a temporary harmonized image from the original image according to the current color harmonic scheme, computing a saliency map of the temporary harmonized image, comparing the saliency map of the original image and the saliency map of the temporary harmonized image, in order to obtain a saliency comparison result, computing a corrected color comparison result from colors of the original image, colors of the current color harmonic scheme and the saliency comparison result, selecting, as the harmonized image, the temporary harmonized image obtained with the color harmonic scheme minimizing the corrected color comparison result.

Claims (37)

1. A method for harmonizing colors of an original image, the method comprising:

computing, using a processor, at least a temporary harmonized image determined from the original image according to at least one color harmonic scheme;

computing, using said processor, a saliency map of said temporary harmonized image;

computing, using said processor, a saliency comparison result obtained from a comparison of a saliency map of the original image and the saliency map of said temporary harmonized image;

computing, using said processor, a corrected color comparison result from colors of the original image, colors of the color harmonic scheme and the saliency comparison result;

selecting, as the harmonized image, the temporary harmonized image obtained with the color harmonic scheme minimizing the corrected color comparison result; and

displaying the harmonized image on a display device.

2. The method according to claim 1 , wherein the saliency comparison result is a correlation coefficient between the saliency map of the original image and the saliency map of the temporary harmonized image.

3. The method according to claim 2 , wherein the correlation coefficient is a linear correlation coefficient between the saliency map of the original image and the saliency map of the temporary harmonized image.

4. The method according to claim 1 , wherein the corrected color comparison result is computed by dividing a color comparison result with the saliency comparison result, the color comparison result being the result of a comparison between the colors of the original image and the colors of the color harmonic scheme.

5. The method according to claim 4 , wherein the color comparison result is a result of a comparison between a hue distribution of the original image and a hue distribution of the color harmonic scheme.

6. The method according to claim 5 , wherein the hue distribution of the original image is a hue histogram.

7. The method according to claim 6 , wherein the hue distribution of the original image is a hue histogram normalized by saturation and value.

8. The method according to claim 5 , wherein the hue distribution of the color harmonic scheme is a uniform distribution.

9. The method according to claim 5 , wherein the comparison between the hue distribution of the original image and the hue distribution of the color harmonic scheme is the Kullback-Leibler divergence.

10. A non-transitory program storage device, readable by a computer, tangibly embodying a program of instructions executable by the computer to perform a method comprising:

computing, using a processor, at least a temporary harmonized image determined from the original image according to at least one color harmonic scheme;

computing, using said processor, a saliency map of said temporary harmonized image;

computing, using said processor, a saliency comparison result obtained from a comparison of a saliency map of the original image and the saliency map of said temporary harmonized image;

computing, using said processor, a corrected color comparison result from colors of the original image, colors of the color harmonic scheme and the saliency comparison result;

selecting, as the harmonized image, the temporary harmonized image obtained with the color harmonic scheme minimizing the corrected color comparison result; and

displaying the harmonized image on a display device.

11. A device for harmonizing colors of an original image, the device comprising at least a processor configured to:

compute, using a processor, at least a temporary harmonized image determined from the original image according to at least one color harmonic scheme;

compute, using said processor, a saliency map of said temporary harmonized image;

compute, using said processor, a saliency comparison result obtained from a comparison of a saliency map of the original image and the saliency map of said temporary harmonized image;

compute, using said processor, a corrected color comparison result from colors of the original image, colors of the color harmonic scheme and the saliency comparison result;

select, as the harmonized image, the temporary harmonized image obtained with the color harmonic scheme minimizing the corrected color comparison result; and

displaying the harmonized image on a display device.

12. The device according to claim 11 , wherein the saliency comparison result is a correlation coefficient between the saliency map of the original image and the saliency map of the temporary harmonized image.

13. The device according to claim 12 , wherein the correlation coefficient is a linear correlation coefficient between the saliency map of the original image and the saliency map of the temporary harmonized image.

14. The device according to claim 11 , wherein the corrected color comparison result is computed by dividing a color comparison result with the saliency comparison result, the color comparison result being the result of a comparison between the colors of the original image and the colors of the color harmonic scheme.

15. The device according to claim 14 , wherein the color comparison result is a result of a comparison between a hue distribution of the original image and a hue distribution of the color harmonic scheme.

16. The device according to claim 15 , wherein the hue distribution of the original image is a hue histogram.

17. The device according to claim 16 , wherein the hue distribution of the original image is a hue histogram normalized by saturation and value.

18. The device according to claim 15 , wherein the hue distribution of the color harmonic scheme is a uniform distribution.

19. The device according to claim 15 , wherein the comparison between the hue distribution of the original image and the hue distribution of the color harmonic scheme is the Kullback-Leibler divergence.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 20, 2020
From: THOMSON LICENSING S.A.S.
To: MAGNOLIA LICENSING LLC
Reel/Frame 053570/0237 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2017
From: CHAMARET, CHRISTEL; BORDES, PHILIPPE; URBAN, FABRICE
To: THOMSON LICENSING
Reel/Frame 043184/0585 →