IP Library Granted Patent US 9,930,220
Granted Patent B2
US 9,930,220 · App. 14/273,727 · Granted Mar 27, 2018

Method and device for mapping colors in a picture using templates of harmonious colors

Inventors: Fabrice Urban (Thorigne Fouillard, FR); Christel Chamaret (Chantepie, FR); Yoann Baveye (Saint-Ave, FR)
Assignee: THOMSON LICENSING SAS
H04N1/6077G06T7/11G06T7/194G06T11/001G06T2207/10024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,930,220
App. No.
14/273,727
Granted
Mar 27, 2018
Kind
B2
Abstract

A method for processing a picture is disclosed. The method according to the invention comprises: segmenting the picture into a background layer and at least another layer; selecting a background template of color harmony for the background layer; determining one template of color harmony for each of the at least another layer from the background template of color harmony depending on the distance between the background layer and said at least another layer. processing the picture by mapping the colors of each segmented layer using the corresponding template of color harmony.

Claims (109)

1. A method for processing a picture comprising:

segmenting the picture into a background layer and at least another layer;

selecting a background template of color harmony for the background layer;

determining one template of color harmony for each of the at least another layer from the background template of color harmony based on a determination of a distance d k between the background layer and said at least another layer; and

processing the picture by mapping the colors of each segmented layer using the corresponding template of color harmony.

2. The method according to claim 1 , wherein each template of color harmony is defined around a hue wheel by at least one sector of harmonious colors.

3. The method of claim 2 , wherein said determining further comprises increasing a size, size b , of each sector of the background template of color harmony based on said distance d k , the template of color harmony with sectors of increased size being the template of color harmony for said at least another layer.

4. The method of claim 3 , wherein said increasing further comprises computing the increased size for each sector of said background template of color harmony according to the following equation:

size

exp

=

size

+

size

2

·

nb

sec

*

abs

(

d

k

d

f

)

where size exp is the increased size, nb sec is the number of sectors in the background template of color harmony, and d f is the distance between said background layer and a foreground layer.

5. The method of claim 2 , wherein said determining further comprises:

determining an intermediate template of color harmony comprising a single sector whose size and angle are computed from said distance; and

determining the template of color harmony for said at least another layer as the union of said background template of color harmony and of said intermediate template of color harmony.

6. The method of claim 5 , wherein a size size Ψ , of the single sector of the intermediate template of color harmony is computed as follows:

size

Ψ

=

720

S

*

abs

(

d

k

d

f

)

where S is the sum of the sizes of the sectors of the background layer and d f is the distance between said background layer and a foreground layer.

7. The method according to claim 1 , wherein said segmenting further comprises determining a depth value for each pixel or for each group of pixels in the picture and segmenting the picture on the basis of said depth values.

8. The method according to claim 7 , wherein the determined distance d k between the background layer and said at least another layer is equal to the difference between the mean of depth values for the background and the mean of depth values for the at least another layer.

9. The method according to claim 1 , wherein said picture belongs to a video and wherein segmenting the picture into a background layer and at least another layer comprises determining a motion value for each pixel or for each group of pixels in the picture and segmenting the picture on the basis of said motion values.

10. The method according to claim 9 , wherein the determined distance d k between the background layer and said at least another layer is equal to the difference between the mean of motion values for the background and the mean of motion values for the at least another layer.

11. A non-transitory program storage device, readable by a computer, tangibly embodying a program of instructions executable by a computer to perform a method comprising:

segmenting the picture into a background layer and at least another layer;

selecting a background template of color harmony for the background layer;

determining one template of color harmony for each of the at least another layer from the background template of color harmony based on a determination of a distance d k between the background layer and said at least another layer; and

processing the picture by mapping the colors of each segmented layer using the corresponding template of color harmony.

12. A device for processing a picture comprising at least one processor configured to:

segment the picture into a background layer and at least another layer;

select a background template of color harmony for the background layer;

determine one template of color harmony for each of the at least another layer from the background template of color harmony based on a determination of a distance d k between the background layer and said at least another layer; and

process the picture by mapping the colors of each segmented layer using the corresponding template of color harmony.

13. The device according to claim 12 , wherein each template of color harmony is defined around a hue wheel by at least one sector of harmonious colors.

14. The device of claim 13 , wherein for determining one template of color harmony for each of the at least another layer from the background template of color harmony based on the determined distance d k between the background layer and said at least another layer, the processor is further configured to increase a size, size b , of each sector of the background template of color harmony based on said distance, the template of color harmony with sectors of increased size being the template of color harmony for said at least another layer.

15. The device of claim 14 , wherein for increasing the size, size b , of each sector of the background template of color harmony based on said distance d k , said processor is further configured to compute the increased size for each sector of said background template of color harmony according to the following equation:

size

exp

=

size

b

+

size

b

2

·

nb

sec

*

abs

(

d

k

d

f

)

where size exp is the increased size, nb sec is the number of sectors in the background template of color harmony, and d f is the distance between said background layer and a foreground layer.

16. The device of claim 13 , wherein for determining one template of color harmony for each of the at least another layer from the background template of color harmony based on the determined distance d k between the background layer and said at least another layer, said processor is further configured to:

determine an intermediate template of color harmony comprising a single sector whose size and angle are computed from said distance; and

determine the template of color harmony for said at least another layer as the union of said background template of color harmony and of said intermediate template of color harmony.

17. The device of claim 16 , wherein a size size Ψ , of the single sector of the intermediate template of color harmony is computed as follows

size

Ψ

=

720

S

*

abs

(

d

k

d

f

)

where S is the sum of the sizes of the sectors of the background layer and d f is the distance between said background layer and a foreground layer.

18. The device according to claim 12 , wherein in segmenting the picture into a background layer and at least another layer the processor is further configured to determine a depth value for each pixel or for each group of pixels in the picture and segment the picture on the basis of said depth values.

19. The device according to claim 18 , wherein the determined distance d k between the background layer and said at least another layer is equal to the difference between the mean of depth values for the background and the mean of depth values for the at least another layer.

20. The device according to claim 12 , wherein said picture belongs to a video and wherein for segmenting the picture into a background layer and at least another layer the processor is further configured to determine a motion value for each pixel or for each group of pixels in the picture and segment the picture on the basis of said motion values.

21. The device according to claim 20 , wherein the distance between the background layer and said at least another layer is equal to the difference between the mean of motion values for the background and the mean of motion values for the at least another layer.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 20, 2020
From: THOMSON LICENSING S.A.S.
To: MAGNOLIA LICENSING LLC
Reel/Frame 053570/0237 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 10, 2015
From: URBAN, FABRICE; BAVEYE, YOANN; CHAMARET, CHRISTEL
To: THOMSON LICENSING SAS
Reel/Frame 034925/0797 →
Priority Claims (1)
EP 13305665 · May 23, 2013 · regional
Continuity (1)
Related Publication 20140348421A1 · Nov 27, 2014