Apparatus and a method for modifying colors of a focal stack of a scene according to a color palette
View Patent ↗The present invention generally relates to COLOR transfer between two images. COLOR transfer is a known technic consisting in modifying the COLORs of a source image by applying the COLOR palette of an example image without changing the source image structure. A lot of COLOR transfer method are known which consist in transferring COLORs between two images, however, those methods do not preserve the quality of the bokeh in areas of an images that are not in focus at a given depth. This results in a navigation in the depth dimension that is not smooth. It is proposed to modify the COLORs of a focal stack of a scene according to a COLOR palette by propagating the COLORs of the pixels in focus in different layers of the reCOLORed focal stack to the layers of the reCOLORed focal stack located behind the layer wherein a considered pixel is in focus.
1. An apparatus for modifying COLORs of a focal stack of a scene according to a COLOR palette comprising a processor configured to:
apply the COLOR palette to an all-in-focus image generated from said focal stack,
estimate the COLOR of a not-in-focus pixel in a layer of a reCOLORed focal stack generated from the obtained reCOLORed all-in-focus image of the scene depending on a COLOR and on a position in said reCOLORed focal stack of at least one pixel in focus in at least one layer of said reCOLORed focal stack.
2. The apparatus according to claim 1 , wherein the processor is configured to store, during the generation of the all-in-focus image, a position in the focal stack of a layer wherein a pixel is in focus.
3. The apparatus according to claim 2 , wherein the processor is configured to generate the reCOLORed focal stack by putting a pixel of the reCOLORed all-in-focus image back into the layer of the reCOLORed focal stack wherein said pixel is in focus.
4. The apparatus according to claim 1 , wherein the processor is configured to propagate the COLOR of a pixel in focus in a layer of the reCOLORed focal stack to the other layers of the reCOLORed focal stack by computing a convolution of said pixel in focus with a kernel.
5. The apparatus according to claim 4 , wherein, when a pixel is in focus in a layer of the reCOLORed focal stack, the processor is configured to associate the COLOR of said pixel in the reCOLORed all-in-focus to said pixel in focus in said layer of the reCOLORed focal stack.
6. The apparatus according to claim 4 , wherein the processor is configured to estimate the COLOR of a pixel in a layer of said reCOLORed focal stack wherein said pixel is not in focus by computing a weighted average of the COLORs associated to said pixel in other layers located before said layer in the reCOLORed focal stack.
7. The apparatus according to claim 6 , wherein the weights used in the computation of the weighted average are inversely proportional to a distance in the reCOLORed focal stack between the layer in which the COLOR to be associated to the pixel is computed and the layer wherein said pixel is in focus.
8. A method for modifying COLORs of a focal stack of a scene according to a COLOR palette comprising: applying the COLOR palette to an all-in-focus image generated from said focal stack, estimating the COLOR of a not-in-focus pixel in a layer of a reCOLORed focal stack generated from the obtained reCOLORed all-in-focus image of the scene depending on a COLOR and on a position in said reCOLORed focal stack of at least one pixel in focus in at least one layer of said reCOLORed focal stack.
9. The method according to claim 8 further comprising generating the reCOLORed focal stack by pulling a pixel of the reCOLORed all-in-focus image back into the layer of the reCOLORed focal stack wherein said pixel is in focus.
10. The method according to claim 8 , further comprising propagating the COLOR of a pixel in focus in a layer of the reCOLORed focal stack to the other layers of the reCOLORed focal stack by computing a convolution of said pixel in focus with a kernel.
11. The method according to claim 10 , further comprising estimating the COLOR of a pixel in a layer of said reCOLORed focal stack wherein said pixel is not in focus by computing a weighted average of the COLORs associated to said pixel in other layers located before said layer in the reCOLORed focal stack.
12. The method according to claim 8 , wherein the weights used in the computation of the weighted average are inversely proportional to a distance in the reCOLORed focal stack between the layer in which the COLOR to be associated to the pixel is computed and the layer wherein said pixel is in focus.
13. Non-transitory storage medium carrying instructions of program code for executing the method modifying COLORs of a focal stack of a scene according to a COLOR palette according to claim 8 , when said program is executed on a computing device.