Device and method for dynamic range expansion in a virtual reality scene
A lower dynamic range visual content ( 21 ) of a virtual reality or VR scene represented in a curved shape form is adapted to a higher dynamic range display of the virtual reality scene. At least two views planar key views ( 230 ) of the VR scene area obtained, at least two parameter values ( 240 ) respectively associated with those planar key views are obtained, corresponding to at least one parameter adapted to expand a dynamic range of a visual content, and a higher dynamic range visual content ( 22 ) corresponding to the lower dynamic range visual content in at least part of the VR scene extending beyond the planar key views is determined, based on the parameter values. Applications to Inverse Tone Mapping.
1. A device for adapting at least an area of a lower dynamic range visual content of a virtual reality scene to a higher dynamic range display of said area, wherein said device comprises at least one processor configured for:
determining a range expansion representation in said area based on at least two elementary range expansion representations in said area, said elementary range expansion representations being associated with respectively at least two planar key views selected among a set of planar key views associated with said virtual reality scene and being based on parameter values associated with the two planar key views, said elementary range expansion representations being combined by weighting said elementary range expansion representations with respective weights decreasing with distances from at least part of said area to said associated planar key views; and
expanding dynamic range of said area by determining said higher dynamic range visual content from said range expansion representation;
wherein at least one of said parameter values associated with at least one of said planar key views depends on the lower dynamic range visual content in said at least one of said planar key views and said parameter values are adapted to expand a dynamic range of a visual content.
2. The device according to claim 1 , wherein at least one of said parameter values associated with at least one of said planar key views depends on the lower dynamic range visual content in said at least one of said planar key views.
3. The device according to claim 1 , wherein determining said higher dynamic range visual content includes raising a luminance of said lower dynamic range visual content at a power given by said range expansion representation.
4. The device according to claim 1 , wherein said area is located within at least one current view available to a user in said virtual reality scene.
5. The device according to claim 1 , wherein a union of said planar key views and of said area covers entirely said virtual reality scene.
6. The device according to claim 1 , wherein said area comprises at least part of said planar key views.
7. The device according to claim 1 , wherein said at least one processor is further configured for:
selecting as said planar key views among a set of potential planar key views, at least two of the potential planar key views being closest to at least a portion of said area.
8. The device according to claim 7 , wherein said area comprises pixels, said at least a portion of said area corresponds to any of said pixels.
9. The device according to claim 1 , wherein said virtual reality scene being temporally varying as a video content, said at least one processor is further configured for:
extracting at least two shots from said video content,
extracting one single representative frame from each of said shots, and
in each of said representative frames, obtaining said planar key views and said associated parameter values, and determining said higher dynamic range visual content from said planar key views and associated parameter values,
in other frames than said representative frames in any of said shots, determining said higher dynamic range visual content based on positions of the planar key views and on the associated parameter values as obtained for the representative frame of said shot.
10. The device according to claim 1 , wherein said at least one parameter is selected among parameters controlling a range expansion in a lower luminance zone, a range expansion in a higher luminance zone, a range expansion in a middle luminance zone, and parameters defining thresholds between luminance zones.
11. A method for adapting at least an area of a lower dynamic range visual content of a virtual reality scene, to a higher dynamic range display of said area, wherein said method comprises:
determining a range expansion representation in said area based on at least two elementary range expansion representations in said area, said elementary range expansion representations being associated with respectively at least two planar key views selected among a set of planar key views associated with said virtual reality scene and being based on parameter values associated with the two planar key views, said elementary range expansion representations being combined by weighting said elementary range expansion representations with respective weights decreasing with distances from at least part of said area to said associated planar key views; and
expanding dynamic range of said area by determining said higher dynamic range visual content from said range expansion representation,
wherein at least one of said parameter values associated with at least one of said planar key views depends on the lower dynamic range visual content in said at least one of said planar key views and said parameter values are adapted to expand a dynamic range of a visual content.
12. The method according to claim 11 , wherein determining said higher dynamic range visual content includes raising a luminance of said lower dynamic range visual content at a power given by said range expansion representation.
13. The method according to claim 11 , further comprising:
selecting as said planar key views among a set of potential planar key views, at least two of the potential planar key views being closest to at least a portion of said area.
14. The method according to claim 11 , wherein said virtual reality scene being temporally varying as a video content, further comprising:
extracting at least two shots from said video content,
extracting one single representative frame from each of said shots, and
in each of said representative frames, obtaining said planar key views and said associated parameter values, and determining said higher dynamic range visual content from said planar key views and associated parameter values,
in other frames than said representative frames in any of said shots, determining said higher dynamic range visual content based on positions of the planar key views and on the associated parameter values as obtained for the representative frame of said shot.
15. The method according to claim 11 , wherein said at least one parameter is selected among parameters controlling a range expansion in a lower luminance zone, a range expansion in a higher luminance zone, a range expansion in a middle luminance zone, and parameters defining thresholds between luminance zones.
16. A non-transitory machine readable medium having stored thereon machine executable instructions that, when executed on a processor, adapt at least an area of a lower dynamic range visual content of a virtual reality scene to a higher dynamic range display of said area, the instructions causing the processor to:
determine a range expansion representation in said area based on at least two elementary range expansion representations in said area, said elementary range expansion representations being associated with respectively at least two planar key views selected among a set of planar key views associated with said virtual reality scene and being based on parameter values associated with the two planar key views, said elementary range expansion representations being combined by weighting them with respective weights decreasing with distances from at least part of said area to said associated planar key views, and
expand dynamic range of said area by determining said higher dynamic range visual content from said range expansion representation,
wherein at least one of said parameter values associated with at least one of said planar key views depends on the lower dynamic range visual content in said at least one of said planar key views and said parameter values are adapted to expand a dynamic range of a visual content.
17. The method according to claim 11 , wherein at least one of said parameter values associated with at least one of said planar key views depends on the lower dynamic range visual content in said at least one of said planar key views.
18. The method according to claim 11 , wherein said area is located within at least one current view available to a user in said virtual reality scene.
19. The method according to claim 11 , wherein a union of said planar key views and of said area covers entirely said virtual reality scene.
20. The method according to claim 11 , wherein said area comprises at least part of said planar key views.