IP Library Granted Patent US 11,526,968
Granted Patent B2
US 11,526,968 · App. 17/169,207 · Granted Dec 13, 2022

Content adapted black level compensation for a HDR display based on dynamic metadata

Inventors: Chenguang Liu (Tustin, CA); William Mandel (Moorpark, CA); Dung Trung Vo (Costa Mesa, CA); McClain C. Nelson (Anaheim, CA); Soojung Hyun (Tustin, CA)
Assignee: Samsung Electronics Co., Ltd.
G06T5/009G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,526,968
App. No.
17/169,207
Granted
Dec 13, 2022
Kind
B2
Abstract

One embodiment provides a method comprising determining metadata corresponding to an input image, determining a black level of a display device and a peak luminance value of the display device, and determining a tone mapping function that adaptively compensates for the black level of the display device based on the metadata, the black level of the display device, and the peak luminance value of the display device. The metadata comprises a distribution of luminance values in the input image. The black level of the display device and the peak luminance value of the display device represent a lowest luminance value and a highest luminance value, respectively, achievable on the display device. The method further comprises applying the tone mapping function to the input image to generate a tone-mapped image that adaptively compensates for the black level of the display device and provided to the display device for presentation.

Claims (45)

1. A method comprising:

determining metadata corresponding to an input image, wherein the metadata comprises a distribution of luminance values in the input image, and the metadata at least partially represents a creative intent indicative of how the input image is intended to be viewed;

determining a black level of a display device and a peak luminance value of the display device, wherein the black level of the display device represents a lowest luminance value achievable on the display device, and the peak luminance value of the display device represents a highest luminance value achievable on the display device;

determining a tone mapping function that adaptively compensates for the black level of the display device based on the metadata, the black level of the display device, and the peak luminance value of the display device; and

applying the tone mapping function to the input image to generate a tone-mapped image that adaptively compensates for the black level of the display device, wherein the tone-mapped image is provided to the display device for presentation, and the tone mapping function applied comprises a portion of a piecewise explicit Bezier curve if a pre-determined percentage of pixels of the input image have luminance values that are less than a pre-determined threshold.

2. The method of claim 1 , wherein the distribution of luminance values comprises a cumulative distribution function (CDF) of pixels in the input image.

3. The method of claim 1 , wherein determining the tone mapping function that adaptively compensates for the black level of the display device comprises:

determining if the black level of the display device is substantially similar to a black level of a reference display.

4. The method of claim 3 , wherein determining the tone mapping function that adaptively compensates for the black level of the display device further comprises:

if the black level of the display device is substantially similar to the black level of the reference display, generating an explicit Bezier curve without compensation for the black level of the display device, wherein the tone mapping function comprises the explicit Bezier curve.

5. The method of claim 4 , wherein applying the tone mapping function to the input image comprises:

applying the explicit Bezier curve to the input image to generate the tone-mapped image without compensation for the black level of the display device.

6. The method of claim 3 , wherein determining the tone mapping function that adaptively compensates for the black level of the display device further comprises:

if the black level of the display device is not substantially similar to the black level of the reference display, generating the piecewise explicit Bezier curve comprising the portion with compensation for the black level of the display device, and another portion without compensation for the black level of the display device, wherein the tone mapping function comprises the piecewise explicit Bezier curve.

7. The method of claim 6 , wherein applying the tone mapping function to the input image comprises:

determining whether the pre-determined percentage of pixels of the input image have luminance values that are less than the pre-determined threshold.

8. The method of claim 7 , wherein applying the tone mapping function to the input image comprises:

if the pre-determined percentage of pixels of the input image have luminance values that are not less than the pre-determined threshold, applying the another portion of the piecewise explicit Bezier curve to the input image to generate the tone-mapped image without compensation for the black level of the display device.

9. The method of claim 1 , wherein the input image is a frame of an input video, the metadata further comprises the creative intent, and the creative intent is further indicative of a particular visualization of the input image a provider of the input image intends for a user to view.

10. A system comprising:

at least one processor; and

a non-transitory processor-readable memory device storing instructions that when executed by the at least one processor causes the at least one processor to perform operations including:

determining metadata corresponding to an input image, wherein the metadata comprises a distribution of luminance values in the input image, and the metadata at least partially represents a creative intent indicative of how the input image is intended to be viewed;

determining a black level of a display device and a peak luminance value of the display device, wherein the black level of the display device represents a lowest luminance value achievable on the display device, and the peak luminance value of the display device represents a highest luminance value achievable on the display device;

determining a tone mapping function that adaptively compensates for the black level of the display device based on the metadata, the black level of the display device, and the peak luminance value of the display device; and

applying the tone mapping function to the input image to generate a tone-mapped image that adaptively compensates for the black level of the display device, wherein the tone-mapped image is provided to the display device for presentation, and the tone mapping function applied comprises a portion of a piecewise explicit Bezier curve if a pre-determined percentage of pixels of the input image have luminance values that are less than a pre-determined threshold.

11. The system of claim 10 , wherein the distribution of luminance values comprises a cumulative distribution function (CDF) of pixels in the input image.

12. The system of claim 10 , wherein determining the tone mapping function that adaptively compensates for the black level of the display device comprises:

determining if the black level of the display device is substantially similar to a black level of a reference display.

13. The system of claim 12 , wherein determining the tone mapping function that adaptively compensates for the black level of the display device further comprises:

if the black level of the display device is substantially similar to the black level of the reference display, generating an explicit Bezier curve without compensation for the black level of the display device, wherein the tone mapping function comprises the explicit Bezier curve.

14. The system of claim 13 , wherein applying the tone mapping function to the input image comprises:

applying the explicit Bezier curve to the input image to generate the tone-mapped image without compensation for the black level of the display device.

15. The system of claim 12 , wherein determining the tone mapping function that adaptively compensates for the black level of the display device further comprises:

if the black level of the display device is not substantially similar to the black level of the reference display, generating the piecewise explicit Bezier curve comprising the portion with compensation for the black level of the display device, and another portion without compensation for the black level of the display device, wherein the tone mapping function comprises the piecewise explicit Bezier curve.

16. The system of claim 15 , wherein applying the tone mapping function to the input image comprises:

determining whether the pre-determined percentage of pixels of the input image have luminance values that are less than the pre-determined threshold; and

if the pre-determined percentage of pixels of the input image have luminance values that are not less than the pre-determined threshold, applying the another portion of the piecewise explicit Bezier curve to the input image to generate the tone-mapped image without compensation for the black level of the display device.

17. The system of claim 10 , wherein the input image is a frame of an input video, the metadata further comprises the creative intent, and the creative intent is further indicative of a particular visualization of the input image a provider of the input image intends for a user to view.

18. A non-transitory processor-readable medium that includes a program that when executed by a processor performs a method comprising:

determining metadata corresponding to an input image, wherein the metadata comprises a distribution of luminance values in the input image, and the metadata at least partially represents a creative intent indicative of how the input image is intended to be viewed;

determining a black level of a display device and a peak luminance value of the display device, wherein the black level of the display device represents a lowest luminance value achievable on the display device, and the peak luminance value of the display device represents a highest luminance value achievable on the display device;

determining a tone mapping function that adaptively compensates for the black level of the display device based on the metadata, the black level of the display device, and the peak luminance value of the display device; and

applying the tone mapping function to the input image to generate a tone-mapped image that adaptively compensates for the black level of the display device, wherein the tone-mapped image is provided to the display device for presentation, and the tone mapping function applied comprises a portion of a piecewise explicit Bezier curve if a pre-determined percentage of pixels of the input image have luminance values that are less than a pre-determined threshold.

19. The non-transitory processor-readable medium of claim 18 , wherein the distribution of luminance values comprises a cumulative distribution function (CDF) of pixels in the input image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2021
From: LIU, CHENGUANG; MANDEL, WILLIAM; VO, DUNG TRUNG; NELSON, MCCLAIN C.; HYUN, SOOJUNG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 055169/0059 →
Continuity (2)
Provisional Application 63118598 · Nov 25, 2020
Related Publication 20220164929A1 · May 26, 2022