IP Library Granted Patent US 11,734,806
Granted Patent B2
US 11,734,806 · App. 17/534,613 · Granted Aug 22, 2023

Dynamic tone mapping

Inventors: Sheng Yuan Chiu (San Jose, CA); Kunlung Wu (San Jose, CA)
Assignee: Roku, Inc.
G06T5/009G06T5/40G06T5/50G06T7/0002H04N5/20G06T2200/24G06T2207/10016G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,734,806
App. No.
17/534,613
Granted
Aug 22, 2023
Kind
B2
Abstract

Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for dynamic tone mapping of video content. An example embodiment operates by identifying, by a dynamic tone mapping system executing on a media device, characteristics of a first video signal having a first dynamic range based on a frame-by-frame analysis of the first video signal. The example embodiment further operates by modifying, by the dynamic tone mapping system, a tone mapping curve based on the characteristics of the first video signal to generate a modified tone mapping curve. Subsequently, the example embodiment operates by converting, by the dynamic tone mapping system, the first video signal based on the modified tone mapping curve to generate a second video signal having a second dynamic range that is less than the first dynamic range.

Claims (49)

1. A computer-implemented method for dynamic tone mapping of video content, comprising:

receiving, by a dynamic tone mapping system executing on a media device, histogram data associated with a first video signal representing a video program, wherein the first video signal has a first dynamic range and static metadata describing one or more brightness characteristics of the video program, wherein the histogram data comprises color values for a plurality of frames in the first video signal outputted by a display device;

determining, by the dynamic tone mapping system, a scene maximum value for a scene in the video program based on the histogram data, wherein the scene maximum value defines a maximum target brightness value for proper display of the scene;

modifying, by the dynamic tone mapping system, a tone mapping curve based on the scene maximum value and characteristics of the display device to generate a modified tone mapping curve; and

converting, by the dynamic tone mapping system, the first video signal based on the modified tone mapping curve to generate a second video signal having a second dynamic range that is less than the first dynamic range.

2. The computer-implemented method of claim 1 , wherein the modifying the tone mapping curve comprises:

modifying the tone mapping curve based on a user setting.

3. The computer-implemented method of claim 2 , further comprising:

adapting, by the dynamic tone mapping system, the second video signal to the user setting.

4. The computer-implemented method of claim 1 , further comprising:

generating, by the dynamic tone mapping system, video quality enhancement data based on the histogram data associated with the first video signal, and

wherein the converting further comprises:

converting, by the dynamic tone mapping system, the first video signal based on the video quality enhancement data.

5. The computer-implemented method of claim 4 , wherein the video quality enhancement data comprises dark scene adjustment data, bright scene adjustment data, or detail enhancement data.

6. The computer-implemented method of claim 1 , wherein the modifying further comprises:

temporally filtering, by the dynamic tone mapping system, the modified tone mapping curve.

7. A system for dynamic tone mapping of video content, comprising:

a memory; and

at least one processor coupled to the memory and configured to:

receive histogram data associated with a first video signal representing a video program, wherein the first video signal has a first dynamic range and static metadata describing one or more brightness characteristics of the video program, wherein the histogram data comprises color values for a plurality of frames in the first video signal outputted by a display device;

determine a scene maximum value for a scene in the video program based on the histogram data, wherein the scene maximum value defines a maximum target brightness value for proper display of the scene;

modify a tone mapping curve based on the scene maximum value and characteristics of the display device to generate a modified tone mapping curve; and

convert the first video signal based on the modified tone mapping curve to generate a second video signal having a second dynamic range that is less than the first dynamic range.

8. The system of claim 7 , wherein to modify the tone mapping curve, the at least one processor is further configured to:

modify the tone mapping curve based on a user setting.

9. The system of claim 8 , wherein the at least one processor is further configured to:

adapt the second video signal to the user setting.

10. The system of claim 7 , wherein the at least one processor is further configured to:

generate video quality enhancement data based on the histogram data associated with the first video signal; and

wherein to convert the first video signal, the at least one processor is further configured to:

convert the first video signal based on the video quality enhancement data.

11. The system of claim 10 , wherein the video quality enhancement data comprises dark scene adjustment data, bright scene adjustment data, or detail enhancement data.

12. The system of claim 7 , wherein to modify the tone mapping curve, the at least one processor is further configured to:

temporally filter the modified tone mapping curve.

13. A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations for dynamic tone mapping of video content, the operations comprising:

receiving histogram data associated with a first video signal representing a video program, wherein the first video signal has a first dynamic range and static metadata describing one or more brightness characteristics of the video program, wherein the histogram data comprises color values for a plurality of frames in the first video signal outputted by a display device;

determining, by a dynamic tone mapping system, scene maximum value for a scene in the video program based on the histogram data, wherein the scene maximum value defines a maximum target brightness value for proper display of the scene;

modifying a tone mapping curve based on the control point scene maximum value and characteristics of the display device to generate a modified tone mapping curve; and

converting the first video signal based on the modified tone mapping curve to generate a second video signal having a second dynamic range that is less than the first dynamic range.

14. The non-transitory computer-readable medium of claim 13 , wherein the modifying the tone mapping curve comprises:

modifying the tone mapping curve based on a user setting.

15. The non-transitory computer-readable medium of claim 14 , wherein the operations further comprise:

adapting the second video signal to the user setting.

16. The non-transitory computer-readable medium of claim 13 , wherein the operations further comprise:

generating video quality enhancement data based on the histogram data associated with the first video signal; and

wherein the converting further comprises:

converting the first video signal based on the video quality enhancement data.

17. The non-transitory computer-readable medium of claim 13 , wherein the modifying further comprises:

temporally filtering the modified tone mapping curve.

Assignments (2)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2021
From: CHIU, SHENG YUAN; WU, KUNLUNG
To: ROKU, INC.
Reel/Frame 058305/0482 →
Continuity (1)
Related Publication 20230162334A1 · May 25, 2023
Cited By (3)
US 12,249,054 US 12,417,520 US 12,608,783