IP Library Granted Patent US 11,544,827
Granted Patent B2
US 11,544,827 · App. 17/245,840 · Granted Jan 3, 2023

Hue-based video enhancement and rendering

Inventor: Reza Rassool (Seattle, WA)
Assignee: RealNetworks, Inc.
G06T5/009G06T5/002G06T5/20H04N9/643H04N9/646G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,544,827
App. No.
17/245,840
Granted
Jan 3, 2023
Kind
B2
Abstract

Embodiments are directed towards hue-based video enhancement. An example method includes processing low dynamic range (LDR) video content to generate an inverse tone map (ITM) for transforming the LDR video content to high dynamic range (HDR) video content, converting the LDR video content into Hue, Saturation and Lightness (HSY) color space to produce H-channel data, S-channel data, and Y-channel data, de-noising the H-channel data, remapping the de-noised H-channel data, the S-channel data, and the Y-channel data based on the ITM; and rendering the HDR video content based thereon.

Claims (37)

1. A computing device, comprising:

memory that stores computer instructions; and

at least one processor that executes the computer instructions to perform actions, the actions comprising:

processing target low dynamic range (LDR) video content to generate an inverse tone map (ITM) for transforming the target LDR video content to high dynamic range (HDR) video content;

converting the target LDR video content into Hue, Saturation and Lightness (HSY) color space to produce H-channel data, S-channel data, and Y-channel data of the target LDR video content;

de-noising the H-channel data of the target LDR video content to at least remedy chroma error;

remapping the de-noised H-channel data, the S-channel data, and the Y-channel data based, at least in part, on the ITM; and

rendering the HDR video content based, at least in part, on the remapped de-noised H-channel data, the remapped S-channel data, and the remapped Y-channel data.

2. The computing device of claim 1 , wherein the HDR video content is superior to the target LDR video content in at least one of resolution, frame rate, or color dynamic range.

3. The computing device of claim 1 , wherein the remapping of the de-noised H-channel data is further based on chromatic discrimination associated with human eyes.

4. The computing device of claim 1 , wherein the actions further comprise identifying one or more objects in the target LDR video content.

5. The computing device of claim 4 , wherein the remapping of the de-noised H-channel data is further based on the identified one or more objects.

6. The computing device of claim 1 , wherein rendering the HDR video content comprises converting the remapped de-noised H-channel data, the remapped S-channel data, and the remapped Y-channel data into another color space.

7. The computing device of claim 1 , wherein the actions further comprise generating video enhancement instructions based, at least in part, on the de-noising and the remapping.

8. The computing device of claim 7 , wherein the actions further comprise sharing the generated video enhancement instructions with one or more other computing devices.

9. A method, comprising:

processing target video content to generate an inverse tone map (ITM) for enhancing the target video content;

converting the target video content into Hue, Saturation and Lightness (HSY) color space to produce H-channel data, S-channel data, and Y-channel data of the target video content;

de-noising the H-channel data of the target video content to at least remedy chroma error;

remapping the de-noised H-channel data, the S-channel data, and the Y-channel data based, at least in part, on the ITM; and

rendering enhanced video content based, at least in part, on the remapped de-noised H-channel data, the remapped S-channel data, and the remapped Y-channel data.

10. The method of claim 9 , wherein the remapping of the de-noised H-channel data is further based on chromatic discrimination associated with human eyes.

11. The method of claim 9 , further comprising identifying one or more objects in the target video content.

12. The method of claim 11 , wherein the remapping of the de-noised H-channel data is further based on the identified one or more objects.

13. The method of claim 9 , wherein rendering the enhanced video content comprises converting the remapped de-noised H-channel data, the remapped S-channel data, and the remapped Y-channel data into another color space.

14. The method of claim 9 , further comprising generating video enhancement instructions based, at least in part, on the de-noising and the remapping.

15. The method of claim 14 , further comprising transmitting metadata including the generated video enhancement instructions to one or more computing devices.

16. A non-transitory computer-readable storage medium storing contents that, when executed by one or more processors, cause the one or more processors to:

process target video content to generate an inverse tone map (ITM) for enhancing the target video content;

convert the target video content into Hue, Saturation and Lightness (HSY) color space to produce H-channel data, S-channel data, and Y-channel data of the target video content;

de-noise the H-channel data of the target video content to at least remedy chroma error;

remap the de-noised H-channel data, the S-channel data, and the Y-channel data based, at least in part, on the ITM; and

render enhanced video content based, at least in part, on the remapped de-noised H-channel data, the remapped S-channel data, and the remapped Y-channel data.

17. The computer-readable storage medium of claim 16 , wherein the remapping of the de-noised H-channel data is further based on chromatic discrimination associated with human eyes.

18. The computer-readable storage medium of claim 16 , wherein the contents further cause the one or more processors to identify one or more objects in the target video content.

19. The computer-readable storage medium of claim 18 , wherein the remapping of the de-noised H-channel data is further based on the identified one or more objects.

20. The computer-readable storage medium of claim 16 , wherein the contents further cause the one or more processors to generate video enhancement instructions based, at least in part, on the de-noising and the remapping.

Assignments (2)
MERGER AND CHANGE OF NAME Recorded Feb 13, 2023
From: REALNETWORKS, INC.; GREATER HEIGHTS ACQUISITION LLC
To: REALNETWORKS LLC
Reel/Frame 062746/0554 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 5, 2021
From: RASSOOL, REZA
To: REALNETWORKS, INC.
Reel/Frame 058030/0318 →
Continuity (1)
Related Publication 20220351343A1 · Nov 3, 2022