IP Library Granted Patent US 10,432,955
Granted Patent B2
US 10,432,955 · App. 16/142,922 · Granted Oct 1, 2019

High dynamic range adaptation operations at a video decoder

Inventors: Zhouye Gu (San Diego, CA); Koohyar Minoo (San Diego, CA)
Assignee: ARRIS Enterprises LLC
H04N19/44G06T5/009H04L65/607H04N19/136H04N19/46H04N19/85G06T2207/10016G06T2207/10024G06T2207/20004G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,432,955
App. No.
16/142,922
Granted
Oct 1, 2019
Kind
B2
Abstract

A method of decoding a bitstream comprising decoding the bitstream into color values and metadata items indicating information about adaptive post-processing operations performed by a decoder, performing high dynamic range (HDR) adaptation operations on the color values based on the metadata items, and performing fixed post-processing operations to reconstruct an HDR video from the color values, wherein the HDR adaptation operations convert color values into a format expected by the fixed post-processing operations.

Claims (36)

1. A method of decoding a bitstream, comprising:

receiving a bitstream compressed during encoding from a high-bit depth input in to a 10-bit 4:2:0 bitstream at a decoder;

decoding said bitstream with said decoder into color values and metadata items indicating information about adaptive post-processing operations to be performed by said decoder, said metadata including at least one of a color conversion, a transfer function, or a second color space conversion operation applied to the bitstream during encoding, said decoding including performing, with said decoder, one or more high dynamic range (HDR) adaptation operations on said color values based on said metadata items; and

reconstructing an HDR video from said color values by inverse quantization re-mapping the 10bit bitstream data, performing inverse perceptual normalization, and processing color components with an inverse color conversion, inverse transfer function, and inverse color conversion,

wherein said one or more HDR adaptation operations convert said color values into a format expected by said one or more fixed post-processing operations.

2. The method of claim 1 , wherein one of said fixed post-processing operations is an inverse color space conversion operation and one of said HDR adaptation operations is a color space adaptation operation that converts said color values from an input color space to an output color space expected by said inverse color space conversion operation.

3. The method of claim 2 , wherein said color space adaptation operation converts said color values based on a fixed lookup table or a fixed mapping function.

4. The method of claim 2 , wherein said color space adaptation operation converts said color values based on an adaptive lookup table or an adaptive mapping function determined from parameters in said metadata items.

5. The method of claim 1 , wherein said input color space is a YCbCr color space and said output color space is a perceptually quantized (PQ) YCbCr color space, and said decoder:

converts the Y luma component from said YCbCr color space to a PQ Y luma component for said PQ YCbCr color space using a luma conversion operation,

converts the Y luma component, the Cb chroma component, and the Cr chroma component from said YCbCr color space to an intermediate PQ blue component using a blue conversion operation,

converts the Y luma component, the Cb chroma component, and the Cr chroma component from said YCbCr color space to an intermediate PQ red component using a red conversion operation,

converts the PQ Y luma component, the intermediate PQ blue component, and the intermediate PQ red component into a PQ Cb chroma component using a Cb conversion operation, and

converts the PQ Y luma component, the intermediate PQ blue component, and the intermediate PQ red component into a PQ Cr chroma component using a Cr conversion operation,

wherein said luma conversion operation, said blue conversion operation, said red conversion operation, said Cb conversion operation, and said Cr conversion operation are defined with mapping functions or lookup tables.

6. The method of claim 5 , wherein one of said input color space and said output color space is a non-constant luminance color space and the other one of said input color space and said output color space is a constant luminance color space.

7. The method of claim 1 , wherein one of said fixed post-processing operations is an inverse color appearance transfer function and one of said HDR adaptation operations is a transfer function adaptation operation that converts said color values from being adjusted by an input transfer function to being adjusted by an output transfer function as expected by inverse color appearance transfer function.

8. The method of claim 7 , wherein one of said input transfer function and said output transfer function is a gamma function and the other one of said input transfer function and said output transfer function is a perceptual quantizer (PQ) function.

9. The method of claim 7 , wherein said transfer function adaptation operation converts said color values based on a fixed lookup table or a fixed mapping function.

10. The method of claim 9 , wherein said decoder has a fixed lookup table for each possible inverse color appearance transfer function that can be used by said decoder, and said decoder converts a color value by finding an output color value on one of the fixed lookup tables identified using said metadata items.

11. The method of claim 7 , wherein said transfer function adaptation operation converts said color values based on an adaptive lookup table or an adaptive mapping function determined from parameters in said metadata items.

12. The method of claim 11 , wherein said metadata items define a multiple piece-wise segment curve and said decoder generates said adaptive lookup table using parameters that define each segment of said multiple piece-wise segment curve.

13. The method of claim 12 , wherein said multiple piece-wise segment curve is a multiple piece-wise polynomial curve with an order of two.

14. The method of claim 1 , wherein one of said HDR adaptation operations is a bit depth adaptation operation that converts said color values from an input bit depth to an output bit depth when said fixed post-processing operations expects said color values at said output bit depth.

15. The method of claim 1 , wherein said metadata items indicate information about the encoder's pre-processing operations on a scene basis, a frame basis, or a frame region basis, such that said decoder changes said one or more HDR adaptation operations based on said metadata items for different scenes, frames, or frame regions.

16. A video decoder, comprising:

a data transmission interface configured to receive a bitstream compressed during encoding from a high-bit depth input in to a 10-bit 4:2:0 bitstream; and

a processor configured to:

decode said bitstream into color values and metadata items indicating information about adaptive post-processing operations to be performed by said processor, said metadata including at least one of a color conversion, a transfer function, or a second color space conversion operation applied to the bitstream during encoding, said decoding including

performing one or more high dynamic range (HDR) adaptation operations on said color values based on said metadata items; and

reconstruct an HDR video from said color values using inverse quantization re-mapping the 10 bit bitstream data, performing inverse perceptual normalization, and processing color components with an inverse color conversion, inverse transfer function, and inverse color conversion,

wherein said one or more HDR adaptation operations convert said color values into a format expected by said one or more fixed post-processing operations, and

wherein said one or more HDR adaptation operations convert the color space of said color values, convert the bit depth of said color values, and/or change a transfer function by which said color values are adjusted.

17. The video decoder of claim 16 , wherein said one or more HDR adaptation operations converts said color values based on fixed lookup tables or fixed mapping functions.

18. The video decoder of claim 16 , wherein said one or more HDR adaptation operations converts said color values based on adaptive lookup tables or adaptive mapping functions determined from parameters in said metadata items.

19. The video decoder of claim 16 , wherein said metadata items indicate information about the encoder's pre-processing operations on a scene basis, a frame basis, or a frame region basis, such that said decoder changes said one or more HDR adaptation operations based on said metadata items for different scenes, frames, or frame regions.

Assignments (7)
SECURITY INTEREST Recorded Apr 8, 2026
From: ARRIS ENTERPRISES LLC; RUCKUS IP HOLDINGS LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 075476/0814 →
RELEASE OF SECURITY INTEREST AT REEL/FRAME 049905/0504 Recorded Dec 19, 2024
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: ARRIS ENTERPRISES LLC (F/K/A ARRIS ENTERPRISES, INC.); ARRIS TECHNOLOGY, INC.; ARRIS SOLUTIONS, INC.; COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; RUCKUS WIRELESS, LLC (F/K/A RUCKUS WIRELESS, INC.)
Reel/Frame 071477/0255 →
SECURITY INTEREST Recorded Dec 17, 2024
From: ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE INC., OF NORTH CAROLINA; OUTDOOR WIRELESS NETWORKS LLC; RUCKUS IP HOLDINGS LLC
To: APOLLO ADMINISTRATIVE AGENCY LLC
Reel/Frame 069889/0114 →
SECURITY INTEREST Recorded Nov 19, 2021
From: ARRIS SOLUTIONS, INC.; ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE, INC. OF NORTH CAROLINA; RUCKUS WIRELESS, INC.
To: WILMINGTON TRUST
Reel/Frame 060752/0001 →
PATENT SECURITY AGREEMENT Recorded Jul 3, 2019
From: ARRIS ENTERPRISES LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 049820/0495 →
ABL SECURITY AGREEMENT Recorded Jul 3, 2019
From: COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; ARRIS ENTERPRISES LLC; ARRIS TECHNOLOGY, INC.; RUCKUS WIRELESS, INC.; ARRIS SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 049892/0396 →
TERM LOAN SECURITY AGREEMENT Recorded Jul 3, 2019
From: COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; ARRIS ENTERPRISES LLC; ARRIS TECHNOLOGY, INC.; RUCKUS WIRELESS, INC.; ARRIS SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 049905/0504 →
Continuity (4)
Continuation 15783683 · Oct 13, 2017
Continuation 15274653 · Sep 23, 2016
Provisional Application 62222715 · Sep 23, 2015
Related Publication 20190028727A1 · Jan 24, 2019
Cited By (1)
US 12,413,731