Systems and methods of processing image data from an entropy decoder
A device includes a memory and one or more processors. The memory is configured to store image data associated with a logical unit of an image frame. The logical unit includes at least a luma transform unit (TU) and at least a chroma TU. The one or more processors are configured to determine, at a pixel processor, whether the luma TU from an entropy decoder is available. The one or more processors are also configured to determine, at the pixel processor, whether the chroma TU from the entropy decoder is available. The one or more processors are further configured to, based on a determination that the chroma TU is available and that the luma TU is unavailable, process, at the pixel processor, the chroma TU to generate chroma pixel values of the logical unit prior to processing the luma TU to generate luma pixel values of the logical unit.
1 . A device comprising:
a memory configured to store image data associated with a logical unit of an image frame, the logical unit including at least a luma transform unit (TU) and at least a chroma TU; and
one or more processors coupled to the memory, wherein the one or more processors are configured to:
determine, at a pixel processor, whether the luma TU from an entropy decoder is available;
determine, at the pixel processor, whether the chroma TU from the entropy decoder is available; and
based on a determination that the chroma TU is available and that the luma TU is unavailable, process, at the pixel processor, the chroma TU to generate chroma pixel values of the logical unit prior to processing the luma TU to generate luma pixel values of the logical unit.
2 . The device of claim 1 , wherein the at least one luma TU of the logical unit includes a first luma TU, and a second luma TU, and wherein the chroma TU is processed subsequent to the first luma TU being processed at the pixel processor to generate first luma pixel values and prior to the second luma TU being processed at the pixel processor to generate second luma pixel values.
3 . The device of claim 1 , wherein the image frame corresponds to a plurality of logical coding units (LCUs), each LCU of the plurality of LCUs includes two logical units, each logical unit of the two logical units includes at least a respective luma TU and at least a respective chroma TU, and one LCU of the plurality of LCUs includes the logical unit and another logical unit.
4 . The device of claim 1 , wherein a TU of the logical unit corresponds to quantized transform coefficients, and wherein the one or more processors are configured to:
perform, at the pixel processor, an inverse quantization operation based on the quantized transform coefficients to generate dequantized transform coefficients;
perform, at the pixel processor, an inverse transform operation based on the dequantized transform coefficients to generate TU pixel data; and
generate, at the pixel processor, TU pixel values based on the TU pixel data.
5 . The device of claim 4 , further comprising:
a modem coupled to the one or more processors, the modem configured to receive a bitstream including a representation of the TU,
wherein the one or more processors are configured to process, at the entropy decoder, the representation of the TU to generate the quantized transform coefficients.
6 . The device of claim 4 , further comprising:
a camera coupled to the one or more processors, the camera configured to generate a bitstream including a representation of the TU,
wherein the one or more processors are configured to process, at the entropy decoder, the representation of the TU to generate the quantized transform coefficients.
7 . The device of claim 4 , further comprising a display device coupled to the one or more processors, the display device configured to display at least a portion of the image frame that corresponds to the TU pixel values.
8 . The device of claim 1 , wherein the one or more processors are configured to, in response to a determination that a TU of the logical unit has been output from the entropy decoder and has not been processed at the pixel processor, determine that the TU is available.
9 . The device of claim 1 , wherein the memory is configured to store availability data of the logical unit, the availability data indicating whether TUs of the logical unit are available.
10 . The device of claim 9 , wherein the one or more processors are configured to, in response to receipt of a TU of the logical unit from the entropy decoder, update the availability data to indicate that the TU has been output from the entropy decoder.
11 . The device of claim 9 , wherein the one or more processors are configured to, responsive to a determination that a TU of the logical unit has been processed at the pixel processor, update the availability data to indicate that the TU has been processed at the pixel processor.
12 . The device of claim 9 , wherein the availability data includes a received indicator and a processed indicator of a TU of the logical unit, and wherein the one or more processors are configured to:
based on a value of the received indicator, determine whether the TU has been output from the entropy decoder; and
based on a value of the processed indicator, determine whether the TU has been processed at the pixel processor.
13 . The device of claim 9 , wherein the one or more processors are configured to determine, based on the availability data, a processing order at the pixel processor of the TUs of the logical unit.
14 . The device of claim 1 , wherein the memory and the one or more processors are integrated into at least one of a mobile phone, a tablet computer device, a wearable electronic device, a camera device, a vehicle, or an extended reality device.
15 . A method comprising:
determining, at a pixel processor, whether a luma transform unit (TU) from an entropy decoder is available, wherein a logical unit of an image frame includes at least the luma TU and at least a chroma TU;
determining, at the pixel processor, whether the chroma TU from the entropy decoder is available; and
based on a determination that the chroma TU is available and that the luma TU is unavailable, processing, at the pixel processor, the chroma TU to generate chroma pixel values of the logical unit prior to processing the luma TU to generate luma pixel values of the logical unit.
16 . The method of claim 15 , further comprising processing, at the pixel processor, a first luma TU to generate first luma pixel values, wherein the logical unit includes the first luma TU and a second luma TU, and wherein the chroma TU is processed subsequent to processing the first luma TU at the pixel processor to generate the first luma pixel values and prior to processing the second luma TU at the pixel processor to generate second luma pixel values.
17 . The method of claim 15 , further comprising:
performing, at the pixel processor, an inverse quantization operation based on quantized transform coefficients to generate dequantized transform coefficients, wherein a TU of the logical unit corresponds to the quantized transform coefficients;
performing, at the pixel processor, an inverse transform based on the dequantized transform coefficients to generate TU pixel data; and
generating, at the pixel processor, TU pixel values based on the TU pixel data.
18 . The method of claim 15 , wherein the determination that the chroma TU is available and that the luma TU is unavailable is based on availability data that indicates whether TUs of the logical unit are available.
19 . A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to:
determine, at a pixel processor, whether a luma transform unit (TU) from an entropy decoder is available, wherein a logical unit of an image frame includes at least the luma TU and at least a chroma TU;
determine, at the pixel processor, whether the chroma TU from the entropy decoder is available; and
based on a determination that the chroma TU is available and that the luma TU is unavailable, process, at the pixel processor, the chroma TU to generate chroma pixel values of the logical unit prior to processing the luma TU to generate luma pixel values of the logical unit.
20 . The non-transitory computer-readable medium of claim 19 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to reconstruct a portion of the image frame based at least in part on a combination of the chroma pixel values and the luma pixel values.