IP Library Granted Patent US 12684119
Granted Patent B2
US 12684119 · App. 17/591,572 · Granted Jul 14, 2026

Systems and methods for luma or chroma statistics collection

Inventors: Felix C Fernandes (Saratoga, CA); Liviu R Morogan (San Jose, CA)
Assignee: Apple Inc.
H04N19/117G06T5/40H04N19/132H04N19/186H04N19/82H04N19/86G06T2207/20076
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12684119
App. No.
17/591,572
Granted
Jul 14, 2026
Kind
B2
Abstract

Systems and methods of analyzing the luma statistics or chroma statistics to correct for image artifacts in decoded images. Video decoder circuitry may enable luma statistics collection circuitry housed in the loop filters to collect luma samples during the last stage of the decoding process. This enables output of luma statistics data and output of the decoded image together.

Claims (37)

1 . An electronic device comprising:

an electronic display; and

decoder hardware configured to decode image data for display on the electronic display, wherein the decoder hardware comprises quantization and transformation (QT) hardware, loop filter hardware, and intra prediction and motion compensation (IPMC) hardware coupled between the QT hardware and the loop filter hardware, wherein the QT hardware is configured to provide an output directly as an input to the IPMC hardware, wherein the loop filter hardware is configured to perform deblocking of an image frame of the image data and perform same-frame luma statistics collection on the deblocked image frame processed by the loop filter hardware, and wherein the loop filter hardware comprises luma statistics collection circuitry configured to receive a plurality of luma samples resulting from the same-frame luma statistics collection.

2 . The electronic device of claim 1 , wherein the decoder hardware comprises one or more processors configured to:

write the plurality of luma samples to a memory region using a direct memory access (DMA) write channel at an end of the image frame.

3 . The electronic device of claim 1 , wherein the luma statistics collection circuitry is configured to convert the plurality of luma samples from a video range to a full range and creates a histogram by binning the plurality of luma samples based on converted full range luma samples.

4 . The electronic device of claim 3 , wherein the decoder hardware comprises one or more processors configured to:

assign the converted full range luma samples into a plurality of bins, wherein each of the plurality of bins holds at least 32-bits.

5 . The electronic device of claim 3 , the decoder hardware comprises one or more processors configured to:

utilize the histogram to correct for image artifacts in the image frame corresponding to the plurality of luma samples.

6 . The electronic device of claim 3 , wherein the luma statistics collection circuitry is configured to convert the plurality of luma samples from the video range to the full range by determining a bit depth of each of the plurality of luma samples.

7 . The electronic device of claim 6 , wherein the luma statistics collection circuitry is configured to convert the plurality of luma samples from the video range to the full range by identifying a multiplier for each of the plurality of luma samples based on the determined bit depth of each of the plurality of luma samples.

8 . The electronic device of claim 1 , wherein the decoder hardware comprises one or more processors configured to:

scale one or more luma samples of the plurality of luma samples to a same bit depth.

9 . The electronic device of claim 8 , wherein the luma statistics collection circuitry is configured to convert the plurality of luma samples from a video range to a full range by implementing a same multiplier for the scaled one or more luma samples.

10 . An electronic device comprising:

one or more processors and decoder hardware, wherein the decoder hardware is configured to:

receive a plurality of luma samples resulting from loop filters hardware deblocking one or more image frames, wherein the loop filters hardware comprises luma statistics collection circuitry configured to receive the plurality of luma samples, wherein the plurality of luma samples correspond to the same one or more deblocked image frames the loop filters hardware has performed deblocking on, and wherein the one or more image frames each comprise a Region of Interest;

scale the plurality of luma samples to a same bit depth;

convert the plurality of luma samples from a video range to a full range corresponding to the Region of Interest using a single multiplier for all the scaled plurality of luma samples; and

create a histogram by binning the scaled plurality of luma samples based on the converted full range luma samples.

11 . The electronic device of claim 10 , wherein the decoder hardware is configured to convert the plurality of luma samples from the video range to the full range by determining a bit depth of each of the plurality of luma samples.

12 . The electronic device of claim 10 , wherein the histogram is used to correct for image artifacts in the one or more image frames corresponding to the one or more image frames that the plurality of luma samples were collected from.

13 . The electronic device of claim 10 , wherein the decoder hardware is configured to:

arrange the converted full range luma samples into a plurality of bins, wherein each of the plurality of bins holds at least 32 bits.

14 . The electronic device of claim 10 , wherein the decoder hardware is configured to:

write the converted full range luma samples to a memory region using a direct memory access (DMA) write channel at an end of each image frame of the one or more image frames.

15 . The electronic device of claim 10 , wherein the decoder hardware is configured to scale the plurality of luma samples based on a number of precision bits, a first range of samples, and a second range of samples.

16 . A tangible, non-transitory, machine-readable medium comprising instructions that, when executed by processing circuitry, causes the processing circuitry to perform operations comprising:

deblocking, using a loop filter comprising luma statistics collection circuitry, one or more image frames, wherein the one or more image frames each comprise a Region of Interest;

obtaining a plurality of luma samples, a plurality of chroma samples, or both at the luma statistics collection circuitry that results from the loop filter deblocking the one or more image frames, wherein the plurality of luma samples, the plurality of chroma samples, or both correspond to the same one or more deblocked image frames that the loop filter has performed deblocking on;

converting the plurality of luma samples, the plurality of chroma samples, or both from a video range to a full range corresponding to the Region of Interest; and

creating a histogram by binning the plurality of luma samples, the plurality of chroma samples, or both based on the converted full range luma samples, chroma samples, or both.

17 . The tangible, non-transitory, machine-readable medium of claim 16 , wherein the operations comprise determining a bit depth of each of the plurality of luma samples, the plurality of chroma samples, or both.

18 . The tangible, non-transitory, machine-readable medium of claim 17 , wherein the operations comprise identifying a multiplier for each of the plurality of luma samples, the plurality of chroma samples, or both based on the determined bit depth of each of the plurality of luma samples, the plurality of chroma samples, or both.

19 . The tangible, non-transitory, machine-readable medium of claim 18 , wherein the operations comprise converting the plurality of luma samples, the plurality of chroma samples, or both from the video range to the full range based on the identified multiplier for each of the plurality of luma samples, the plurality of chroma samples, or both.

20 . The tangible, non-transitory, machine-readable medium of claim 17 , wherein the operations comprise correcting for image artifacts based on the histogram in the one or more image frames that the plurality of luma samples, the plurality of chroma samples, or both were collected from.