IP Library Granted Patent US 12711666
Granted Patent B2
US 12711666 · App. 18/425,493 · Granted Aug 18, 2026

Compression techniques for burn-in statistics of display screens

Inventors: Lars M. Lindberg (Bjaerred, SE); Ali Sazegari (Los Altos, CA); Christian T. Martelock (Los Gatos, CA)
Assignee: Apple Inc.
G06T9/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12711666
App. No.
18/425,493
Granted
Aug 18, 2026
Kind
B2
Abstract

Techniques for pre-processing image data for compression are disclosed. According to some embodiments, the techniques include receiving the image data, where the image data comprises a plurality of pixels, and each pixel of the plurality of pixels comprises a plurality of sub-pixel values. Various operations—including quantization, color space transformation, de-interleaving, prediction, and encoding operations—can be performed on the plurality of pixels/sub-pixel values to yield modified image data. In some cases, the modified image data is arranged, and possesses particular characteristics, such that when it is compressed, a substantially improved compression ratio can be achieved in comparison to the compression ratio that otherwise would achieved when compressing the (unmodified) image data.

Claims (102)

1 . A method for pre-processing image data for compression, the method comprising, by a computing device:

receiving the image data, wherein the image data comprises a plurality of pixels, and each pixel of the plurality of pixels comprises at least two sub-pixel values;

for each pixel of the plurality of pixels:

quantizing the at least two sub-pixel values of the pixel, and

color space transforming the at least two sub-pixel values of the pixel;

for each row of pixels in the image data:

de-interleaving the at least two sub-pixel values of the pixels in the row of pixels such that corresponding types of sub-pixel values are adjacent to one another across the row of pixels;

for each pixel of the plurality of pixels, and for each sub-pixel value of the at least two sub-pixel values of the pixel:

generating a prediction error for the sub-pixel value,

identifying an encoder model for encoding the prediction error into the sub-pixel value, and

utilizing the encoder model to encode the prediction error into the sub-pixel value;

compressing the image data to produce compressed image data; and

storing the compressed image data into a storage device.

2 . The method of claim 1 , wherein quantizing a given sub-pixel value of the at least two sub-pixel values of a given pixel of the plurality of pixels comprises:

identifying, based on (i) the sub-pixel value, and (ii) other sub-pixel values of the plurality of pixels that correspond to the sub-pixel value, a numerical range of values;

segmenting the numerical range of values into a plurality of levels; and

quantizing the sub-pixel value to a respective level of the plurality of levels that corresponds to the sub-pixel value.

3 . The method of claim 2 , wherein the plurality of levels is based two raised to a power of a predefined quantization bit rate.

4 . The method of claim 1 , wherein, when each pixel of the plurality of pixels comprises red, green, and blue sub-pixel values, color space transforming the red, green, and blue sub-pixel values comprises:

generating a chrominance orange (Co) sub-pixel value by subtracting the blue sub-pixel value from the red sub-pixel value;

right-shifting the Co sub-pixel value by one position to produce a right-shifted Co sub-pixel value;

generating a temporary (U) sub-pixel value by adding the blue sub-pixel value to the right-shifted Co sub-pixel value;

generating a chrominance green (Cg) sub-pixel value by subtracting the U sub-pixel value from the green sub-pixel value;

right-shifting the Cg sub-pixel value by one position to produce a right-shifted Cg sub-pixel value; and

generating a luma (Y) sub-pixel value by adding the U sub-pixel value to the right-shifted Cg sub-pixel value.

5 . The method of claim 4 , wherein, for a given row of pixels in the image data, de-interleaving the at least two sub-pixel values of the pixels in the row of pixels such that corresponding types of sub-pixel values are adjacent to one another across the row of pixels comprises:

adjacently arranging all luma (Y) sub-pixel values of the pixels in the row,

adjacently arranging all chrominance orange (Co) sub-pixel values of the pixels in the row, and

adjacently arranging all chrominance green (Cg) sub-pixel values of the pixels in the row.

6 . The method of claim 1 , wherein generating the prediction error for a given sub-pixel value of a given pixel comprises:

identifying, among the de-interleaved sub-pixel values, top left (TL), top (T), top right (TR), and left (L) sub-pixel values relative to the sub-pixel value;

calculating a prediction (P) value by identifying a median of (i) the L sub-pixel value, (ii) the T sub-pixel value, and (ii) a first result of adding, to the L sub-pixel value, a second result of subtracting the TL sub-pixel value from the T sub-pixel value; and

calculating the prediction error value by subtracting the P value from the sub-pixel value.

7 . The method of claim 6 , wherein identifying the encoder model for encoding the prediction error into the sub-pixel value comprises:

producing a first value by quantizing the TL sub-pixel value subtracted from the L sub-pixel value;

producing a second value by quantizing the TL sub-pixel value subtracted from the T sub-pixel value;

producing a third value by quantizing the T sub-pixel value subtracted from the TR sub-pixel value;

identifying an index that corresponds to the first, second, and third values; and

utilizing the index to identify, among a plurality of encoder models associated with respective indexes, the encoder model associated with the index.

8 . The method of claim 1 , wherein the image data comprises at least one segment of a multiple-channel digital image or comprises the multiple-channel digital image.

9 . A system configured to pre-process image data for compression, the system comprising:

a storage device; and

processing circuitry configured to:

receive the image data, wherein the image data comprises a plurality of pixels, and each pixel of the plurality of pixels comprises at least two sub-pixel values;

for each pixel of the plurality of pixels:

quantize the at least two sub-pixel values of the pixel, and

color space transform the at least two sub-pixel values of the pixel;

for each row of pixels in the image data:

de-interleave the at least two sub-pixel values of the pixels in the row of pixels such that corresponding types of sub-pixel values are adjacent to one another across the row of pixels;

for each pixel of the plurality of pixels, and for each sub-pixel value of the at least two sub-pixel values of the pixel:

generate a prediction error for the sub-pixel value,

identify an encoder model for encoding the prediction error into the sub-pixel value, and

utilize the encoder model to encode the prediction error into the sub-pixel value;

compress the image data to produce compressed image data; and

store the compressed image data into the storage device.

10 . The system of claim 9 , wherein the processing circuitry comprises a processor configured to execute instructions.

11 . The system of claim 9 , wherein:

the system comprises a display panel; and

the compressed image data comprises pixel wear data associated with the display panel.

12 . The system of claim 9 , wherein quantizing a given sub-pixel value of the at least two sub-pixel values of a given pixel of the plurality of pixels comprises:

identifying, based on (i) the sub-pixel value, and (ii) other sub-pixel values of the plurality of pixels that correspond to the sub-pixel value, a numerical range of values;

segmenting the numerical range of values into a plurality of levels; and

quantizing the sub-pixel value to a respective level of the plurality of levels that corresponds to the sub-pixel value.

13 . The system of claim 12 , wherein the plurality of levels is based two raised to a power of a predefined quantization bit rate.

14 . The system of claim 9 , wherein, when each pixel of the plurality of pixels comprises red, green, and blue sub-pixel values, color space transforming the red, green, and blue sub-pixel values comprises:

generating a chrominance orange (Co) sub-pixel value by subtracting the blue sub-pixel value from the red sub-pixel value;

right-shifting the Co sub-pixel value by one position to produce a right-shifted Co sub-pixel value;

generating a temporary (U) sub-pixel value by adding the blue sub-pixel value to the right-shifted Co sub-pixel value;

generating a chrominance green (Cg) sub-pixel value by subtracting the U sub-pixel value from the green sub-pixel value;

right-shifting the Cg sub-pixel value by one position to produce a right-shifted Cg sub-pixel value; and

generating a luma (Y) sub-pixel value by adding the U sub-pixel value to the right-shifted Cg sub-pixel value.

15 . The system of claim 14 , wherein, for a given row of pixels in the image data, de-interleaving the at least two sub-pixel values of the pixels in the row of pixels such that corresponding types of sub-pixel values are adjacent to one another across the row of pixels comprises:

adjacently arranging all luma (Y) sub-pixel values of the pixels in the row,

adjacently arranging all chrominance orange (Co) sub-pixel values of the pixels in the row, and

adjacently arranging all chrominance green (Cg) sub-pixel values of the pixels in the row.

16 . The system of claim 9 , wherein generating the prediction error for a given sub-pixel value of a given pixel comprises:

identifying, among the de-interleaved sub-pixel values, top left (TL), top (T), top right (TR), and left (L) sub-pixel values relative to the sub-pixel value;

calculating a prediction (P) value by identifying a median of (i) the L sub-pixel value, (ii) the T sub-pixel value, and (ii) a first result of adding, to the L sub-pixel value, a second result of subtracting the TL sub-pixel value from the T sub-pixel value; and

calculating the prediction error value by subtracting the P value from the sub-pixel value.

17 . The system of claim 16 , wherein identifying an encoder model for encoding the prediction error into the sub-pixel value comprises:

producing a first value by quantizing the TL sub-pixel value subtracted from the L sub-pixel value;

producing a second value by quantizing the TL sub-pixel value subtracted from the T sub-pixel value;

producing a third value by quantizing the T sub-pixel value subtracted from the TR sub-pixel value;

identifying an index that corresponds to the first, second, and third values; and

utilizing the index to identify, among a plurality of encoder models associated with respective indexes, the encoder model associated with the index.

18 . The system of claim 9 , wherein the image data comprises at least one segment of a multiple-channel digital image or comprises the multiple-channel image.

19 . A non-transitory computer readable storage medium configured to store instructions that, when executed by at least one processor included in a computing device, cause the computing device to pre-process image data for compression, by carrying out steps that include:

receiving the image data, wherein the image data comprises a plurality of pixels, and each pixel of the plurality of pixels comprises at least two sub-pixel values;

for each pixel of the plurality of pixels:

quantizing the at least two sub-pixel values of the pixel, and

color space transforming the at least two sub-pixel values of the pixel;

for each row of pixels in the image data:

de-interleaving the at least two sub-pixel values of the pixels in the row of pixels such that corresponding types of sub-pixel values are adjacent to one another across the row of pixels;

for each pixel of the plurality of pixels, and for each sub-pixel value of the at least two sub-pixel values of the pixel:

generating a prediction error for the sub-pixel value,

identifying an encoder model for encoding the prediction error into the sub-pixel value, and

utilizing the encoder model to encode the prediction error into the sub-pixel value;

compressing the image data to produce compressed image data; and

storing the compressed image data into a storage device.

20 . The non-transitory computer readable storage medium of claim 19 , wherein:

the computing device comprises a display panel; and

the compressed image data comprises pixel wear data associated with the display panel.