IP Library › Granted Patent US 11,153,586
Granted Patent B2
US 11,153,586 · App. 16/545,501 · Granted Oct 19, 2021

Image processing device and frame buffer compressor

Inventor: Sung Ho Jun (Hwaseong-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N19/423H04N19/103H04N19/124H04N19/159H04N19/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,153,586
App. No.
16/545,501
Granted
Oct 19, 2021
Kind
B2
Abstract

An image processing device includes a multimedia IP including a plurality of IP cores, at least one of which processes image data to generate source data, a frame buffer compressor, shared by the plurality of IP cores, compressing the source data to generate compressed data, and a memory coupled to the frame buffer compressor and accessed by the multimedia IP through the frame buffer compressor so that the compressed data is stored in the memory. The frame buffer compressor includes a quantization module which performs quantizing on the source data to generate recon data and a prediction module which executes intra-prediction on the recon data to generate prediction data.

Claims (66)

1. An image processing device comprising:

a multimedia IP including a plurality of IP cores, at least one of which processes image data to generate source data;

a frame buffer compressor shared by the plurality of IP cores and configured to compress the source data to generate compressed data; and

a memory coupled to the frame buffer compressor and accessed by the multimedia IP through the frame buffer compressor, the memory configured to store the compressed data,

wherein the frame buffer compressor includes a quantization module configured to perform quantizing on the source data to generate recon data, and a prediction module configured to execute intra-prediction on the recon data to generate prediction data, and

wherein the source data comprises a plurality of source pixel data, and the quantization module is configured to perform a division operation on each of the plurality of source pixel data using a predefined, constant, quantization coefficient as a divisor to generate the recon data which correspond to quotients obtained by the division operation.

2. The image processing device of claim 1 ,

wherein the compressed data comprises the predefined quantization coefficient.

3. The image processing device of claim 1 ,

wherein the recon data comprises a plurality of recon pixel data of the image data in a same frame, and

wherein the prediction module is configured to determine reference pixel data from one or more recon pixel data of the plurality of recon pixel data, and set differences between each of remaining parts of the plurality of recon pixel data and a corresponding one of the reference pixel data as the residual pixel data.

4. The image processing device of claim 3 ,

wherein the reference pixel data is generated on the basis of an average value of the one or more recon pixel data of the plurality of recon pixel data.

5. The image processing device of claim 1 ,

wherein the prediction data comprises a plurality of prediction pixel data, the frame buffer compressor further comprises an entropy encoding module which performs entropy encoding on the prediction data based on an entropy frequency of the plurality of prediction pixel data to generate entropy data, and

the entropy frequency is calculated based on a number of prediction pixel data having the same value among the plurality of prediction pixel data.

6. The image processing device of claim 5 ,

wherein the frame buffer compressor further comprises a padding module which adds zero data to the entropy data to generate padding data having a predefined size.

7. The image processing device of claim 6 ,

wherein the frame buffer compressor comprises a CRC module which adds a CRC code to the padding data for verifying an error of the compressed data, and the CRC module generates the CRC code based on the source data.

8. An image processing device comprising:

a multimedia IP including a plurality of IP cores, at least one of which processes image data to generate source data;

a frame buffer compressor shared by the plurality of IP cores and configured to compress the source data to generate compressed data; and

a memory coupled to the frame buffer compressor and accessed by the multimedia IP through the frame buffer compressor, the memory configured to store the compressed data,

wherein the frame buffer compressor includes a quantization module configured to perform quantizing on the source data to generate recon data, and a prediction module configured to execute intra-prediction on the recon data to generate prediction data, and

wherein the source data comprises a plurality of source pixel data, and

the quantization module is configured to perform a division operation on each of the plurality of source pixel data using a predefined, constant, quantization coefficient as a divisor to generate the recon data which correspond to quotients obtained by the division operation,

wherein the frame buffer compressor further comprising:

a mode selector which determines whether the frame buffer compressor operates in a lossy compression mode or a lossless compression mode,

wherein, when the frame buffer compressor operates in the lossy compression mode, the quantization module generates the recon data from the source data, and the prediction module generates the prediction data from the recon data.

9. The image processing device of claim 8 ,

wherein, when the frame buffer compressor operates in the lossy compression mode, the mode selector transfers the source data, which is input to the frame buffer compressor, to the quantization module.

10. The image processing device of claim 8 ,

wherein, when the frame buffer compressor operates in the lossless compression mode, the prediction module generates the prediction data from the source data.

11. The image processing device of claim 10 ,

wherein, when the frame buffer compressor operates in the lossless compression mode, the mode selector transfers the source data, which is input to the frame buffer compressor, to the prediction module.

12. The image processing device of claim 8 ,

wherein the frame buffer compressor decompresses the compressed data to generate output data,

the frame buffer compressor further comprises a prediction compensation module which performs intra-predicting compensation on the prediction data, and an inverse quantization module which performs inverse quantizing on the recon data, and

when the frame buffer compressor operates in the lossy compression mode, the prediction compensation module generates the recon data from the prediction data, and the inverse quantization module generates the output data from the recon data.

13. The image processing device of claim 12 ,

wherein, when the frame buffer compressor operates in the lossy compression mode, the mode selector transfers the recon data generated by the prediction compensation module to the inverse quantization module.

14. The image processing device of claim 12 ,

wherein, when the frame buffer compressor operates in the lossless compression mode, the prediction compensation module generates the output data from the prediction data.

15. The image processing device of claim 14 ,

wherein, when the frame buffer compressor operates in the lossless compression mode, the prediction compensation module outputs the output data to outside of the frame buffer compressor.

16. An image processing device comprising:

a memory storing compressed data;

a frame buffer compressor receiving source data and compressing the source data to generate the compressed data which are stored in the memory, and receiving the compressed data and decompressing the compressed data to generate output data; and

a multimedia IP including a plurality of IP cores, the plurality of IP cores sharing the frame buffer compressor and at least one of the plurality of IP cores receiving the output data from the frame buffer compressor, accessing the memory through the frame buffer compressor and processing the output data to generate image data,

wherein the frame buffer compressor is configured to compress the source data to generate the compressed data,

wherein the frame buffer compressor includes a quantization module configured to perform quantizing on the source data to generate recon data, and a prediction module configured to execute intra-prediction on the recon data to generate prediction data, and

wherein the frame buffer compressor is further configured to generate the prediction data based on the compressed data, and

wherein the frame buffer compressor further includes a prediction compensation module configured to perform intra-prediction compensation on the prediction data to generate the recon data, and an inverse quantization module which performs inverse quantization on the recon data to generate the output data, and

wherein the source data comprises a plurality of source pixel data, and

the quantization module is configured to perform a division operation on each of the plurality of source pixel data using a predefined, constant, quantization coefficient as a divisor to generate the recon data which correspond to quotients obtained by the division operation.

17. The image processing device of claim 16 ,

wherein the compressed data comprises a cyclic redundancy check (CRC) code for detecting an error of the output data, and

the frame buffer compressor further comprises a CRC check module which detects an error in the output data, using the CRC code.

18. The image processing device of claim 17 ,

wherein the CRC check module includes an error mark in the output data when the error of the output data is detected, and

the multimedia IP displays an error in the image data when the error mark is included in the output data.

19. The image processing device of claim 16 ,

wherein the compressed data comprises a predefined quantization coefficient,

the recon data comprises a plurality of recon pixel data, and

the inverse quantization module performs inverse quantizing on each of the plurality of recon pixel data using the predefined quantization coefficient to generate the output data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2019
From: JUN, SUNG HO
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 050353/0965 →
Priority Claims (1)
KR 10-2018-0151752 · Nov 30, 2018 · national
Continuity (1)
Related Publication 20200177899A1 · Jun 4, 2020
Cited By (2)
US 12,652,419 US 12,732,611