IP Library Granted Patent US 9,788,002
Granted Patent B2
US 9,788,002 · App. 14/020,019 · Granted Oct 10, 2017

Image processing apparatus and method

Inventors: Sang Jo Lee (Suwon-si, KR); Do Hyung Kim (Hawseong-si, KR); Joon Ho Song (Hwaseong-si, KR); Shi Hwa Lee (Seoul, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N19/423H04N19/119H04N19/174
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,788,002
App. No.
14/020,019
Granted
Oct 10, 2017
Kind
B2
Abstract

A method and apparatus for applying a tile size adaptively based on a size of a coding unit. An image processing apparatus may detect a size of a largest coding unit (LCU) used in encoding of a video from a header of a bitstream, may determine a tile size adaptively based on the detected size of the LCU, and may decode the bitstream in units of the LCU based on the determined tile size.

Claims (46)

1. An image processing apparatus for processing frames of a video, the apparatus comprising:

a detecting unit configured to detect a size of a largest coding unit (LCU) used in encoding a bitstream;

a determining unit configured to determine a tile size adaptively based on the detected size of the LCU; and

a decoding unit configured to decode the bitstream,

wherein the determining unit further comprises:

a calculating unit configured to calculate a cycle required to transmit pixels included in the LCU to a memory, by tile sizes of a plurality of tiles included in a pool; and

a deciding unit configured to decide, as the tile size for tiling the LCU, the tile size corresponding to a smallest cycle required for transmission as a result of the calculation by the calculating unit,

wherein the determining unit is configured to tile pixels of a pixel block into tiles of a row when the detected size of the LCU is a size of one pixel block among a 16×4 pixel block, a 32×8 pixel block, and a 64×16 pixel block, and

wherein frames composing the video include LCUs of different sizes and the determining unit determines a respective tile size for each frame based on the size of the LCU.

2. The image processing apparatus of claim 1 , wherein the detecting unit comprises:

a parsing unit configured to obtain the size of the LCU by parsing a header field of the bitstream.

3. The image processing apparatus of claim 1 , wherein the decoding unit further comprises:

a tiling unit configured to tile the pixels included in the LCU by the determined tile size; and

an access unit configured to access the memory by the determined tile size.

4. The image processing apparatus of claim 1 , wherein the determining unit is configured to tile pixel blocks representing a plurality of color components included in the LCU into the tiles of the row.

5. The image processing apparatus of claim 1 , further comprising:

a data reconstructing unit configured to reconstruct, after the decoding of the bitstream, pixel data of the LCU through intra prediction using a neighboring pixel of a current frame previously reconstructed; and

a control unit configured to store the reconstructed pixel data in the memory in the determined tile size.

6. The image processing apparatus of claim 1 , further comprising:

a loading unit configured to load, after the decoding of the bitstream, pixel data of a previously stored frame from the memory in units of the determined tile size using decoded motion information;

a data reconstructing unit configured to reconstruct pixel data of the LCU using the loaded previous pixel data and decoded residual data in a current bitstream; and

a control unit configured to store the reconstructed pixel data in the memory in the determined tile size.

7. The image processing apparatus of claim 1 , wherein a cycle required for transmission is calculated differently based on an initial latency, a data transmission bus width, and a transmission process.

8. An image processing method for processing frames of a video, the method comprising:

detecting a size of a largest coding unit (LCU) used in encoding of a video of a bitstream;

determining a tile size adaptively based on the detected size of the LCU; and

decoding the bitstream,

wherein the determining further comprises:

calculating a cycle required to transmit pixels included in the LCU to a memory, by tile sizes of a plurality of tiles included in a pool; and

deciding, as the tile size for tiling the LCU, the tile size corresponding to a smallest cycle required for transmission as a result of the calculation, and

wherein the determining tiles pixels of a pixel block into tiles of a row when the detected LCU has a size of one pixel block among a 16×4 pixel block, a 32×8 pixel block, and a 64×16 pixel block, and

wherein frames composing the video include LCUs of different sizes, and wherein the determining determines a respective tile size for each frame based on the detected size of the LCU.

9. The image processing method of claim 8 , wherein the detecting comprises:

obtaining the size of the LCU by parsing a header field of the bitstream.

10. The image processing method of claim 8 , wherein the decoding further comprises:

tiling the pixels included in the LCU by the determined tile size; and

accessing the memory by the determined tile size.

11. The image processing method of claim 8 , further comprising:

reconstructing, after the decoding of the bitstream, pixel data of the LCU through intra prediction using a neighboring pixel of a current frame previously reconstructed; and

storing the reconstructed pixel data in the memory in the determined tile size.

12. The image processing method of claim 8 , further comprising:

loading, after the decoding of the bitstream, pixel data of a previously stored frame from the memory in units of the determined tile size using decoded motion information;

reconstructing pixel data of the LCU using the loaded previous pixel data and decoded residual data in a current bitstream; and

storing the reconstructed pixel data in the memory in the determined tile size.

13. The image processing method of claim 8 , further comprising accessing the memory using different tile sizes based on the detected size of the LCU.

14. The image processing method of claim 8 , wherein the determining comprises determine an optimized memory access based on the decided tile size.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2014
From: LEE, SANG JO; KIM, DO HYUNG; SONG, JOON HO; LEE, SHI HWA
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 032504/0446 →
Priority Claims (2)
KR 10-2012-0136928 · Nov 29, 2012 · national
KR 10-2013-0019581 · Feb 25, 2013 · national
Continuity (1)
Related Publication 20140146873A1 · May 29, 2014