IP Library › Granted Patent US 8,902,982
Granted Patent B2
US 8,902,982 · App. 13/350,250 · Granted Dec 2, 2014

Depth map coding and decoding apparatus and method

Inventors: Kwan Jung Oh (Hwaseong Si, KR); Jae Joon Lee (Seoul, KR); Du Sik Park (Suwon-si, KR); Ho Cheon Wey (Seongnam-si, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N19/00157H04N19/00769H04N19/0003H04N19/00278H04N13/0003
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,902,982
App. No.
13/350,250
Granted
Dec 2, 2014
Kind
B2
Abstract

An apparatus and method for coding and decoding a depth image are provided. The depth image coding apparatus predicts directivity of a current macro block using coded adjacent macro blocks. An intra-prediction mode that intra-codes the current macro block using the predicted directivity is included in intra-candidate coding modes. Priorities of intra-candidate coding modes and inter-candidate coding modes are arranged according to characteristics of a color image and coded. As a result, coding efficiency for a depth image may be increased.

Claims (81)

1. A depth image coding apparatus, comprising:

an intra-mode prediction unit to predict directivity of a current macro block using coded adjacent macro blocks;

an intra-coding unit to intra-code the current macro block according to each of intra-candidate coding modes;

an inter-coding unit to inter-code the current macro block according to each of inter-candidate coding modes; and

a coding mode determination unit to determine a coding mode having a lowest rate distortion optimization (RDO) cost among coding modes included in the intra-candidate coding modes and the inter-candidate coding modes as a coding mode of the current macro block, in consideration of priorities of the coding modes,

wherein the coding mode determination unit varies the priorities of the coding modes included in the inter-candidate coding modes and the inter-candidate coding modes, according to a final determination of frequencies of the coding modes,

wherein the intra-candidate coding modes comprise an intra-prediction mode for intra-coding using the predicted directivity.

2. The depth image coding apparatus of claim 1 , wherein

the intra-mode prediction unit measures a complexity of a left block of the current macro block and a complexity of an upper block of the current macro block using a first complexity measuring scheme, and predicts the directivity using a result of the measuring, and

when the complexity of the left block of the current macro block is similar to the complexity of the upper block of the current macro block within a predetermined margin of error as a result of the measuring using the first complexity measuring scheme, the intra-mode prediction unit measures the complexity of the left block of the current macro block and the complexity of the upper block of the current macro block using a second complexity measuring scheme, and predicts the directivity using a result of the measuring using the second complexity measuring scheme.

3. The depth image coding apparatus of claim 1 , wherein

the intra-prediction mode comprises at least one selected from an intra-skip mode, an intra-direct mode, and an intra-direction mode,

the intra-skip mode skips trasmitting predicted directivity information and a residual signal to a decoding apparatus,

the intra-direct mode transmits the residual signal to the decoding apparatus, and

the intra-direction mode transmits the predicted directivity information to the decoding apparatus.

4. The depth image coding apparatus of claim 3 , wherein the intra-skip mode has a highest priority or a second-highest priority of the priorities of the coding modes included in the intra-candidate coding modes and the inter-candidate coding modes.

5. The depth image coding apparatus of claim 1 , wherein the predicted directivity comprises one of a vertical direction that generates a prediction block by vertically expanding the current macro block from an upper boundary pixel, a horizontal direction that generates the prediction block by horizontally expanding the current macro block from a left boundary pixel, a discrete cosine DC direction that generates the prediction block using a mean value of the upper boundary pixel and the left boundary pixel of the current macro block, and a plane direction that generates the prediction block considering both the upper boundary pixel and the left boundary pixel of the current macro block.

6. The depth image coding apparatus of claim 1 , wherein the intra-candidate coding modes are classified according to a difference in at least one of a macro block size, whether directivity information is coded, and existence of a residual signal regarding a luminance component of the macro block.

7. The depth image coding apparatus of claim 1 , wherein

the inter-candidate coding modes refer to one motion vector per macro block, and

the inter-candidate coding modes are classified according to a difference in at least one of a macro block size, whether the motion vector is coded, and whether a residual signal is coded.

8. The depth image coding apparatus of claim 1 , wherein the priorities of the coding modes included in the intra-candidate coding modes and the inter-candidate coding modes are set such that the intra-candidate coding modes have higher priorities than the inter-candidate coding modes.

9. The depth image coding apparatus of claim 1 , wherein the priorities of the intra-candidate coding modes are set such that

a coding mode having a greater macro block size has a higher priority,

a coding mode not coding directivity information has a higher priority than a coding mode coding the directivity information,

a coding mode not coding a residual signal has a higher priority than a coding mode coding the residual signal, and

a coding mode having directivity has a higher priority than a coding mode not having directivity.

10. The depth image coding apparatus of claim 1 , wherein the priorities of the inter-candidate coding modes are set such that

a coding mode having a greater macro block size has a higher priority,

a coding mode not coding a motion vector has a higher priority than a coding mode coding the motion vector, and

a coding mode not coding a residual signal has a higher priority than a coding mode coding the residual signal.

11. The depth image coding apparatus of claim 1 , wherein information on the priorities of the coding modes included in the intra-candidate coding modes and the inter-candidate coding modes is preset or determined when a depth image is coded and then transmitted to a decoding apparatus.

12. The depth image coding apparatus of claim 1 , wherein the current macro block comprises one of a macro block of a depth image, a macro block of a black and white image, a macro block of a color image having a flat characteristic, and a macro block of an X-ray image.

13. The depth image coding apparatus of claim 1 , further comprising a deblocking filter unit to remove blocking by filtering a recovered block using the prediction block,

wherein the deblocking filter unit performs filtering more strongly in an instance when either of blocks on both sides with reference to a block boundary is intra-coded than in an instance when both of the blocks on both sides are inter-coded.

14. A depth image decoding apparatus comprising:

a coding mode recovery unit to confirm a coding mode of a coded macro block being received;

an intra-mode recovery unit to predict directivity of the coded macro block using decoded adjacent macro blocks when the coding mode of the coded macro block is an intra-prediction mode; and

an intra-decoding unit to generate a prediction block using the predicted directivity

wherein

the coding mode recovery unit confirms the coding mode of the macro block using information on priorities of coding modes included in intra-candidate coding modes and inter-candidate coding modes, and

the intra-prediction mode is included in the intra-candidate coding modes

wherein the coding mode recovery unit varies the priorities of the coding modes included in the intra-candidate coding modes and the inter-candidates coding modes, according to a final determination of frequencies of the code modes.

15. The depth image decoding apparatus of claim 14 , wherein

the intra-mode prediction unit measures a complexity of a left block of the current macro block and a complexity of an upper block of the current macro block using a first complexity measuring scheme, and predicts the directivity using a result of the measuring, and

when the complexity of the left block of the current macro block is similar to the complexity of the upper block of the current macro block within a predetermined margin of error as a result of the measuring using the first complexity measuring scheme, the intra-mode prediction unit measures the complexity of the left block of the current macro block and the complexity of the upper block of the current macro block using a second complexity measuring scheme, and predicts the directivity using a result of the measuring using the second complexity measuring scheme.

16. The depth image decoding apparatus of claim 14 , wherein the information on the priorities of the coding modes included the intra-candidate coding modes and the inter-candidate coding modes is preset or determined when a depth image is decoded and then received by a coding apparatus.

17. The depth image decoding apparatus of claim 14 , wherein the predicted directivity comprises one of a vertical direction that generates a prediction block by vertically expanding the coded macro block from an upper boundary pixel, a horizontal direction that generates the prediction block by horizontally expanding the coded macro block from a left boundary pixel, a DC direction that generates the prediction block using a mean value of the upper boundary pixel and the left boundary pixel of the coded macro block, and a plane direction that generates the prediction block considering both the upper boundary pixel and the left boundary pixel of the coded macro block.

18. The depth image decoding apparatus of claim 14 , wherein

the intra-prediction mode comprises at least one selected from an intra-skip mode, an intra-direct mode, and an intra-direction mode,

the intra-skip mode skips receiving predicted directivity information and a residual signal,

the intra-direct mode receives the residual signal, and

the intra-direction mode receives the predicted directivity information.

19. The depth image decoding apparatus of claim 14 , further comprising a deblocking filter unit to remove blocking by filtering a recovered block using the prediction block,

wherein the deblocking filter unit performs filtering more strongly in an instance when either of blocks on both sides with reference to a block boundary is intra-coded than in an instance when both of the blocks on both sides are inter-coded.

20. A depth image coding method comprising:

predicting directivity of a current macro block using coded adjacent macro blocks;

intra-coding the current macro block according to each of intra-candidate coding modes;

inter-coding the current macro block according to each of inter-candidate coding modes when the current macro block corresponds to a P-picture or a B-picture; and

determining a coding mode having a lowest rate distortion optimization (RDO) cost among coding modes included in the intra-candidate coding modes and the inter-candidate coding modes as a coding mode of the current macro block, in consideration of priorities of the coding modes,

wherein the coding mode determination unit varies the priorities of the coding modes included in the intra-candidate coding modes and the inter-candidate coding modes, determining a coding mode according to a final determination of frequencies of the coding modes,

wherein the intra-candidate coding modes comprise an intra-prediction mode for intra-coding using the predicted directivity.

21. The depth image coding method of claim 20 , wherein

the intra-prediction mode comprises at least one selected from an intra-skip mode, an intra-direct mode, and an intra-direction mode,

the intra-skip mode codes predicted directivity information and a residual signal and skips transmitting the residual signal and the information to a decoding apparatus,

the intra-direct mode codes the transmit the residual signal to the decoding apparatus, and

the intra-direction mode transmits the predicted directivity information to the decoding apparatus.

22. The depth image coding method of claim 21 , wherein the intra-skip mode has a highest priority or a second-highest priority of the priorities of the coding modes included in the intra-candidate coding modes and the inter-candidate coding modes.

23. The depth image coding method of claim 20 , wherein the predicted directivity comprises one of a vertical direction that generates a prediction block by vertically expanding the current macro block from an upper boundary pixel, a horizontal direction that generates the prediction block by horizontally expanding the current macro block from a left boundary pixel, a DC direction that generates the prediction block using a mean value of the upper boundary pixel and the left boundary pixel of the current macro block, and a plane direction that generates the prediction block considering both the upper boundary pixel and the left boundary pixel of the current macro block.

24. A depth image decoding method comprising:

confirming a coding mode of a coded macro block using information on priorities of coding modes included intra-candidate coding modes and inter-candidate coding modes;

predicting directivity of the coded macro block using decoded adjacent macro blocks when the coding mode of the coded macro block is an intra-prediction mode; and

generating a prediction block using the predicted directivity

wherein information on the priorities of the coding modes included in the intra-candidate coding modes and the inter-candidate coding modes is preset or determined when a depth image is decoded,

wherein the coding mode determination unit varies the priorities of the coding modes included in the intra-candidate coding modes and the inter-candidate coding modes, confirming a coding mode according to a final determination of frequencies of the code modes.

25. The depth image decoding method of claim 24 , wherein the predicted directivity comprises one of a vertical direction that generates a prediction block by vertically expanding the coded macro block from an upper boundary pixel, a horizontal direction that generates the prediction block by horizontally expanding the coded macro block from a left boundary pixel, a DC direction that generates the prediction block using a mean value of the upper boundary pixel and the left boundary pixel of the coded macro block, and a plane direction that generates the prediction block considering both the upper boundary pixel and the left boundary pixel of the coded macro block.

26. The depth image decoding method of claim 24 , wherein

the intra-prediction mode comprises at least one selected from an intra-skip mode, an intra-direct mode, and an intra-direction mode,

the intra-skip mode skips receiving predicted directivity information and a residual signal from a coding apparatus,

the intra-direct mode receives the residual signal, and

the intra-direction mode receives the predicted directivity information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2012
From: OH, KWAN JUNG; LEE, JAE JOON; PARK, DU SIK; WEY, HO CHEON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 027539/0884 →
Priority Claims (2)
KR 10-2011-0004490 · Jan 17, 2011 · national
KR 10-2011-0092912 · Sep 15, 2011 · national
Continuity (3)
Provisional Application 61434594 · Jan 20, 2011
Provisional Application 61558567 · Nov 11, 2011
Related Publication 20120183066A1 · Jul 19, 2012