IP Library Granted Patent US 10,021,391
Granted Patent B2
US 10,021,391 · App. 15/659,715 · Granted Jul 10, 2018

Method and apparatus for encoding of video using depth information

Inventors: Gwang Hoon Park (Seongnam-si, KR); Tae Wook Kim (Suwon-si, KR); Yoon Jin Lee (Yongin-si, KR)
Assignee: UNIVERSITY-INDUSTRY COOPERATION GROUP OF KYUNG HEE UNIVERSITY
H04N19/124H04N19/119H04N19/136H04N19/167H04N19/172H04N19/51H04N19/597H04N19/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,021,391
App. No.
15/659,715
Granted
Jul 10, 2018
Kind
B2
Abstract

Provided is a method for encoding an image using a depth information that includes selecting a current coding unit (CU); verifying an object information of the current CU from an object information obtained from a depth image; and verifying whether or not the current CU is composed of a single object based on the object information, and predicting a division structure of the current CU according to whether or not the current CU is composed of a single object.

Claims (45)

1. A method for encoding an image using a depth information, the method comprising:

selecting a current coding unit (CU);

judging whether or not the current CU is composed of a single object when a size of the current CU is equal to or greater than a predetermined value; and

verifying an object information of a peripheral CU of the current CU or an object information of a reference CU of the current CU, and predicting a division structure of the current CU based on the object information of the peripheral CU or the object information of the reference CU, when the current CU is composed of a single object,

wherein the peripheral CU is an upside CU and a left CU of the current CU, and

wherein predicting a division structure of the current CU comprises:

judging whether or not the upside CU and the left CU are each composed of a single object; and

deciding not to divide the current CU when the upside CU and the left CU are each composed of a single object and each have a size equal to or greater than a predetermined value, and deciding to divide the current CU in one more level when the upside CU and the left CU each have the size less than the predetermined value.

2. The method according to claim 1 , wherein predicting the division structure of the current CU comprises:

judging whether or not the reference CU is composed of a single object when the upside CU and the left CU are not each composed of a single object; and

deciding not to divide the current CU when the reference CU is composed of a single object and has a size equal to or greater than the predetermined value, and deciding to divide the current CU in one more level when the current CU is not composed of a single object.

3. The method according to one of claim 1 , wherein the object information is a label value of an object information image that is a depth image labeled by a labeling algorithm.

4. The method according to one of claim 1 , wherein the object information of the current CU, the object information of the peripheral CU and the objection information of the reference CU are respective label values of an object information image that is a depth image labeled by a labeling algorithm.

5. A method for encoding an image using a depth information, the method comprising:

obtaining an object information of a largest coding unit (LCU) from a depth image;

predicting division structure candidates of the LCU based on the object information; and

deciding an optimum division structure among the division structure candidates of the LCU based on at least one of coding efficiency and display quality,

wherein predicting the division structure candidates of the LCU includes a process of judging whether or not a current coding unit (CU) is composed of a single object, and predicting a division structure of the current CU based on an object information of a peripheral CU when the current CU is composed of a single object,

wherein the peripheral CU is an upside CU and a left CU of the current CU, and

wherein predicting a division structure of the current CU comprises:

judging whether or not the upside CU and the left CU are each composed of a single object; and

deciding not to divide the current CU when the upside CU and the left CU are each composed of a single object and each have a size equal to or greater than a predetermined value, and deciding to divide the current CU in one more level when the upside CU and the left CU each have the size less than the predetermined value.

6. The method according to claim 5 , wherein the object information is a label value of an object information image that is a depth image labeled by a labeling algorithm.

7. The method according to claim 5 , wherein predicting the division structure candidates of the LCU comprises:

ending predicting the structure candidates when the current coding unit (CU) is composed of a single object and has a size less than a predetermined value.

8. An apparatus for encoding an image using a depth information, the apparatus comprising:

an object information verifying portion that verifies a size of a current coding unit (CU), and verifies whether or not the current CU is composed of a single object based on an object information of the current CU obtained from a depth image when the size of the current CU is equal to or greater than a predetermined value; and

a division structure prediction portion that verifies an object information of a peripheral CU of the current CU or an object information of a reference CU of the current CU, and predicts a division structure of the current CU based on the object information of the peripheral CU or the object information of the reference CU, when the current CU is composed of a single object,

wherein the peripheral CU is an upside CU and a left CU of the current CU, and

wherein the division structure prediction portion is configured to:

judge whether or not the upside CU and the left CU are each composed of a single object;

decide not to divide the current CU when the upside CU and the left CU are each composed of a single object and each have a size equal to or greater than a predetermined value; and

decide to divide the current CU in one more level when the upside CU and the left CU each have the size less than the predetermined value.

9. An apparatus for encoding an image using a depth information, the apparatus comprising:

an objection information verifying portion that verifies an object information of a largest coding unit (LCU) from a depth image;

a division structure prediction portion that predicts division structure candidates of the LCU based on the object information; and

an optimum division structure decision portion that decides an optimum division structure among the division structure candidates of the LCU based on at least one of coding efficiency and display quality,

wherein the division structure prediction portion is configured to

judge whether or not a current coding unit(CU) is composed of a single object,

predict a division structure of the current CU based on an object information of a peripheral CU when the current CU is composed of a single object,

wherein the peripheral CU is an upside CU and a left CU of the current CU, and

wherein the division structure prediction portion is configured to:

judge whether or not the upside CU and the left CU are each composed of a single object;

decide not to divide the current CU when the upside CU and the left CU are each composed of a single object and each have a size equal to or greater than a predetermined value; and

decide to divide the current CU in one more level when the upside CU and the left CU each have the size less than the predetermined value.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2026
From: IP3 2023, SERIES 923 OF ALLIED SECURITY TRUST I
To: RP INTELLECTUAL PARTNERS LLC
Reel/Frame 075782/0624 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2024
From: UNIVERSITY-INDUSTRY COOPERATION GROUP OF KYUNG HEE UNIVERSITY A/K/A KYUNGHEE UNIVERSITY-INDUSTRY COOPERATION FOUNDATION
To: IP3 2023, SERIES 923 OF ALLIED SECURITY TRUST I
Reel/Frame 066114/0951 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2023
From: PARK, GWANG HOON; KIM, TAE WOOK; LEE, YOON JIN
To: UNIVERSITY-INDUSTRY COOPERATION GROUP OF KYUNG HEE UNIVERSITY
Reel/Frame 065715/0107 →
Priority Claims (2)
KR 10-2014-0037275 · Mar 28, 2014 · national
KR 10-2014-0059063 · May 16, 2014 · national
Continuity (2)
Division 14631507 · Feb 25, 2015
Related Publication 20170324956A1 · Nov 9, 2017