IP Library › Granted Patent US 11,159,811
Granted Patent B2
US 11,159,811 · App. 16/814,350 · Granted Oct 26, 2021

Partitioning of coded point cloud data

Inventors: Byeongdoo Choi (Palo Alto, CA); Arash Vosoughi (San Jose, CA); Sehoon Yea (Palo Alto, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/44H04N19/119H04N19/172H04N19/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,159,811
App. No.
16/814,350
Granted
Oct 26, 2021
Kind
B2
Abstract

Systems and methods for decoding a video stream, a method includes receiving video stream, the video stream including: a frame of a plurality of two-dimensional (2D) pictures that are layers of the frame, each of the plurality of 2D pictures having a respective attribute of a same three-dimensional (3D) representation, frame partition information that indicates the frame is partitioned into a plurality of sub-frames, each of the plurality of sub-frames being a respective combination of a sub-region of each picture of the plurality of 2D pictures, and 3D bounding box information that specifies a 3D position corresponding to a sub-frame of the plurality of sub-frames; the method further includes identifying the sub-frame using the frame partition information; and decoding the sub-frame identified.

Claims (59)

1. A method for decoding a video stream with at least one processor, the method comprising:

receiving the video stream, the video stream including:

a frame of a plurality of two-dimensional (2D) pictures that are layers of the frame, each of the plurality of 2D pictures having a respective attribute of a same three-dimensional (3D) representation,

frame partition information that indicates the frame is partitioned into a plurality of sub-frames, each of the plurality of sub-frames being a respective combination of a sub-region of each picture of the plurality of 2D pictures, and

3D bounding box information that specifies a 3D position corresponding to a sub-frame of the plurality of sub-frames;

identifying the sub-frame using the frame partition information; and

decoding the sub-frame identified,

wherein the frame partition information, of the video stream received, includes 2D bounding box information that specifies at least one among a position and boundary of the sub-frame in the frame,

the 3D bounding box information specifies a 3D position of a 2D bounding box specified in the 2D bounding box information, and

the method further comprises, after decoding the sub-frame identified, obtaining a point cloud from the video stream by using the 3D bounding box information.

2. The method according to claim 1 , further comprises:

determining whether the sub-frame is independently coded, wherein

the decoding the sub-frame comprises decoding the sub-frame independently from other sub-frames of the plurality of sub-frames, in a case where the sub-frame is determined to be independently coded.

3. The method according to claim 1 , wherein

the video stream received includes a frame parameter set that includes the frame partition information and the 3D bounding box information.

4. The method according to claim 1 , wherein

the plurality of 2D pictures includes a first picture, a second picture, and a third picture, the first picture being a texture image, the second picture being a geometry image, and the third picture being an occupancy map.

5. The method according to claim 1 , wherein

the video stream further includes an additional frame of a plurality of 2D pictures that are layers of the additional frame, each of the plurality of 2D pictures of the additional frame having a respective attribute of a same additional 3D representation, and

the method further comprises:

identifying a sub-frame of the additional frame using the frame partition information used to identify the sub-frame of the frame, and

decoding the sub-frame of the additional frame identified.

6. A system for decoding a video stream, the system comprising:

memory configured to store computer program code; and

at least one processor configured to receive the video stream, access the computer program code, and operate as instructed by the computer program code, wherein

the video stream includes:

a frame of a plurality of two-dimensional (2D) pictures that are layers of the frame, each of the plurality of 2D pictures having a respective attribute of a same three-dimensional (3D) representation,

frame partition information that indicates the frame is partitioned into a plurality of sub-frames, each of the plurality of sub-frames being a respective combination of a sub-region of each picture of the plurality of 2D pictures, and

3D bounding box information that specifies a 3D position corresponding to a sub-frame of the plurality of sub-frames,

the computer program code includes:

identifying code configured to cause the at least one processor to identify the sub-frame using the frame partition information; and

decoding code configured to cause the at least one processor to decode the sub-frame identified,

the frame partition information, of the video stream, includes 2D bounding box information that specifies at least one among a position and boundary of the sub-frame in the frame,

the 3D bounding box information specifies a 3D position of a 2D bounding box specified in the 2D bounding box information, and

the computer program code further includes obtaining code configured to cause the at least one processor to obtain a point cloud from the video stream by using the 3D bounding box information.

7. The system according to claim 6 , wherein

the computer program code further comprises determining code configured to cause the at least one processor to determine whether the sub-frame is independently coded, and

the decoding code is configured to cause the at least one processor to decode the sub-frame independently from other sub-frames of the plurality of sub-frames, in a case where the sub-frame is determined to be independently coded.

8. The system according to claim 6 , wherein

the video stream includes a frame parameter set that includes the frame partition information and the 3D bounding box information.

9. The system according to claim 6 , wherein

the plurality of 2D pictures includes a first picture, a second picture, and a third picture, the first picture being a texture image, the second picture being a geometry image, and the third picture being an occupancy map.

10. A non-transitory computer-readable medium storing computer instructions that, when executed by at least one processor, cause the at least one processor to:

identify a sub-frame, from a video stream received by the at least one processor, using frame partition information;

decode the sub-frame identified; and

obtain, after decoding the sub-frame identified, a point cloud from the video stream by using three-dimensional (3D) bounding box information, wherein

the video stream includes:

a frame of a plurality of two-dimensional (2D) pictures that are layers of the frame, each of the plurality of 2D pictures having a respective attribute of a same 3D representation,

the frame partition information, the frame partition information indicating the frame is partitioned into a plurality of sub-frames, including the sub-frame, each of the plurality of sub-frames being a respective combination of a sub-region of each picture of the plurality of 2D pictures, and

the 3D bounding box information, the 3D bounding box information specifying a 3D position corresponding to the sub-frame of the plurality of sub-frames,

the frame partition information, of the video stream, includes 2D bounding box information that specifies at least one among a position and boundary of the sub-frame in the frame, and

the 3D bounding box information specifies a 3D position of a 2D bounding box specified in the 2D bounding box information.

11. The non-transitory computer-readable medium according to claim 10 , wherein

the computer instructions, when executed by the at least one processor, further cause the at least one processor to determine whether the sub-frame is independently coded, and

the sub-frame is decoded independently from other sub-frames of the plurality of sub-frames, in a case where the sub-frame is determined to be independently coded.

12. The non-transitory computer-readable medium according to claim 10 , wherein

the video stream received includes a frame parameter set that includes the frame partition information and the 3D bounding box information.

13. The non-transitory computer-readable medium according to claim 10 , wherein

the plurality of 2D pictures includes a first picture, a second picture, and a third picture, the first picture being a texture image, the second picture being a geometry image, and the third picture being an occupancy map.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2020
From: CHOI, BYEONGDOO; VOSOUGHI, ARASH; YEA, SEHOON; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 052070/0035 →
Continuity (2)
Provisional Application 62819504 · Mar 15, 2019
Related Publication 20200296394A1 · Sep 17, 2020