IP Library Granted Patent US 11,216,984
Granted Patent B2
US 11,216,984 · App. 16/734,224 · Granted Jan 4, 2022

Patch splitting for improving video-based point cloud compression performance

Inventors: Indranil Sinharoy (Richardson, TX); Esmaeil Faramarzi (Richardson, TX); Madhukar Budagavi (Plano, TX)
Assignee: Samsung Electronics Co., Ltd.
G06T9/00G06T3/40G06T7/0002G06T7/11G06T7/136G06T7/174G06T7/40G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,216,984
App. No.
16/734,224
Granted
Jan 4, 2022
Kind
B2
Abstract

An encoding device and methods for point cloud encoding are disclosed. The method for encoding includes generating, using a processor of an encoder, a first frame and a second frame that include patches representing a cluster of points of three-dimensional (3D) point cloud; identifying a patch to segment in the patches of the first frame and the second frame; determining, in response to identifying the patch, a path representing a boundary between segmented regions within the patch; segmenting the patch along the path into two patches for the first frame and the second frame; encoding the first frame and the second frame to generate a compressed bitstream; and transmitting, using a communication interface operably coupled to the processor, the compressed bitstream.

Claims (58)

1. An encoding device for point cloud encoding, the encoding device comprising:

a processor configured to:

generate, for a three-dimensional (3D) point cloud, a first frame and a second frame that include patches representing a cluster of points of the 3D point cloud;

identify a first patch to segment in the patches of the first frame and the second frame;

identify an attribute for points in the first patch;

determine, in response to identifying the first patch, transition points in the first patch based on the attribute changing between adjacent points;

identify an attribute boundary based on a string of the transition points extending entirely across the first patch;

determine a path representing the attribute boundary between segmented regions within the patch;

segment the first patch along the path into a second patch and a third patch for the first frame and the second frame; and

encode the second patch and the third patch in the first frame and the second frame to generate a compressed bitstream; and

a communication interface operably coupled to the processor, the communication interface configured to transmit the compressed bitstream.

2. The encoding device of claim 1 , wherein:

the processor is further configured to identify the first patch to segment based on a dimension of the first patch exceeding a dimension threshold, and

the determination of the path is in response to the identification that the dimension of the first patch exceeds the dimension threshold.

3. The encoding device of claim 2 , wherein:

more than one attribute boundary is identified based on the transition points,

to determine the path, the processor is further configured to determine the path based on an attribute boundary with a longest boundary in a direction that the first patch exceeded the dimension threshold.

4. The encoding device of claim 2 , wherein the dimension threshold is a max patch size.

5. The encoding device of claim 2 , wherein the dimension threshold is a function of a point cloud bit-depth.

6. The encoding device of claim 2 , wherein, to determine the path, the processor is further configured to determine that at least one of the second patch and the third patch does not exceed the dimension threshold, which was exceeded by the first patch.

7. The encoding device of claim 2 , wherein:

the attribute is a texture; and

the attribute boundary is a texture boundary.

8. The encoding device of claim 2 , wherein:

the attribute is a depth, and

the attribute boundary is a depth boundary.

9. The encoding device of claim 2 , wherein:

the attribute is a material identifier (ID); and

the attribute boundary is a material boundary.

10. The encoding device of claim 1 , wherein the path continuously extends from one side of the first patch to an opposite side of the first patch in a direction in which the first patch exceeded a dimension threshold.

11. A method for point cloud encoding, the method comprising:

generating, using a processor of an encoder, a first frame and a second frame that include patches representing a cluster of points of three-dimensional (3D) point cloud;

identifying a first patch to segment in the patches of the first frame and the second frame;

identifying an attribute for points in the first patch;

determining, in response to identifying the first patch, transition points in the first patch based on the attribute changing between adjacent points;

identifying an attribute boundary based on a string of the transition points extending entirely across the first patch;

determining a path representing the attribute boundary between segmented regions within the patch;

segmenting the first patch along the path into a second patch and a third patch for the first frame and the second frame;

encoding the second patch and the third patch in the first frame and the second frame to generate a compressed bitstream; and

transmitting, using a communication interface operably coupled to the processor, the compressed bitstream.

12. The method of claim 11 , further comprising identifying the first patch to segment based on a dimension of the first patch exceeding a dimension threshold,

wherein the determination of the path is in response to the identification that the dimension of the first patch exceeds the dimension threshold.

13. The method of claim 12 , wherein:

more than one attribute boundary is identified based on the transition points,

to determine the path, the method further comprises determining the path based on an attribute boundary with a longest boundary in a direction that the first patch exceeded the dimension threshold.

14. The method of claim 12 , wherein the dimension threshold is a max patch size.

15. The method of claim 12 , wherein the dimension threshold is a function of a point cloud bit-depth.

16. The method of claim 12 , wherein determining the path includes determining that at least one of the second patch and the third patch does not exceed the dimension threshold, which was exceeded by the first patch.

17. The method of claim 12 , wherein:

the attribute is a texture; and

the attribute boundary is a texture boundary.

18. The method of claim 12 , wherein:

the attribute is a depth, and

the attribute boundary is a depth boundary.

19. The method of claim 12 , wherein:

the attribute is a material identifier (ID); and

the attribute boundary is a material boundary.

20. The method of claim 11 , wherein the path continuously extends from one side of the first patch to an opposite side of the first patch in a direction in which the first patch exceeded a dimension threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2020
From: SINHAROY, INDRANIL; FARAMARZI, ESMAEIL; BUDAGAVI, MADHUKAR
To: SAMSUNG ELECTRONICS CO., LTD
Reel/Frame 051414/0521 →
Continuity (4)
Provisional Application 62790322 · Jan 9, 2019
Provisional Application 62869846 · Jul 2, 2019
Provisional Application 62937998 · Nov 20, 2019
Related Publication 20200219286A1 · Jul 9, 2020
Cited By (1)
US 12,457,258