IP Library › Granted Patent US 11,109,071
Granted Patent B2
US 11,109,071 · App. 16/738,287 · Granted Aug 31, 2021

Method and apparatus for dynamic point cloud partition packing

Inventors: Arash Vosoughi (San Jose, CA); Sehoon Yea (Palo Alto, CA); Shan Liu (San Jose, CA); Byeongdoo Choi (Palo Alto, CA); Stephan Wenger (Hillsborough, CA)
Assignee: TENCENT AMERICA LLC
H04N19/91H04N19/119H04N19/167H04N19/172
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,109,071
App. No.
16/738,287
Granted
Aug 31, 2021
Kind
B2
Abstract

A method of dynamic point cloud partition packing is by at least one processor and includes obtaining one or more region of interest (ROI) patches from an ROI of a point cloud, and attempting to pack, into one among tiles of a tile map, one among the obtained one or more ROI patches, in a tile scan order. The method further includes identifying whether the one among the one or more ROI patches is packed successfully into the one among the tiles, and based on the one among the one or more ROI patches being determined to be not packed successfully into the one among the tiles, chunking the one among the one or more ROI patches into multiple ROI patches.

Claims (42)

1. A method of dynamic point cloud partition packing, the method being performed by at least one processor, and the method comprising:

obtaining one or more region of interest (ROI) patches from an ROI of a point cloud;

attempting to pack, into one among tiles of a tile map, one among the obtained one or more ROI patches, in a tile scan order;

identifying whether the one among the one or more ROI patches is packed successfully into the one among the tiles;

based on the one among the one or more ROI patches being determined to be not packed successfully into the one among the tiles, chunking the one among the one or more ROI patches into multiple ROI patches;

partitioning the point cloud into multiple partitions comprising a first partition and a second partition;

obtaining, for each of the multiple partitions into which the point cloud is partitioned, a maximum number of tiles in a frame to be used to pack a respective one of the multiple partitions, among a group of frames, the maximum number of tiles for the first partition being different than the maximum number of tiles for the second partition; and

packing each of the multiple partitions into the maximum number of tiles obtained for a respective one of the multiple partitions, in each of the group of frames, so that each of the maximum number of tiles for the first partition and the maximum number of tiles for the second partition is not shared by any of the multiple partitions and remains the same for all frames in the group of frames.

2. The method of claim 1 , further comprising:

attempting to pack, into the one among the tiles, one among the multiple ROI patches into which the one among the one or more ROI patches is chunked, in the tile scan order;

identifying whether the one among the multiple ROI patches is packed successfully into the one among the tiles; and

based on the one among the multiple ROI patches being determined to be not packed successfully into the one among the tiles, chunking the one among the multiple ROI patches into a plurality of ROI patches.

3. The method of claim 1 , further comprising transmitting information of a super bounding box for the group of tiles into which a respective one of the multiple partitions is packed, the super bounding box comprising all tiles into which the respective one of the multiple partitions is packed for all frames in the group of frames.

4. The method of claim 1 , further comprising, based on the one among the one or more ROI patches being determined to be packed successfully into the one among the tiles, transmitting an index of the one among the tiles.

5. An apparatus for dynamic point cloud partition packing, the apparatus comprising:

at least one memory configured to store computer program code; and

at least one processor configured to access the at least one memory and operate according to the computer program code, the computer program code comprising:

obtaining code configured to cause the at least one processor to obtain one or more region of interest (ROI) patches from an ROI of a point cloud;

packing code configured to cause the at least one processor to attempt to pack, into one among tiles of a tile map, one among the obtained one or more ROI patches, in a tile scan order;

identifying code configured to cause the at least one processor to identify whether the one among the one or more ROI patches is packed successfully into the one among the tiles;

chunking code configured to cause the at least one processor to, based on the one among the one or more ROI patches being determined to be not packed successfully into the one among the tiles, chunk the one among the one or more ROI patches into multiple ROI patches; and

partitioning code configured to cause the at least one processor to partition the point cloud into multiple partitions comprising a first partition and a second partition,

wherein the obtaining code is further configured to cause the at least one processor to obtain, for each of the multiple partitions into which the point cloud is partitioned, a maximum number of tiles in a frame to be used to pack a respective one of the multiple partitions, among a group of frames, the maximum number of tiles for the first partition being different than the maximum number of tiles for the second partition, and

the packing code is further configured to cause the at least one processor to pack each of the multiple partitions into the maximum number of tiles obtained for a respective one of the multiple partitions, in each of the group of frames, so that each of the maximum number of tiles for the first partition and the maximum number of tiles for the second partition is not shared by any of the multiple partitions and remains the same for all frames in the group of frames.

6. The apparatus of claim 5 , wherein the packing code is further configured to cause the at least one processor to attempt to pack, into the one among the tiles, one among the multiple ROI patches into which the one among the one or more ROI patches is chunked, in the tile scan order,

the identifying code is further configured to cause the at least one processor to identify whether the one among the multiple ROI patches is packed successfully into the one among the tiles, and

the chunking code is further configured to cause the at least one processor to, based on the one among the multiple ROI patches being determined to be not packed successfully into the one among the tiles, chunk the one among the multiple ROI patches into a plurality of ROI patches.

7. The apparatus of claim 5 , further comprising transmitting code configured to cause the at least one processor to transmit information of a super bounding box for the group of tiles into which a respective one of the multiple partitions is packed, the super bounding box comprising all tiles into which the respective one of the multiple partitions is packed for all frames in the group of frames.

8. The apparatus of claim 5 , further comprising transmitting code configured to cause the at least one processor to, based on the one among the one or more ROI patches being determined to be packed successfully into the one among the tiles, transmit an index of the one among the tiles.

9. A non-transitory computer-readable storage medium storing instructions that cause at least one processor to:

obtain one or more region of interest (ROI) patches from an ROI of a point cloud;

attempt to pack, into one among tiles of a tile map, one among the obtained one or more ROI patches, in a tile scan order;

identify whether the one among the one or more ROI patches is packed successfully into the one among the tiles;

based on the one among the one or more ROI patches being determined to be not packed successfully into the one among the tiles, chunk the one among the one or more ROI patches into multiple ROI patches;

partition the point cloud into multiple partitions comprising a first partition and a second partition;

obtain, for each of the multiple partitions into which the point cloud is partitioned, a maximum number of tiles in a frame to be used to pack a respective one of the multiple partitions, among a group of frames, the maximum number of tiles for the first partition being different than the maximum number of tiles for the second partition; and

pack each of the multiple partitions into the maximum number of tiles obtained for a respective one of the multiple partitions, in each of the group of frames, so that each of the maximum number of tiles for the first partition and the maximum number of tiles for the second partition is not shared by any of the multiple partitions and remains the same for all frames in the group of frames.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the instructions further cause the at least one processor to:

attempt to pack, into the one among the tiles, one among the multiple ROI patches into which the one among the one or more ROI patches is chunked, in the tile scan order;

identify whether the one among the multiple ROI patches is packed successfully into the one among the tiles; and

based on the one among the multiple ROI patches being determined to be not packed successfully into the one among the tiles, chunk the one among the multiple ROI patches into a plurality of ROI patches.

11. The non-transitory computer-readable storage medium of claim 9 , wherein the instructions further cause the at least one processor to transmit information of a super bounding box for the group of tiles into which a respective one of the multiple partitions is packed, the super bounding box comprising all tiles into which the respective one of the multiple partitions is packed for all frames in the group of frames.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2020
From: VOSOUGHI, ARASH; YEA, SEHOON; LIU, SHAN; CHOI, BYEONGDOO; WENGER, STEPHAN
To: TENCENT AMERICA LLC
Reel/Frame 052175/0114 →
Continuity (4)
Provisional Application 62790446 · Jan 9, 2019
Provisional Application 62854953 · May 30, 2019
Provisional Application 62870319 · Jul 3, 2019
Related Publication 20200221139A1 · Jul 9, 2020