IP Library › Granted Patent US 11,875,539
Granted Patent B2
US 11,875,539 · App. 17/108,918 · Granted Jan 16, 2024

Partial access metadata for video-based point cloud compression data

Inventor: Youngkwon Lim (Allen, TX)
Assignee: Samsung Electronics Co., Ltd.
G06T9/001G06T3/40G06T17/00G06V20/64G06V30/147G06V30/1437H04L65/70H04L65/75
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,875,539
App. No.
17/108,918
Granted
Jan 16, 2024
Kind
B2
Abstract

A decoding device, method, and computer readable medium for partial access metadata for video-based point cloud compression data are disclosed. The decoding device for point cloud decoding includes a communication interface and a processor operably coupled to the communication interface. The communication interface receives a compressed bitstream and metadata related to the compressed bitstream. The processor identifies, in the metadata, region information that indicates a region of a point cloud based on a user perspective; locates a track of the compressed bitstream that corresponds to the region information; identifies, in the track, objects corresponding to the region of the point cloud; and decodes for display of an object, included in the objects identified in the track, that is visible from the user perspective.

Claims (66)

1. A decoding device for generating partial access metadata for video-based point cloud compression, the decoding device comprising:

a communication interface configured to receive a compressed bitstream and metadata related to the compressed bitstream;

a processor operably coupled to the communication interface, wherein the processor is configured to:

identify, in the metadata, region information that indicates a region of a point cloud based on a user perspective;

locate a track of the compressed bitstream that corresponds to the region information;

identify, in the track, objects corresponding to the region of the point cloud; and

decode for display of an object, included in the objects identified in the track, that is visible from the user perspective.

2. The decoding device of claim 1 , wherein:

the compressed bitstream includes a supplemental enhancement information (SEI) message, and

the objects corresponding to the region of the point cloud are defined in the SEI message based on a number of the objects, a length of an object identifier, and a value of object identifiers.

3. The decoding device of claim 2 , wherein the number of the objects indicates a total number of objects in the region, the length of the object identifier indicates a length of a respective object identifier, and the value of object identifiers indicates an identifier of a respective object.

4. The decoding device of claim 2 , wherein the processor is configured to determine whether the object is visible from the user perspective based on a three-dimensional region corresponding to a location present in or bordering the region in line with the user perspective.

5. The decoding device of claim 1 , wherein the processor is further configured to:

identify, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;

identify a new object in the updated track that is visible from the user perspective; and

decode the new object for display.

6. The decoding device of claim 1 , wherein the processor is further configured to:

identify, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;

identify, in the track, a deleted object corresponding an object currently displayed; and

remove the deleted object from display.

7. The decoding device of claim 6 , wherein:

the compressed bitstream includes a supplemental enhancement information (SEI) message, and

the deleted object is defined in the SEI message based on a number of canceled objects, a length of an object identifier, and a value of object identifiers.

8. A method for point cloud decoding, the method comprising:

receiving, using a communication interface, a compressed bitstream and metadata related to the compressed bitstream;

identifying, using a processor operably coupled to the communication interface, region information in the metadata that indicates a region of a point cloud based on a user perspective;

locating a track of the compressed bitstream that corresponds to the region information;

identifying, in the track, objects corresponding to the region of the point cloud; and

decoding for display of an object, included in the objects identified in the track, that is visible from the user perspective.

9. The method of claim 8 , wherein:

the compressed bitstream includes a supplemental enhancement information (SEI) message, and

the objects corresponding to the region of the point cloud are defined in the SEI message based on a number of the objects, a length of an object identifier, and a value of object identifiers.

10. The method of claim 9 , wherein the number of the objects indicates a total number of objects in the region, the length of the object identifier indicates a length of a respective object identifier, and the value of object identifiers indicates an identifier of a respective object.

11. The method of claim 9 , further comprising:

determining whether the object is visible from the user perspective based on a three-dimensional region corresponding to a location present in or bordering the region in line with the user perspective.

12. The method of claim 8 , further comprising:

identifying, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;

identifying a new object in the updated track that is visible from the user perspective; and

decoding the new object for display.

13. The method of claim 8 , further comprising:

identifying, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;

identifying, in the track, a deleted object corresponding an object currently displayed; and

removing the deleted object from display.

14. The method of claim 13 , wherein:

the compressed bitstream includes a supplemental enhancement information (SEI) message, and

the deleted object is defined in the SEI message based on a number of canceled objects, a length of an object identifier, and a value of object identifiers.

15. A non-transitory computer readable medium embodying a computer program, the computer program comprising computer readable program code that, when executed by a processor of an electronic device, causes the electronic device to:

receive a compressed bitstream and metadata related to the compressed bitstream;

identify, in the metadata, region information that indicates a region of a point cloud based on a user perspective;

locate a track of the compressed bitstream that corresponds to the region information;

identify, in the track, objects corresponding to the region of the point cloud; and

decode for display of an object, included in the objects identified in the track, that is visible from the user perspective.

16. The non-transitory computer readable medium of claim 15 , wherein:

the compressed bitstream includes a supplemental enhancement information (SEI) message, and

the objects corresponding to the region of the point cloud are defined in the SEI message based on a number of the objects, a length of an object identifier, and a value of object identifiers.

17. The non-transitory computer readable medium of claim 16 , wherein the number of the objects indicates a total number of objects in the region, the length of the object identifier indicates a length of a respective object identifier, and the value of object identifiers indicates an identifier of a respective object.

18. The non-transitory computer readable medium of claim 16 , wherein the computer readable program code that, when executed by the processor of the electronic device, further causes the electronic device to:

determine whether the object is visible from the user perspective based on a three-dimensional region corresponding to a location present in or bordering the region in line with the user perspective.

19. The non-transitory computer readable medium of claim 15 , wherein the computer readable program code that, when executed by the processor of the electronic device, further causes the electronic device to:

identify, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;

identify a new object in the updated track that is visible from the user perspective; and

decode the new object for display.

20. The non-transitory computer readable medium of claim 15 , wherein the computer readable program code that, when executed by the processor of the electronic device, further causes the electronic device to:

identify, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;

identify, in the track, a deleted object corresponding an object currently displayed; and

remove the deleted object from display.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2020
From: LIM, YOUNGKWON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 054509/0266 →
Continuity (3)
Provisional Application 63003425 · Apr 1, 2020
Provisional Application 62990252 · Mar 16, 2020
Related Publication 20210287405A1 · Sep 16, 2021