Partial access metadata for video-based point cloud compression data
A decoding device, method, and computer readable medium for partial access metadata for video-based point cloud compression data are disclosed. The decoding device for point cloud decoding includes a communication interface and a processor operably coupled to the communication interface. The communication interface receives a compressed bitstream and metadata related to the compressed bitstream. The processor identifies, in the metadata, region information that indicates a region of a point cloud based on a user perspective; locates a track of the compressed bitstream that corresponds to the region information; identifies, in the track, objects corresponding to the region of the point cloud; and decodes for display of an object, included in the objects identified in the track, that is visible from the user perspective.
1. A decoding device for generating partial access metadata for video-based point cloud compression, the decoding device comprising:
a communication interface configured to receive a compressed bitstream and metadata related to the compressed bitstream;
a processor operably coupled to the communication interface, wherein the processor is configured to:
identify, in the metadata, region information that indicates a region of a point cloud based on a user perspective;
determine whether an object corresponding to the region of the point cloud is visible from the user perspective based on a supplemental enhancement information (SEI) message included in the compressed bitstream;
in response to a determination that the object is visible from the user perspective:
locate a track of the compressed bitstream that corresponds to the region information;
identify, in the track, the object; and
decode the compressed bitstream to display the object from the user perspective.
2. The decoding device of claim 1 , wherein the user perspective includes information that indicates a user's location and viewing direction.
3. The decoding device of claim 1 , wherein the object is defined in the SEI message based on a length of an object identifier and a value of object identifiers.
4. The decoding device of claim 3 , wherein to determine whether the object is visible from the user perspective based on the SEI message, the processor is configured to determine whether the object is visible from the user perspective based on the value of the object identifier.
5. The decoding device of claim 1 , wherein the processor is further configured to:
identify, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;
identify a new object in the updated track that is visible from the user perspective; and
decode the compressed bitstream to display the new object from the user perspective.
6. The decoding device of claim 1 , wherein the processor is further configured to:
identify, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;
identify, in the track, a deleted object corresponding an object currently displayed; and
remove the deleted object from display.
7. The decoding device of claim 6 , wherein the deleted object is defined in the SEI message based on a length of an object identifier and a value of the object identifier.
8. A method for point cloud decoding, the method comprising:
receiving, using a communication interface, a compressed bitstream and metadata related to the compressed bitstream;
identifying, using a processor operably coupled to the communication interface, region information in the metadata that indicates a region of a point cloud based on a user perspective;
determine whether an object corresponding to the region of the point cloud is visible from the user perspective based on a supplemental enhancement information (SEI) message included in the compressed bitstream;
in response to a determination that the object is visible from the user perspective:
locating a track of the compressed bitstream that corresponds to the region information;
identifying, in the track, the object; and
decoding the compressed bitstream to display the object from the user perspective.
9. The method of claim 8 , wherein the user perspective includes information that indicates a user's location and viewing direction.
10. The method of claim 8 , wherein the object is defined in the SEI message based on a length of an object identifier and a value of object identifiers.
11. The method of claim 10 , wherein determining whether the object is visible from the user perspective based on the SEI message comprises determining whether the object is visible from the user perspective based on the value of the object identifier.
12. The method of claim 8 , further comprising:
identifying, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;
identifying a new object in the updated track that is visible from the user perspective; and
decoding the compressed bitstream to display the new object from the user perspective.
13. The method of claim 8 , further comprising:
identifying, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;
identifying, in the track, a deleted object corresponding an object currently displayed; and
removing the deleted object from display.
14. The method of claim 13 , wherein the deleted object is defined in the SEI message based on a length of an object identifier and a value of the object identifier.
15. A non-transitory computer readable medium embodying a computer program, the computer program comprising computer readable program code that, when executed by a processor of an electronic device, causes the electronic device to:
receive a compressed bitstream and metadata related to the compressed bitstream;
identify, in the metadata, region information that indicates a region of a point cloud based on a user perspective;
determine whether an object corresponding to the region of the point cloud is visible from the user perspective based on a supplemental enhancement information (SEI) message included in the compressed bitstream;
in response to a determination that the object is visible from the user perspective:
locate a track of the compressed bitstream that corresponds to the region information;
identify, in the track, the object; and
decode the compressed bitstream to display the object from the user perspective.
16. The non-transitory computer readable medium of claim 15 , wherein the user perspective includes information that indicates a user's location and viewing direction.
17. The non-transitory computer readable medium of claim 15 , wherein the object is defined in the SEI message based on a length of an object identifier and a value of object identifiers.
18. The non-transitory computer readable medium of claim 17 , wherein the computer readable program code that when executed when executed by the processor of the electronic device, causes the electronic device to determine whether the object is visible from the user perspective based on the SEI message comprises computer readable program code that when executed when executed by the processor of the electronic device, causes the electronic device to determine whether the object is visible from the user perspective based on the value of the object identifier.
19. The non-transitory computer readable medium of claim 15 , wherein the computer readable program code, when executed by the processor of the electronic device, further causes the electronic device to:
identify, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;
identify a new object in the updated track that is visible from the user perspective; and
decode the compressed bitstream to display the new object from the user perspective.
20. The non-transitory computer readable medium of claim 15 , wherein the computer readable program code, when executed by the processor of the electronic device, further causes the electronic device to:
identify, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;
identify, in the track, a deleted object corresponding an object currently displayed; and
remove the deleted object from display.