IP Library Patent Application 18678465
Patent Application
App. No. 18/678,465

METHODS AND APPARATUS FOR ADAPTIVE STREAMING OF POINT CLOUDS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/678,465
Abstract

Methods, apparatus, and systems directed to adaptive streaming of V-PCC (Video-based Point Cloud Compression) data using an adaptive HTTP streaming protocol, such as MPEG DASH. A method includes signaling the point cloud data of the point cloud in a DASH MPD including: a main AdaptationSet for the point cloud, including at least (1) a @codecs attribute that is set to a unique value signifying that the corresponding AdaptationSet corresponds to V-PCC data and (2) an initialization segment containing at least one V-PCC sequence parameter set for a representation of the point cloud; and a plurality of component AdaptationSets, each corresponding to one of the V-PCC components and including at least (1) a VPCCComponent descriptor identifying a type of the corresponding V-PCC component and (2) at least one property of the V-PCC component; and transmitting the DASH bitstream over the network.

Claims (43)

1 . A decoding node comprising:

a processor configured to:

receive information associated with streaming point cloud (PC) data (PCD) corresponding to a PC in a Dynamic Adaptive Streaming of Hyper-Text Transfer Protocol (HTTP) (DASH) Media Presentation Description (MPD), wherein the DASH MPD indicates at least:

a main Adaptation Set (AS) for the PC, wherein the main AS includes information indicating at least: a value for a codec attribute signifying that the main AS corresponds to Video-based Point Cloud Compression (V-PCC) data, and an initialization segment comprising at least one V-PCC sequence parameter set for a representation of the PC, and

a plurality of component ASs, wherein each of the plurality of component ASs corresponds to one of a plurality of V-PCC components and includes information indicating at least:

a V-PCC Component descriptor identifying a type of the corresponding V-PCC component, wherein the type comprises geometry, occupancy, or attribute, and at least one property of the corresponding V-PCC component; and

receive the DASH MPD over the network.

2 . The decoding node of claim 1 , wherein the processor is further configured to parse the DASH MPD to generate a representation of the DASH MPD.

3 . The decoding node of claim 1 , wherein the processor is further configured to identify available point cloud media content based on one or more of the value for the codec attribute or the initialization segment.

4 . The decoding node of claim 1 , wherein the processor is further configured to determine a number of unique point clouds based on the V-PCC component descriptor.

5 . The decoding node of claim 1 , wherein the processor is further configured to stream the PC by downloading the initialization segment for the main AS.

6 . The decoding node of claim 5 , wherein the processor is further configured to:

receive time-aligned segments from the main AS and the plurality of component ASs over HTTP; and

store the time-aligned segments in a memory buffer.

7 . The decoding node of claim 6 , wherein the processor is further configured to concatenate the time-aligned segments with respective initialization segments.

8 . The decoding node of claim 7 , wherein the processor is further configured to generate a V-PCC bitstream using the time-aligned segments.

9 . The decoding node of claim 8 , wherein the processor is further configured to decode the V-PCC bitstream.

10 . The decoding node of claim 1 , wherein, an International Organization for Standardization (ISO) Base Media File Format (ISOBMFF) is used as a media container for V-PCC content, and wherein, the initialization segment of the main AS includes a MetaBox containing one or more V-PCC GroupBox instances providing metadata information associated with V-PCC tracks.

11 . The decoding node of claim 1 , wherein the initialization segment of the main AS includes information indicating a single initialization segment at an adaptation level, and V-PCC sequence parameter sets for a plurality of representations of the main AS.

12 . The decoding node of claim 1 , wherein the main AS includes information indicating an initialization segment for each of multiple representations of the PC, and wherein each initialization segment that corresponds to a representation of the PC includes a V-PCC sequence parameter set for that representation.

13 . The decoding node of claim 1 , wherein the V-PCC Component descriptor includes information indicating a video codec attribute for a codec used for encoding a corresponding PC component.

14 . The decoding node of claim 1 , wherein the AS includes information indicating a role descriptor DASH element having a value indicating one of geometry, occupancy map, or attribute of a corresponding V-PCC component.

15 . The decoding node of claim 1 , wherein the decoding node is a DASH streaming client.

16 . A method for a decoding node streaming point cloud (PC) data (PCD) corresponding to a PC via a network using Hyper-Text Transfer Protocol (HTTP) and including a plurality of Video-based PC Compression (V-PCC) components comprising a PC, the method comprising:

receiving information associated with streaming point cloud (PC) data (PCD) corresponding to a PC in a Dynamic Adaptive Streaming of Hyper-Text Transfer Protocol (HTTP) (DASH) Media Presentation Description (MPD), wherein the DASH MPD indicates at least:

a main Adaptation Set (AS) for the PC, wherein the main AS includes information indicating at least: a value for a codec attribute signifying that the main AS corresponds to Video-based Point Cloud Compression (V-PCC) data, and an initialization segment comprising at least one V-PCC sequence parameter set for a representation of the PC, and

a plurality of component ASs, wherein each of the plurality of component ASs corresponds to one of a plurality of V-PCC components and includes information indicating at least: a V-PCC Component descriptor identifying a type of the corresponding V-PCC component, wherein the type comprises geometry, occupancy, or attribute, and at least one property of the corresponding V-PCC component; and

receiving the DASH MPD over the network.

17 . The method of claim 16 , further comprising parsing the DASH MPD to generate a representation of the DASH MPD.

18 . The method of claim 16 , further comprising identifying available point cloud media content based on one or more of the value for the codec attribute or the initialization segment.

19 . The method of claim 16 , further comprising determining a number of unique point clouds based on the V-PCC component descriptor.

20 . The method of claim 16 , further comprising streaming the PC by downloading the initialization segment for the main AS.

21 . The method of claim 20 , further comprising:

receiving time-aligned segments from the main AS and the plurality of component ASs over HTTP; and

storing the time-aligned segments in a memory buffer.

22 . The method of claim 21 , further comprising concatenating the time-aligned segments with respective initialization segments.

23 . The method of claim 22 , further comprising generating a V-PCC bitstream using the time-aligned segments.

24 . The method of claim 23 , further comprising decoding the V-PCC bitstream.

25 . The method of claim 16 , wherein, an International Organization for Standardization (ISO) Base Media File Format (ISOBMFF) is used as a media container for V-PCC content, and wherein, the initialization segment of the main AS includes a MetaBox containing one or more V-PCC GroupBox instances providing metadata information associated with V-PCC tracks.

26 . The method of claim 16 , wherein the initialization segment of the main AS includes information indicating a single initialization segment at an adaptation level, and V-PCC sequence parameter sets for a plurality of representations of the main AS.

27 . The method of claim 16 , wherein the main AS includes information indicating an initialization segment for each of multiple representations of the PC, and wherein each initialization segment that corresponds to a representation of the PC includes a V-PCC sequence parameter set for that representation.

28 . The method of claim 16 , wherein the V-PCC Component descriptor includes information indicating a video codec attribute for a codec used for encoding a corresponding PC component.

29 . The method of claim 15 , wherein the AS includes information indicating a role descriptor DASH element having a value indicating one of geometry, occupancy map, or attribute of a corresponding V-PCC component.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2024
From: VID SCALE, INC.
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 068284/0031 →