Granted Patent B2

US 12,368,896 · App. 17/926,558 · Granted Jul 22, 2025

Inventors: Jill Boyce (Portland, OR); Basel Salahieh (Santa Clara, CA)

Assignee: Intel Corporation

H04N19/70H04N19/172H04N19/597

Abstract

Claims (52)

1. A volumetric video encoding system comprising:

interface circuitry;

machine readable instructions; and

at least one processor circuit to be programmed based on the machine readable instructions to:

form a packed video frame that includes video components placed into different regions of the packed video frame based on a packed video frame layout, the packed video frame to be a single packed video frame including a first region associated with a first atlas and a second region associated with a second atlas, the second region different from the first region, the second atlas different from the first atlas;

generate packed video frame information identifying characteristics of the packed video frame, the packed video frame information including a first identifier to identify the first atlas associated with the first region of the packed video frame and a second identifier to identify the second atlas associated with the second region of the packed video frame; and

encode the packed video frame in an encoded bitstream, the encoded bitstream to include the packed video frame information, the packed video frame information to signal the inclusion of the packed video frame in the encoded bitstream.

2. The volumetric video encoding system of claim 1 , wherein the video components include at least one of auxiliary data, attribute data, geometry data, or occupancy data.

3. The volumetric video encoding system of claim 1 , wherein the regions of the packed video frame are non-overlapping, and the packed video frame information further includes information identifying respective types of video components associated with respective ones of the regions.

4. The volumetric video encoding system of claim 1 , wherein the video components in the packed video frame have a same bit depth.

5. The volumetric video encoding system of claim 1 , wherein one or more of the at least one processor circuit is to verify that a constraint on a number of decoders to be used to decode the encoded bitstream is not violated.

6. The volumetric video encoding system of claim 1 , wherein one or more of the at least one processor circuit is to:

identify (i) regions of the packed video frame that can be decoded independently and (ii) corresponding region identifiers;

generate a message including the region identifiers and indicating that the regions corresponding to the region identifiers can be decoded independently; and

multiplex the message with the encoded bitstream for transmission to a decoder.

7. One or more non-transitory computer readable media comprising instructions to cause at least one processor circuit to at least:

form a packed video frame that includes video component data placed into different regions of the packed video frame based on a packed video frame layout, the video component data including attribute data, geometry data and occupancy data, the packed video frame to be a single packed video frame having a first region including at least a portion of the attribute data of a first atlas, a second region including at least a portion of the geometry data of the first atlas, and a third region including at least a portion of the occupancy data of the first atlas;

generate packed video frame information identifying characteristics of the packed video frame; and

encode the packed video frame in an encoded bitstream, the encoded bitstream to include the packed video frame information, the packed video frame information to signal the inclusion of the packed video frame in the encoded bitstream.

8. The one or more non-transitory computer readable media of claim 7 , wherein the video component data incudes auxiliary data.

9. The one or more non-transitory computer readable media of claim 7 , wherein the regions of the packed video frame are non-overlapping, and the packed video frame information further includes information identifying respective video component data types associated with respective ones of the regions.

10. The one or more non-transitory computer readable media of claim 7 , wherein the video component data placed into the packed video frame has a same bit depth.

11. The one or more non-transitory computer readable media of claim 7 , wherein the instructions are to cause one or more of the at least one processor circuit to verify that a constraint on a number of decoders to be used to decode the encoded bitstream is not violated.

12. The one or more non-transitory computer readable media of claim 7 , wherein the instructions are to cause one or more of the at least one processor circuit to:

identify (i) regions of the packed video frame that can be decoded independently and (ii) corresponding region identifiers;

generate a message including the region identifiers and indicating that the regions corresponding to the region identifiers can be decoded independently; and

multiplex the message with the encoded bitstream for transmission to a decoder.

13. The one or more non-transitory computer readable media of claim 7 , wherein the instructions are to cause one or more of the at least one processor circuit to:

identify regions of the packed video frame that can be decoded independently;

generate a message identifying the regions of the packed video frame to be decoded independently; and

multiplex the message with the encoded bitstream for transmission to a decoder.

14. A volumetric video decoding system comprising:

interface circuitry;

machine readable instructions; and

at least one processor circuit to be programmed based on the machine readable instructions to:

extract packed video frame information from a bitstream including a packed video frame, the packed video frame information to include information to identify regions of the packed video frame;

decode the regions of the packed video frame based on the packed video frame information, the regions of the packed video frame including a first region, a second region and a third region, the first region of the packed video frame including attribute data of a first atlas, the second region of the packed video frame including geometry data of the first atlas, and the third region of the packed video frame including occupancy data of the first atlas; and

map, based on the packed video frame information, the regions of the packed video frame to at least a portion of a volumetric video sequence to be rendered.

15. The volumetric video decoding system of claim 14 , wherein respective ones of the regions include respective video component data types, the video component data types to include an attribute data type, a geometry data type, and an occupancy data type.

16. The volumetric video decoding system of claim 14 , wherein the regions of the packed video frame are non-overlapping, and the packed video frame information includes information identifying respective video component data types associated with respective ones of the regions, and at least one of an atlas identifier or an atlas tile identifier.

17. The volumetric video decoding system of claim 14 , wherein one or more of the at least one processor circuit is to extract a message from the bitstream, the message to include supplemental enhancement information having region identifiers, ones of the regions corresponding to the region identifiers to be coded independently.

18. The volumetric video decoding system of claim 17 , wherein one or more of the at least one processor circuit is to determine a size and a location of a first one of the regions to be coded independently based on a tile index included in the packed video frame information.

19. The volumetric video decoding system of claim 17 , wherein one or more of the at least one processor circuit is to determine a size and a location of a first one of the regions to be coded independently based on a sub-picture identifier included in the packed video frame information.

20. A volumetric video decoding method comprising:

extracting, by at least one processor circuit programmed based on at least one instruction, packed video frame information from a bitstream including a packed video frame, the packed video frame information including information to identify regions of the packed video frame;

decoding the regions of the packed video frame based on the packed video frame information, the regions of the packed video frame including a first region and a second region, the first region of the packed video frame associated with a first atlas, the second region of the packed video frame associated with a second atlas, the second atlas different from the first atlas; and

mapping, based on the packed video frame information, the regions of the packed video frame to at least a portion of a volumetric video sequence to be rendered.

21. The volumetric video decoding method of claim 20 , wherein respective ones of the regions include respective video component data types, the video component data types to include at least one of an auxiliary data type, an attribute data type, a geometry data type, or an occupancy data type.

22. The volumetric video decoding method of claim 20 , wherein the regions of the packed video frame are non-overlapping, and the packed video frame information includes information identifying respective video component data types associated with respective ones of the regions, and at least one of an atlas identifier or an atlas tile identifier.

23. The volumetric video decoding method system of claim 20 , including extracting a message from the bitstream, the message including supplemental enhancement information having region identifiers, ones of the regions corresponding to the region identifiers to be coded independently.

24. The volumetric video decoding method of claim 20 , including determining a size and a location of a first one of the regions to be coded independently based on a tile index included in the packed video frame information.

25. The volumetric video decoding method of claim 20 , including determining a size and a location of a first one of the regions to be coded independently based on a sub-picture identifier included in the packed video frame information.

Assignments (1)

Continuity (2)

References Cited (23)