IP Library › Granted Patent US 12,137,225
Granted Patent B2
US 12,137,225 · App. 17/863,049 · Granted Nov 5, 2024

Multi-atlas encapsulation of immersive media

Inventor: Qiuting Li (Guangdong, CN)
Assignee: ZTE Corporation
H04N19/136H04N19/132H04N19/423H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,137,225
App. No.
17/863,049
Granted
Nov 5, 2024
Kind
B2
Abstract

Methods, apparatus, and systems that provide flexible encapsulation of volumetric video data in media files are disclosed. In one example aspect, a method for video processing includes receiving three-dimensional (3D) volumetric video data and encoding the three-dimensional volumetric video data into a media file. The 3D volumetric video data corresponds to one or more atlases, each comprising atlas data and one or more two-dimensional (2D) components. The atlas data and the one or more 2D components are stored in one or more media tracks in the media file.

Claims (32)

1. A method for video processing, comprising:

receiving three-dimensional (3D) volumetric video data; and

encoding the 3D volumetric video data into a media file according to a file format,

wherein the 3D volumetric video data corresponds to atlases, each atlas comprising atlas data and one or more two-dimensional (2D) components, and wherein the file format specifies that the atlas data and the one or more 2D components of each atlas are stored in one or more media tracks in the media file, wherein the file format further specifies at least one 2D component of the one or more 2D components that corresponds to an atlas is stored in a component track of the one or more media tracks, and wherein a part of the atlas data that the at least one 2D component corresponds to and is not common to all of the atlases is stored in the component track.

2. The method of claim 1 , wherein the one or more 2D components for each atlas comprise at least a geometry component, an occupancy component, or an attribute component.

3. The method of claim 1 , wherein the atlas data comprises projection relationship of projecting the 3D volumetric video data from a 3D space to a 2D plane.

4. The method of claim 1 , wherein the one or more media tracks includes a volumetric visual track with a specific sample entry type, the volumetric visual track comprising parameter information common to all of the atlases.

5. The method of claim 1 , wherein the one or more media tracks are organized into multiple groups, each group corresponding to the atlases arranged according to a grouping criterion associated with the 3D volumetric video data.

6. A method for video processing, comprising:

decoding a media file that represents three-dimensional (3D) volumetric video data according to a file format,

wherein the 3D volumetric video data corresponds to atlases, each atlas comprising atlas data and one or more two-dimensional (2D) components, and wherein the file format specifies that the atlas data and the one or more 2D components of each atlas are stored in one or more media tracks in the media file, wherein the file format further specifies at least one 2D component of the one or more 2D components that corresponds to an atlas is stored in a component track of the one or more media tracks, and wherein a part of the atlas data that the at least one 2D component corresponds to and is not common to all of the atlases is stored in the component track; and

reconstructing the 3D volumetric video data based on at least one media track of the one or more media tracks.

7. The method of claim 6 , wherein the one or more 2D components for each atlas comprise at least a geometry component, an occupancy component, or an attribute component.

8. The method of claim 6 , wherein the atlas data comprises projection relationship of projecting the 3D volumetric video data from a 3D space to a 2D plane.

9. The method of claim 6 , wherein the one or more media tracks includes a volumetric visual track with a specific sample entry type, the volumetric visual track comprising parameter information common to all of the atlases.

10. The method of claim 6 , wherein the one or more media tracks are organized into multiple groups, each group corresponding to the atlases arranged according to a grouping criterion associated with the 3D volumetric video data.

11. A video processing apparatus comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

receive three-dimensional (3D) volumetric video data; and

encode the 3D volumetric video data into a media file according to a file format,

wherein the 3D volumetric video data corresponds to atlases, each atlas comprising atlas data and one or more two-dimensional (2D) components, and wherein the file format specifies that the atlas data and the one or more 2D components of each atlas are stored in one or more media tracks in the media file, wherein the file format further specifies at least one 2D component of the one or more 2D components that corresponds to an atlas is stored in a component track of the one or more media tracks, and wherein a part of the atlas data that the at least one 2D component corresponds to and is not common to all of the atlases is stored in the component track.

12. The apparatus of claim 11 , wherein the one or more 2D components for each atlas comprise at least a geometry component, an occupancy component, or an attribute component.

13. The apparatus of claim 11 , wherein the atlas data comprises projection relationship of projecting the 3D volumetric video data from a 3D space to a 2D plane.

14. The apparatus of claim 11 , wherein the one or more media tracks includes a volumetric visual track with a specific sample entry type, the volumetric visual track comprising parameter information common to all of the atlases.

15. The apparatus of claim 11 , wherein the one or more media tracks are organized into multiple groups, each group corresponding to the atlases arranged according to a grouping criterion associated with the 3D volumetric video data.

16. A video processing apparatus comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

decode a media file that represents three-dimensional (3D) volumetric video data according to a file format,

wherein the 3D volumetric video data corresponds to atlases, each atlas comprising atlas data and one or more two-dimensional (2D) components, and wherein the file format specifies that the atlas data and the one or more 2D components of each atlas are stored in one or more media tracks in the media file, wherein the file format further specifies at least one 2D component of the one or more 2D components that corresponds to an atlas is stored in a component track of the one or more media tracks, and wherein a part of the atlas data that the at least one 2D component corresponds to and is not common to all of the atlases is stored in the component track; and

reconstruct the 3D volumetric video data based on at least one media track of the one or more media tracks.

17. The apparatus of claim 16 , wherein the one or more 2D components for each atlas comprise at least a geometry component, an occupancy component, or an attribute component.

18. The apparatus of claim 16 , wherein the atlas data comprises projection relationship of projecting the 3D volumetric video data from a 3D space to a 2D plane.

19. The apparatus of claim 16 , wherein the one or more media tracks includes a volumetric visual track with a specific sample entry type, the volumetric visual track comprising parameter information common to all of the atlases.

20. The apparatus of claim 16 , wherein the one or more media tracks are organized into multiple groups, each group corresponding to the atlases arranged according to a grouping criterion associated with the 3D volumetric video data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 12, 2022
From: LI, QIUTING
To: ZTE CORPORATION
Reel/Frame 060487/0554 →
Continuity (2)
Continuation PCTCN2020132660 · Nov 30, 2020
Related Publication 20220345714A1 · Oct 27, 2022