V3C syntax extension for mesh compression
View Patent ↗In the current implementation of V-DMC, the (u, v) coordinates are generated using Microsoft UVAtlas and they, together with the 3D positions and the topology, are carried in the base mesh sub-bitstream. High level syntax structures described herein support projection-based atlas map generation, and the means to derive the (u, v) coordinates on the decoder side using V3C syntax structure extensions. In comparison with previous implementations and in order to preserve the current V3C geometry bitstream concept, a separate sub-bitstream referred to hereby as vertex property sub-bitstream is used to carry displacement information.
1 . A method programmed in a non-transitory memory of a device comprising:
implementing atlas mapping processing, wherein an atlas sequence parameter set extension enables dividing triangle faces into face groups, wherein the face groups include a first group where all triangles are associated with a current patch, a second group where identifiers are signaled in a base mesh, and a third group where the identifiers are signaled in a mesh patch data unit, wherein atlas mapping processing includes:
receiving patch identification information and mapping function parameters; and
deriving (u,v) coordinates based on the patch identification and mapping function parameters;
performing connectivity processing to divide triangles to generate vertex information;
performing vertex position processing to adjust positions of the vertices in the vertex information; and
implementing a displacement sub-bitstream to include displacement information, wherein the displacement information is utilized by the vertex position processing.
2 . The method of claim 1 further comprising reconstructing a mesh based on displaced vertices and connectivity information.
3 . The method of claim 1 further comprising utilizing one or more flags to bypass one or more V-DMC methods and to use a texture attribute map video as a V3C attribute component video.
4 . The method of claim 1 wherein implementing atlas mapping processing occurs before performing connectivity processing and vertex position processing.
5 . The method of claim 1 wherein implementing atlas mapping processing occurs after performing connectivity processing and vertex position processing.
6 . The method of claim 1 further comprising implementing surface processing to generate features on a surface.
7 . The method of claim 1 further comprising implementing surface processing to generate one or more bumps on a surface.
8 . An apparatus comprising:
a non-transitory memory for storing an application, the application for:
implementing atlas mapping processing, wherein an atlas sequence parameter set extension enables dividing triangle faces into face groups, wherein the face groups include a first group where all triangles are associated with a current patch, a second group where identifiers are signaled in a base mesh, and a third group where the identifiers are signaled in a mesh patch data unit, wherein atlas mapping processing includes:
receiving patch identification information and mapping function parameters; and
deriving (u,v) coordinates based on the patch identification and mapping function parameters;
performing connectivity processing to divide triangles to generate vertex information;
performing vertex position processing to adjust positions of the vertices in the vertex information; and
implementing a displacement sub-bitstream to include displacement information, wherein the displacement information is utilized by the vertex position processing; and
a processor coupled to the memory, the processor configured for processing the application.
9 . The apparatus of claim 8 wherein the application is further for reconstructing a mesh based on displaced vertices and connectivity information.
10 . The apparatus of claim 8 wherein the application is further for utilizing one or more flags to bypass one or more V-DMC methods and to use a texture attribute map video as a V3C attribute component video.
11 . The apparatus of claim 8 wherein implementing atlas mapping processing occurs before performing connectivity processing and vertex position processing.
12 . The apparatus of claim 8 wherein implementing atlas mapping processing occurs after performing connectivity processing and vertex position processing.
13 . A system comprising:
an encoder configured for encoding a 3D mesh to generate patch identification information and mapping function parameters; and
a decoder configured for:
implementing atlas mapping processing on the patch identification information and the mapping function parameters, wherein an atlas sequence parameter set extension enables dividing triangle faces into face groups, wherein the face groups include a first group where all triangles are associated with a current patch, a second group where identifiers are signaled in a base mesh, and a third group where the identifiers are signaled in a mesh patch data unit, wherein atlas mapping processing includes:
receiving patch identification information and mapping function parameters; and
deriving (u,v) coordinates based on the patch identification and mapping function parameters;
performing connectivity processing to divide triangles to generate vertex information;
performing vertex position processing to adjust positions of the vertices in the vertex information; and
implementing a displacement sub-bitstream to include displacement information, wherein the displacement information is utilized by the vertex position processing.
14 . The system of claim 13 wherein the decoder is further for reconstructing a mesh based on displaced vertices and connectivity information.
15 . The system of claim 13 wherein the decoder is further for utilizing one or more flags to bypass one or more V-DMC methods and to use a texture attribute map video as a V3C attribute component video.
16 . The system of claim 13 wherein implementing atlas mapping processing occurs before performing connectivity processing and vertex position processing.
17 . The system of claim 13 wherein implementing atlas mapping processing occurs after performing connectivity processing and vertex position processing.