V3C syntax extension for mesh compression using sub-patches
View Patent ↗With the concept of sub-patches, the single geometry is described at the patch level, while the multiple attributes are then described at the sub-patch level. One application of the concept is the derivation of texture coordinates using projections for several sections of a mesh surface (affecting the attributes only), whereby the geometry of the whole mesh section uses just one single syntax element.
1 . A method programmed in a non-transitory memory of a device comprising:
separating a mesh into a plurality of sub-meshes, wherein the plurality of sub-meshes correspond with a single set of geometry information and a plurality of sets of attribute information, wherein the single set of geometry information is shared by the plurality of sub-meshes;
signaling a number of sub-patches associated with the plurality of sets of attribute information;
transmitting the single set of geometry information and the plurality of sets of attribute information;
receiving the single set of geometry information and the plurality of sets of attribute information; and
decoding the mesh based on the single set of geometry information and the plurality of sets of attribute information, including derivation of texture coordinates using projections for a plurality of sections of a mesh surface affecting only the plurality of sets of attribute information, wherein geometry of the mesh uses a single syntax element.
2 . The method of claim 1 further comprising encoding the mesh.
3 . The method of claim 1 further comprising decoding the mesh based on orthographic projections to establish (u, v) coordinates.
4 . The method of claim 3 further comprising reconstructing a 3D mesh based on the (u, v) coordinates.
5 . The method of claim 1 wherein the plurality of sets of attribute information include projection-based information.
6 . The method of claim 1 wherein the plurality of sets of attribute information include color or texture coordinates.
7 . An apparatus comprising:
a non-transitory memory for storing an application, the application for:
separating a mesh into a plurality of sub-meshes, wherein the plurality of sub-meshes correspond with a single set of geometry information and a plurality of sets of attribute information, wherein the single set of geometry information is shared by the plurality of sub-meshes;
signaling a number of sub-patches associated with the plurality of sets of attribute information;
transmitting the single set of geometry information and the plurality of sets of attribute information;
receiving the single set of geometry information and the plurality of sets of attribute information; and
decoding the mesh based on the single set of geometry information and the plurality of sets of attribute information, including derivation of texture coordinates using projections for a plurality of sections of a mesh surface affecting only the plurality of sets of attribute information, wherein geometry of the mesh uses a single syntax element; and
a processor coupled to the memory, the processor configured for processing the application.
8 . The apparatus of claim 7 wherein the application is further configured for encoding the mesh.
9 . The apparatus of claim 7 wherein the application is further configured for decoding the mesh based on orthographic projections to establish (u, v) coordinates.
10 . The apparatus of claim 9 wherein the application is further configured for reconstructing a 3D mesh based on the (u, v) coordinates.
11 . The apparatus of claim 7 wherein the plurality of sets of attribute information include projection-based information.
12 . The apparatus of claim 7 wherein the plurality of sets of attribute information include color or texture coordinates.
13 . A system comprising:
an encoder configured for:
separating a mesh into a plurality of sub-meshes, wherein the plurality of sub-meshes correspond with a single set of geometry information and a plurality of sets of attribute information, wherein the single set of geometry information is shared by the plurality of sub-meshes;
signaling a number of sub-patches associated with the plurality of sets of attribute information; and
transmitting the single set of geometry information described at a mesh-level and the plurality of sets of attribute information described at a sub-mesh-level; and
a decoder configured for:
receiving the single set of geometry information and the plurality of sets of attribute information; and
decoding the mesh based on the single set of geometry information and the plurality of sets of attribute information, including derivation of texture coordinates using projections for a plurality of sections of a mesh surface affecting only the plurality of sets of attribute information, wherein geometry of the mesh uses a single syntax element.
14 . The system of claim 13 wherein the encoder is further configured for encoding the mesh.
15 . The system of claim 13 wherein the decoder is further configured for decoding the mesh based on orthographic projections to establish (u, v) coordinates.
16 . The system of claim 15 wherein the decoder is further configured for reconstructing a 3D mesh based on the (u, v) coordinates.
17 . The system of claim 13 wherein the plurality of sets of attribute information include projection-based information.
18 . The system of claim 13 wherein the plurality of sets of attribute information include color or texture coordinates.