Patch mesh connectivity coding
The connectivity information and mapping information of a mesh surface patch are able to be encoded after projection to 2D. Regarding the connectivity information, the projection operation does not change the connection between vertices, so the same list of connected vertices are able to be carried in the atlas data. Similarly, the mapping information does not change after projection and is able to be carried in the atlas data. Two methods are disclosed for encoding the connectivity and mapping information. For the connectivity information, a video-based method uses neighboring color coding. For mapping coordinates, a method uses the projected vertex position. The connectivity and mapping are also able to be processed by an external mesh encoder. Newly proposed mapping information is able to be taken advantage of to perform temporal compression.
1 . A method of encoding connectivity information and mapping information comprising:
encoding vertex mapping information including delta information for geometry correction; and
encoding patch connectivity information, including implementing mesh simplification by fixing positions of vertices in time, wherein implementing mesh simplification includes sending only boundary vertices and not sending inner vertices, wherein the inner vertices are determined based on a previous set of inner vertices from a previous frame.
2 . The method of claim 1 further comprising sending a flag indicating whether the vertex mapping information is implicitly or explicitly sent.
3 . The method of claim 1 wherein encoding the vertex information and encoding the patch connectivity information are performed by an external encoder.
4 . The method of claim 1 wherein encoding the patch connectivity information comprises using color coding in an occupancy map.
5 . The method of claim 4 wherein using color coding in the occupancy map is limited to a maximum of 4 colors.
6 . The method of claim 1 wherein encoding vertex mapping information further comprises using rate distortion face transmission.
7 . An apparatus comprising:
a non-transitory memory for storing an application, the application for:
encoding vertex mapping information including delta information for geometry correction; and
encoding patch connectivity information, including implementing mesh simplification by fixing positions of vertices in time, wherein implementing mesh simplification includes sending only boundary vertices and not sending inner vertices, wherein the inner vertices are determined based on a previous set of inner vertices from a previous frame; and
a processor coupled to the memory, the processor configured for processing the application.
8 . The apparatus of claim 7 wherein the application is further configured for sending a flag indicating whether the vertex mapping information is implicitly or explicitly sent.
9 . The apparatus of claim 7 wherein encoding the vertex information and encoding the patch connectivity information are performed by an external encoder.
10 . The apparatus of claim 7 wherein encoding the patch connectivity information comprises using color coding in an occupancy map.
11 . The apparatus of claim 10 wherein using color coding in the occupancy map is limited to a maximum of 4 colors.
12 . The apparatus of claim 7 wherein encoding vertex mapping information further comprises using rate distortion face transmission.
13 . A system comprising:
one or more cameras for acquiring three dimensional content;
an encoder for encoding the three dimensional content:
encoding vertex mapping information including delta information for geometry correction; and
encoding patch connectivity information, including implementing mesh simplification by fixing positions of vertices in time, wherein implementing mesh simplification includes sending only boundary vertices and not sending inner vertices; and
a decoder for decoding the encoded three dimensional content including:
using the delta information for adjusting a mesh;
determining inner vertices of the patch connectivity information from previous inner vertices from a previous frame.
14 . The system of claim 13 wherein the encoder is further configured for sending a flag indicating whether the vertex mapping information is implicitly or explicitly sent.
15 . The system of claim 13 wherein encoding the vertex information and encoding the patch connectivity information are performed by an external encoder.
16 . The system of claim 13 wherein encoding the patch connectivity information comprises using color coding in an occupancy map.
17 . The system of claim 16 wherein using color coding in the occupancy map is limited to a maximum of 4 colors.
18 . The system of claim 13 wherein encoding vertex mapping information further comprises using rate distortion face transmission.