Mesh zippering
Ways to improve mesh reconstruction by modifying the position of vertices at the border of patches to make sure that neighboring patches do not have a gap between them, also known as zippering, are described herein. Six different methods to implement the post-processing operation, as well as syntax elements and semantics for transmission of the filter parameters, are disclosed. A hierarchical method indicate the geometry distortion that can generate gaps between patches. The value per frame, or per patch, or per boundary object is sent. The number of bits to encode the values is also dependent on the previous geometry distortion. A method sends index matches instead of geometry distortion. The matching index is sent per boundary vertex, but a method to send only one index of the pair is implemented as well.
1 . A method programmed in a non-transitory memory of a device comprising:
finding a plurality of border points;
selecting a zippering implementation from a plurality of mesh zippering implementations, wherein the plurality of mesh zippering implementations include a fixed value per sequence implementation which limits a scope of a search for a matching border point based on distance such that only points with a distance less than the fixed value are searched for the matching border point, wherein the distance of a point is compared with the fixed value and when the distance of the point is greater than the fixed value, the point is excluded from the search, wherein the plurality of mesh zippering implementations include a per boundary point implementation which receives distortion information from an encoder without performing the search; and
merging vertices based on the selected mesh zippering implementation.
2 . The method of claim 1 wherein the plurality of mesh zippering implementations include a matched patch/vertex index implementation which matches indices together.
3 . The method of claim 1 wherein selecting the zippering implementation from the plurality of mesh zippering implementations is adaptively selected based on a set of detected criteria.
4 . An apparatus comprising:
a non-transitory memory for storing an application, the application for:
finding a plurality of border points;
selecting a zippering implementation from a plurality of mesh zippering implementations, wherein the plurality of mesh zippering implementations include a fixed value per sequence implementation which limits a scope of a search for a matching border point based on distance such that only points with a distance less than the fixed value are searched for the matching border point, wherein the distance of a point is compared with the fixed value and when the distance of the point is greater than the fixed value, the point is excluded from the search, wherein the plurality of mesh zippering implementations include a per boundary point implementation which receives distortion information from an encoder without performing the search; and
merging vertices based on the selected mesh zippering implementation; and
a processor coupled to the memory, the processor configured for processing the application.
5 . The apparatus of claim 4 wherein the plurality of mesh zippering implementations include a matched patch/vertex index implementation which matches indices together.
6 . The apparatus of claim 4 wherein selecting the zippering implementation from the plurality of mesh zippering implementations is adaptively selected based on a set of detected criteria.
7 . A system comprising:
an encoder configured for encoding content; and
a decoder configured for:
finding a plurality of border points of the content;
selecting a zippering implementation from a plurality of mesh zippering implementations, wherein the plurality of mesh zippering implementations include a fixed value per sequence implementation which limits a scope of a search for a matching border point based on distance such that only points with a distance less than the fixed value are searched for the matching border point, wherein the distance of a point is compared with the fixed value and when the distance of the point is greater than the fixed value, the point is excluded from the search, wherein the plurality of mesh zippering implementations include a per boundary point implementation which receives distortion information from an encoder without performing the search; and
merging vertices based on the selected mesh zippering implementation.
8 . The system of claim 7 wherein the plurality of mesh zippering implementations include a matched patch/vertex index implementation includes matching which matches indices together.
9 . The system of claim 7 wherein selecting the zippering implementation from the plurality of mesh zippering implementations is adaptively selected based on a set of detected criteria.
10 . A method programmed in a non-transitory memory of a device comprising:
finding a plurality of border points;
selecting a zippering implementation from a plurality of mesh zippering implementations, wherein the plurality of mesh zippering implementations include a fixed value per sequence implementation which limits a scope of a search for a matching border point based on distance such that only points with a distance less than the fixed value are searched for the matching border point, wherein the distance of a point is compared with the fixed value and when the distance of the point is greater than the fixed value, the point is excluded from the search, wherein the plurality of mesh zippering implementations include a matched patch/vertex index implementation which matches indices together; and
merging vertices based on the selected mesh zippering implementation.
11 . The method of claim 10 wherein selecting the zippering implementation from the plurality of mesh zippering implementations is adaptively selected based on a set of detected criteria.
12 . An apparatus comprising:
a non-transitory memory for storing an application, the application for:
finding a plurality of border points;
selecting a zippering implementation from a plurality of mesh zippering implementations, wherein the plurality of mesh zippering implementations include a fixed value per sequence implementation which limits a scope of a search for a matching border point based on distance such that only points with a distance less than the fixed value are searched for the matching border point, wherein the distance of a point is compared with the fixed value and when the distance of the point is greater than the fixed value, the point is excluded from the search, wherein the plurality of mesh zippering implementations include a matched patch/vertex index implementation which matches indices together; and
merging vertices based on the selected mesh zippering implementation; and
a processor coupled to the memory, the processor configured for processing the application.
13 . The apparatus of claim 12 wherein selecting the zippering implementation from the plurality of mesh zippering implementations is adaptively selected based on a set of detected criteria.
14 . A system comprising:
an encoder configured for encoding content; and
a decoder configured for:
finding a plurality of border points of the content;
selecting a zippering implementation from a plurality of mesh zippering implementations, wherein the plurality of mesh zippering implementations include a fixed value per sequence implementation which limits a scope of a search for a matching border point based on distance such that only points with a distance less than the fixed value are searched for the matching border point, wherein the distance of a point is compared with the fixed value and when the distance of the point is greater than the fixed value, the point is excluded from the search, wherein the plurality of mesh zippering implementations include a matched patch/vertex index implementation includes matching which matches indices together; and
merging vertices based on the selected mesh zippering implementation.
15 . The system of claim 14 wherein selecting the zippering implementation from the plurality of mesh zippering implementations is adaptively selected based on a set of detected criteria.