Robust merge of 3D textured meshes
A method of merging 3D meshes includes receiving a first mesh and a second mesh; performing spatial alignment to register the first mesh and the second mesh in a common world coordinate system; performing mesh clipping on the first mesh and the second mesh to remove redundant mesh vertices; performing geometry refinement around a clipping seam to close up mesh concatenation holes created by mesh clipping; and performing texture blending in regions adjacent the clipping seam to obtain a merged mesh.
1. A method of merging three-dimensional (3D) textured meshes, the method comprising:
receiving a first mesh and a second mesh;
performing spatial alignment to align the first mesh with respect to the second mesh;
performing mesh clipping on the first mesh and the second mesh to remove redundant mesh faces; and
performing geometry refinement around a clipping seam to close up mesh concatenation holes created by mesh clipping, wherein performing geometry refinement comprises:
growing back the first mesh and the second mesh along the clipping seam; and
translating one or more vertices of the first mesh towards one or more matching vertices of the second mesh, wherein a translation distance for each respective vertex of the one or more vertices is proportional to a weight that is inversely related to a distance between the respective vertex to the clipping seam.
2. The method of claim 1 , wherein growing back the first mesh and the second mesh comprises growing back one or more of the removed redundant mesh faces.
3. The method of claim 1 , wherein growing back the first mesh and the second mesh creates a merging band around the clipping seam.
4. The method of claim 1 , wherein performing geometry refinement further comprises bending corresponding overlapping regions of the first mesh and the second mesh to reduce an interspace in-between the first mesh and the second mesh.
5. The method of claim 1 , wherein translating the one or more vertices of the first mesh towards the one or more matching vertices of the second mesh comprises translating a position of a first vertex of the one or more vertices of the first mesh.
6. The method of claim 5 , wherein the translation is performed according to the following equation:
P v0 =P v0 +w ( P v1 −P v0 )
where P v0 is a position of the first vertex v0 of the one or more vertices of the first mesh, P v1 is a position of a second vertex v1 of the one or more matching vertices of the second mesh, and w is a weight.
7. The method of claim 6 , wherein the weight w is determined according to the following equation:
w
=
d
bmax
-
d
0
d
bmax
where d bmax is a largest geodesic distance to a mesh boundary within a merging area, and d 0 is a geodesic distance from the position of the first vertex (P v0 ) of the one or more vertices of the first mesh to the mesh boundary.
8. The method of claim 1 , further comprising performing texture blending in regions adjacent the clipping seam to obtain a merged mesh.
9. A system comprising:
one or more processors; and
a non-transitory computer readable medium storing a plurality of instructions that when executed control the one or more processors to merge three-dimensional (3D) textured meshes, the plurality of instructions comprising:
receiving a first mesh and a second mesh;
performing spatial alignment to align the first mesh with respect to the second mesh;
performing mesh clipping on the first mesh and the second mesh to remove redundant mesh faces; and
performing geometry refinement around a clipping seam to close up mesh concatenation holes created by mesh clipping, wherein performing geometry refinement comprises:
growing back the first mesh and the second mesh along the clipping seam; and
translating one or more vertices of the first mesh towards one or more matching vertices of the second mesh, wherein a translation distance for each respective vertex of the one or more vertices is proportional to a weight that is inversely related to a distance between the respective vertex to the clipping seam.
10. The system of claim 9 , wherein growing back the first mesh and the second mesh comprises growing back one or more of the removed redundant mesh faces.
11. The system of claim 9 , wherein growing back the first mesh and the second mesh creates a merging band around the clipping seam.
12. The system of claim 9 , wherein performing geometry refinement further comprises bending corresponding overlapping regions of the first mesh and the second mesh to reduce an interspace in-between the first mesh and the second mesh.
13. The system of claim 9 , wherein translating the one or more vertices of the first mesh towards the one or more matching vertices of the second mesh comprises translating a position of a first vertex of the one or more vertices of the first mesh.
14. The system of claim 13 , wherein the translation is performed according to the following equation:
P v0 =P v0 +w ( P v1 −P v0 )
where P v0 is a position of the first vertex v0 of the one or more vertices of the first mesh, P v1 is a position of a second vertex v1 of the one or more matching vertices of the second mesh, and w is a weight.
15. The system of claim 14 , wherein the weight w is determined according to the following equation:
w
=
d
bmax
-
d
0
d
bmax
where d bmax is a largest geodesic distance to a mesh boundary within a merging area, and d 0 is a geodesic distance from the position of the first vertex (P v0 ) of the one or more vertices of the first mesh to the mesh boundary.
16. The system of claim 9 , wherein the plurality of instructions further comprising performing texture blending in regions adjacent the clipping seam to obtain a merged mesh.