Method and apparatus for 3D mesh de-noising
View Patent ↗Disclosed are a method and apparatus for processing a 3D model. To preserve fine structures while de-noising a 3D mesh model, the local structural information around a vertex is captured when designing a de-noising filter. In particular, for a current vertex to be processed, a path, for example, a geodesic path, is determined between the current vertex and each neighboring vertex. For each mesh edge along the path, local variations are calculated for the two end vertices of the mesh edge using a covariance matrix, and a geometric variation for the mesh edge is calculated as the difference between the two local variations. Then structural information for the region between the current vertex and a neighboring vertex is calculated as a function of the geometric variations for mesh edges along the path, for example, as the maximum geometric variation along the path. The present principles can also be adjusted to be used in de-noising 3D point-based models.
1. A computer implemented method for de-noising a 3D model, comprising:
accessing a two dimensional image content by a processor configured to process image content information using structural information;
determining a shortest geodesic path based on said two dimensional image, wherein said shortest geodesic path has multiple mesh edges by said processor to identify a set of mesh edges amongst said multiple mesh edges connecting a first vertex of the 3D model and a second vertex of the 3D model wherein the set of mesh edges is determined responsive to at least one of a distance between the first vertex and the second vertex, curvature variation, and local variation;
constructing a proximity graph for the first vertex, wherein estimated mesh edges of the proximity graph are used to determine the set of mesh edges;
determining a respective geometric variation for each one of a plurality of edges, the plurality of edges belonging to the set of mesh edges;
determining structural information relating to the 3D model in a neighborhood around the first vertex of the 3D model responsive to the respective geometric variations by calculating geometric variations along the shortest geodesic path established based on spatial relationship between the first and the second vertex; and
processing the first vertex in response to the structural information relating to the 3D model.
2. The method of claim 1 , wherein the structural information is determined to be one of a maximum of the respective geometric variations, a mean value of the respective geometric variations, and a root mean square value of the respective geometric variations.
3. The method of claim 2 , wherein the respective geometric variation is determined in response to eigenvalues of a covariance matrix.
4. The method of claim 1 , further comprising:
determining a weight in response to the structural information, wherein the processing step is responsive to the weight.
5. The method of claim 1 , wherein a bilateral filter or a Laplacian filter is used for the processing step.
6. The method of claim 1 , wherein at least one of a position and a normal of the first vertex is processed in the processing step.
7. An apparatus for de-noising a 3D model, comprising:
a filter having a processor configured to access a two dimensional image content using structural information;
determine a shortest geodesic path based on said two dimensional image, wherein said shortest geodesic path has multiple mesh edges by said processor to identify a set of mesh edges amongst said multiple mesh edges connecting a first vertex of the 3D model and a second vertex of the 3D model wherein the set of mesh edges is determined responsive to at least one of a distance between the first vertex and the second vertex, curvature variation, and local variation;
construct a proximity graph for the first vertex, wherein estimated mesh edges of the proximity graph are used to determine the set of mesh edges;
determine a respective geometric variation for each one of a plurality of edges, the plurality of edges belonging to the set of mesh edges;
determine structural information relating to the 3D model in a neighborhood around a the first vertex of the 3D model responsive to the respective geometric variations by calculating geometric variations along the shortest a geodesic path established based on spatial relationship between the first and the second vertex; and
process the first vertex in response to the structural information relating to the 3D model.
8. The apparatus of claim 7 , wherein the structural information is determined to be one of a maximum of the respective geometric variations, a mean value of the respective geometric variations, and a root mean square value of the respective geometric variations.
9. The apparatus of claim 8 , wherein the respective geometric variation is determined in response to eigenvalues of a covariance matrix.
10. The apparatus of claim 7 , wherein the filter is further configured to determine a weight in response to the structural information, wherein the first vertex is processed responsive to the weight.
11. The apparatus of claim 7 , wherein a bilateral filter or a Laplacian filter is used for processing the first vertex.
12. The apparatus of claim 7 , wherein at least one of a position and a normal of the first vertex is processed.