System and methods for customizing 3D models
A computer-implemented method is disclosed. The method includes: receiving an indication of a first point on a three-dimensional (3D) model; determining a second point in a texture map of the 3D model that corresponds to the first point; performing segmentation of the texture map for identifying portions of the texture map that are related to the second point; and outputting a 3D representation of the identified related portions of the texture map.
1 . A computer-implemented method, comprising:
receiving input of a selection of a first point on a three-dimensional (3D) model;
determining a second point in a texture map of the 3D model that corresponds to the first point;
identifying portions of the texture map that belong to a same texture or object class as the second point based on performing segmentation of the texture map; and
outputting a 3D representation of the identified portions of the texture map, wherein the 3D representation of the identified related portions of the texture map comprises a 3D version of an image mask.
2 . The method of claim 1 , wherein receiving selection of the first point comprises receiving, via an input device, user input for selecting a point on a render of the 3D model.
3 . The method of claim 1 , wherein the texture map comprises a 2D image representing a projection of the 3D model's surfaces in texture space.
4 . The method of claim 1 , wherein the second point in the texture map is determined based on a mapping of 3D coordinates of the first point to texture space.
5 . The method of claim 1 , further comprising performing a pre-processing segmentation on a render of the 3D model for identifying a minimum cover portion of the 3D model corresponding to the selected first point, wherein the segmentation of the texture map is performed only on the minimum cover portion.
6 . The method of claim 1 , further comprising identifying portions of the texture map that belong to a same surface section as the selected first point in the 3D model.
7 . The method of claim 1 , further comprising receiving a selection of one or more pixel categories, wherein the segmentation of the texture map is performed for identifying portions of the texture map that belong to a same category as the second point for at least one of the selected pixel categories.
8 . A computing system, comprising:
a processor; and
a memory coupled to the processor, the memory storing computer-executable instructions that, when executed by the processor, are to cause the processor to:
receive input of a selection of a first point on a three-dimensional (3D) model;
determine a second point in a texture map of the 3D model that corresponds to the first point;
identify portions of the texture map that belong to a same texture or object class as the second point based on performing segmentation of the texture map; and
output a 3D representation of the identified portions of the texture map, wherein the 3D representation of the identified related portions of the texture map comprises a 3D version of an image mask.
9 . The computing system of claim 8 , wherein receiving selection of the first point comprises receiving, via an input device, user input for selecting a point on a render of the 3D model.
10 . The computing system of claim 8 , wherein the texture map comprises a 2D image representing a projection of the 3D model's surfaces in texture space.
11 . The computing system of claim 8 , wherein the second point in the texture map is determined based on a mapping of 3D coordinates of the first point to texture space.
12 . The computing system of claim 8 , wherein the instructions, when executed, are to further cause the processor to perform a pre-processing segmentation on a render of the 3D model for identifying a minimum cover portion of the 3D model corresponding to the selected first point, wherein the segmentation of the texture map is performed only on the minimum cover portion.
13 . The computing system of claim 8 , wherein the instructions, when executed, further configure the processor to identify portions of the texture map that belong to a same surface section as the selected first point in the 3D model.
14 . The computing system of claim 8 , wherein the instructions, when executed, further configure the processor to receive a selection of one or more pixel categories, wherein the segmentation of the texture map is performed for identifying portions of the texture map that belong to a same category as the second point for at least one of the selected pixel categories.
15 . A non-transitory, computer-readable storage medium storing computer-executable instructions that, when executed by one or more processors, are to cause the one or more processors to:
receive input of a selection of a first point on a three-dimensional (3D) model;
determine a second point in a texture map of the 3D model that corresponds to the first point;
identify portions of the texture map that belong to a same texture or object class as the second point based on performing segmentation of the texture map; and
output a 3D representation of the identified portions of the texture map, wherein the 3D representation of the identified related portions of the texture map comprises a 3D version of an image mask.
16 . The storage medium of claim 15 , wherein receiving selection of the first point comprises receiving, via an input device, user input for selecting a point on a render of the 3D model.
17 . The storage medium of claim 15 , wherein the texture map comprises a 2D image representing a projection of the 3D model's surfaces in texture space.
18 . The storage medium of claim 15 , wherein the second point in the texture map is determined based on a mapping of 3D coordinates of the first point to texture space.