System and method for rendering complex data in a virtual reality or augmented reality environment
View Patent ↗Methods for virtual reality and augmented reality rendering of a 3D object are provided. The methods can include segmenting the 3D object such that portions of the 3D object can be identifiable and distinguishable. The methods can include creating masks, identifying relationships between the masks and marking the masks accordingly.
1. A method for creating a three-dimensional (3D) virtual reality or augmented reality rendering of an object from a 3D object, the method comprising:
receiving a plurality of masks each mask assigned a plurality of voxels, the plurality of masks including an outer mask and a plurality of other masks, and each mask including a unique visual marker and representing a unique portion of the 3D object;
creating a 3D mesh from the outer mask;
for each vertex in an inner wall of the 3D mesh of the outer mask:
a) determining a geodesic distance for each voxel in each mask, except for the outer mask, to a respective current voxel, and
b) modifying the respective visual marker of the current vertex to have the same visual marker as the voxel with the shortest geodesic distance to the vertex; and
creating the 3D virtual reality or augmented reality rendering of the object based on the outer mask and the respective unique visual marker of all of the masks.
2. The method of claim 1 wherein the set of masks is based on: determining an object type based on the 3D object;
creating a set of masks based on the object type;
assigning each mask in the set of masks i) a plurality of voxels from the 3D object that corresponds to the respective mask's unique portion and ii) the unique visual marker; and
determining an outer mask of the set of masks.
3. The method of claim 1 further comprising for each voxel in the plurality of voxels that is not assigned to a mask:
a) determining one mask from the set of masks having a voxel that is within a nearest distance to the current voxel, and
b) assigning a visual marker to the current voxel that is the same as the unique visual marker of the one mask.
4. The method of claim 1 further comprising modifying the outer mask by applying a box filter that has a predetermined threshold.
5. The method of claim 1 wherein determining the outer mask is based on user input, the object type, or any combination thereof.
6. The method of claim 1 wherein the unique visual marker is a color marker, a pattern, or any combination thereof.
7. The method of claim 1 further comprising displaying by a virtual reality or augmented reality device or an augmented reality device the 3D virtual reality or augmented reality rendering.
8. A non-transient computer readable medium containing program instructions for causing a computer to perform the method of:
receiving a plurality of masks each mask assigned a plurality of voxels, the plurality of masks including an outer mask and a plurality of other masks, and each mask including a unique visual marker and representing a unique portion of the 3D object;
creating a 3D mesh from the outer mask;
for each vertex in an inner wall of the 3D mesh of the outer mask:
c) determining a geodesic distance for each voxel in each mask, except for the outer mask, to a respective current voxel, and
d) modifying the respective visual marker of the current vertex to have the same visual marker as the voxel with the shortest geodesic distance to the vertex; and
creating the 3D virtual reality or augmented reality rendering of the object based on the outer mask and the respective unique visual marker of all of the masks.
9. The non-transient computer readable medium of claim 8 wherein the set of masks is based on:
determining an object type based on the 3D object;
creating a set of masks based on the object type;
assigning each mask in the set of masks i) a plurality of voxels from the 3D object that corresponds to the respective mask's unique portion and ii) the unique visual marker; and
determining an outer mask of the set of masks.
10. The non-transient computer readable medium of claim 8 wherein for each voxel in the plurality of voxels that is not assigned to a mask:
c) determining one mask from the set of masks having a voxel that is within a nearest distance to the current voxel, and
d) assigning a visual marker to the current voxel that is the same as the unique visual marker of the one mask.
11. The non-transient computer readable medium of claim 8 further comprising modifying the outer mask by applying a box filter that has a predetermined threshold.
12. The non-transient computer readable medium of claim 8 wherein determining the outer mask is based on user input, the object type, or any combination thereof.
13. The non-transient, computer readable medium of claim 8 wherein the unique visual marker is a color marker, a pattern, or any combination thereof.
14. The non-transient computer readable medium of claim 8 further comprising displaying by a virtual reality or augmented reality device or an augmented reality device the 3D virtual reality or augmented reality rendering.