Machine learning dental segmentation methods using sparse voxel representations
Methods for automatically segmenting a 3D model of a patient's teeth may include scanning a patient's dentition and converting the scan data into a 3D model, including a sparse voxel representation of the 3D model. Features can be extracted from the sparse voxel representation of the 3D model and input into a machine learning model to train the machine learning model to segment the 3D model into individual dental components.
1. A method of segmenting a three-dimensional (3D) model of a patient's dentition, the method comprising:
receiving, in a computing device, the 3D model of the patient's dentition;
converting the 3D model of the patient's dentition into a sparse voxel representation comprising voxels having features mapped from the 3D model of the patient's dentition; and
convolving the sparse voxel representation to segment the 3D model of the patient's dentition using a convolutional neural network to form a segmented 3D model of the patient's dentition.
2. The method of claim 1 , wherein convolving the sparse voxel representation further comprises applying a trained machine learning model to recognize segmentation elements corresponding to segmentation of the patient's dentition.
3. The method of claim 1 , wherein features are computed for each voxel based on a mesh representation of the 3D model of the patient's dentition.
4. The method of claim 3 , wherein the features that are computed for each voxel are based on one or more of: a sum of normals of mesh faces which map to the voxel, a count of faces mapped to the voxel, a sum of an area from the mesh representation, and an average of angles from the mesh representation.
5. The method of claim 1 , wherein convolving comprises using sparse 3D submanifold convolution.
6. The method of claim 1 , wherein convolving the spare sparse voxel representation to segment the 3D model comprises generating a predicted segmentation from the sparse voxel representation and applying the predicted segmentation onto the 3D model of the patient's dentition to form the segmented 3D model of the patient's dentition.
7. The method of claim 1 , further comprising assigning a tooth number to individually segmented teeth of the segmented 3D model of the patient's dentition.
8. The method of claim 1 , further comprising postprocessing of the segmented 3D model of the patient's dentition to correct a tooth numbering.
9. The method of claim 1 , wherein the 3D model of the patient's dentition comprises a scan of the patient's dentition.
10. The method of claim 1 , further comprising capturing a scan of the patient's dentition with a scanning device and converting the scan into the 3D model of the patient's dentition.
11. The method of claim 1 , further comprising outputting one or more of:
interproximal contact distances, teeth numbers and sizes based on the segmented 3D model of the patient's dentition.