Systems and methods for constructing a three-dimensional model from two-dimensional images
Systems and methods for generating a three-dimensional (3D) model of a user's dental arch based on two-dimensional (2D) images of dental impressions include a model training system that provides a machine learning model using training image(s) of a dental impression of a respective dental arch and a 3D training model of the respective dental arch. A model generation system receives first image(s) of a first dental impression of a user's dental arch and second image(s), which may be of the first dental impression or a second dental impression of the dental arch. The model generation system generates a first and second 3D model of the dental arch by applying the first image(s) and second image(s) to the machine learning model. A model merging system merges the first 3D model and the second 3D model to generate a merged model of the dental arch.
1. A system comprising:
a model generation system configured to:
receive one or more first images of a first dental impression of a dental arch of a user;
generate a first three-dimensional (3D) model of the dental arch of the user by applying the one or more first images to a machine learning model trained to generate 3D models of dental arches from two-dimensional (2D) images of dental impressions of the dental arches;
receive one or more second images, wherein the one or more second images are of one of the first dental impression of the dental arch or a second dental impression of the dental arch; and
generate a second 3D model of the dental arch of the user by applying the one or more second images to the machine learning model; and
a model merging system configured to:
merge the first 3D model and the second 3D model to generate a merged model.
2. The system of claim 1 , wherein the one or more first images and the one or more second images are images of the first dental impression, and wherein the first 3D model and the second 3D model are generated based on the first dental impression of the dental arch.
3. The system of claim 1 , wherein the one or more first images are of the first dental impression of the dental arch, the one or more second images are of the second dental impression of the dental arch, and wherein the first 3D model is generated based on the first dental impression of the dental arch and the second 3D model is generated based on the second dental impression of the dental arch.
4. The system of claim 1 , further comprising:
a model training system configured to:
receive a plurality of data packets of a training set, each data packet of the plurality of data packets including data corresponding to one or more training images of a dental impression of a respective dental arch and a three-dimensional (3D) training model of the respective dental arch;
identify, for each data packet of the plurality of data packets of the training set, a plurality of correlation points between the one or more training images and the 3D training model of the respective dental arch; and
generate the machine learning model using the one or more training images, the 3D training model, and the plurality of correlation points between the one or more training images and the 3D training model of each data packet of the plurality of data packets of the training set.
5. The system of claim 1 , wherein the model merging system is configured to:
generate a first point cloud of the first 3D model and a second point cloud of the second 3D model;
align the first point cloud and the second point cloud; and
merge the first 3D model and the second 3D model to generate the merged model, wherein merging the first 3D model and the second 3D model is based on the alignment of the first point cloud and the second point cloud.
6. The system of claim 1 , further comprising a manufacturing system configured to manufacture a dental aligner based on the merged 3D model, the dental aligner being specific to the user and configured to reposition one or more teeth of the user.
7. The system of claim 1 , wherein the model merging system is further configured to transmit the merged 3D model, wherein the merged 3D model is transmitted for generating a user interface for rendering at a user device that includes the merged 3D model to the user.
8. A method comprising:
providing, by a model training system, a machine learning model using one or more training images of a dental impression of a respective dental arch and a three-dimensional (3D) training model of the respective dental arch;
receiving, by a model generation system, one or more first images of a first dental impression of a dental arch of a user;
generating, by the model generation system, a first 3D model of the dental arch of the user by applying the one or more first images to the machine learning model;
receiving, by the model generation system, one or more second images, wherein the one or more second images are of one of the first dental impression of the dental arch or a second dental impression of the dental arch;
generating, by the model generation system, a second 3D model of the dental arch of the user by applying the one or more second images to the machine learning model; and
merging, by a model merging system, the first 3D model and the second 3D model to generate a merged model of the dental arch of the user.
9. The method of claim 8 , further comprising manufacturing a dental aligner based on the merged 3D model, the dental aligner being specific to the user and configured to reposition one or more teeth of the user.
10. The method of claim 8 , further comprising:
generating, using the merged 3D model of the dental arch of the user, a user interface for rendering at a user device that includes the merged 3D model; and
transmitting, to the user device, the generated user interface for rendering to the user.
11. The method of claim 8 , further comprising tracking, based on the merged 3D model of the dental arch of the user, a progress of repositioning one or more teeth of the user by one or more dental aligners from a first position to a second position by comparing the 3D model representing a current position of the one or more teeth with a treatment planning model representing an expected position of the one or more teeth.
12. The method of claim 8 , wherein merging the first 3D model and the second 3D model comprises:
generating a first point cloud of the first 3D model and a second point cloud of the second 3D model;
aligning the first point cloud and the second point cloud; and
merging the first 3D model and the second 3D model to generate the merged model, wherein merging the first 3D model and the second 3D model is based on the alignment of the first point cloud and the second point cloud.
13. The method of claim 8 , wherein providing the machine learning model comprises:
receiving, by the model training system, a plurality of data packets of a training set, each data packet of the plurality of data packets including data corresponding to one or more training images of a dental impression of a respective dental arch and a three-dimensional (3D) training model of the respective dental arch;
identifying, by the model training system, for each data packet of the plurality of data packets of the training set, a plurality of correlation points between the one or more training images and the 3D training model of the respective dental arch; and
generating, by the model training system, the machine learning model using the one or more training images, the 3D training model, and the plurality of correlation points between the one or more training images and the 3D training model of each data packet of the plurality of data packets of the training set.