Augmented reality enhancements for dental practitioners

1. A method comprising:

receiving, from an image capture device associated with an augmented reality (AR) display and by a processing device, a plurality of images of a face of a patient;

selecting, by the processing device, a subset of the plurality of images that meet one or more image selection criteria, the selecting comprising:

determining, from the plurality of images, a first image that represents a first position extreme for the face;

determining, from the plurality of images, a second image that represents a second position extreme of the face;

selecting the first image; and

selecting the second image; and

generating, by the processing device, a digital model of a jaw of the patient based at least in part on the subset of the plurality of images that have been selected.

2. The method of claim 1 , further comprising:

discarding a remainder of the plurality of images that have not been selected.

3. The method of claim 1 , wherein the first image comprises a left profile of the face and the second image comprises a right profile of the face.

4. The method of claim 1 , wherein determining that the first image represents the first position extreme of the face comprises:

performing the following for each image of the plurality of images:

identifying a tip of a nose in the image;

identifying a base of the nose in the image;

generating a vector between the base of the nose and the tip of the nose; and

determining a direction and a magnitude for a horizontal component of the vector;

comparing, between each of the plurality of images, the direction and the magnitude for the horizontal component of the vector; and

determining that the first image has a first direction and a maximum magnitude for the horizontal component of the vector.

5. The method of claim 1 , wherein the subset of the plurality of images comprises:

an image representing a left profile of the face in which a mouth of the patient is closed;

an image representing a right profile of the face in which the mouth of the patient is closed;

an image representing the left profile of the face in which the mouth of the patient is open;

an image representing the right profile of the face in which the mouth of the patient is open;

an image representing a front view of the face in which the mouth of the patient is closed; and

an image representing the front view of the face in which the mouth of the patient is open.

6. The method of claim 1 , wherein:

the first image is an image in which a lower jaw of the patient has been moved left relative to an upper jaw of the patient;

the second image is an image in which the lower jaw of the patient has been moved right relative to the upper jaw of the patient; and

the subset of the plurality of images further comprises a third image in which a mouth of the patient is maximally open.

7. The method of claim 6 , wherein determining the first image comprises:

performing the following for each image of the plurality of images:

identifying a first midline of the upper jaw;

identifying a second midline of the lower jaw; and

determining a horizontal distance between the first midline and the second midline;

comparing, between each of the plurality of images, the horizontal distance between the first midline and the second midline; and

determining that the first image has a maximum horizontal distance.

8. The method of claim 6 , wherein the digital model of the jaw comprises an articulation model of the jaw that defines motion vectors for the jaw.

9. The method of claim 8 , further comprising:

computing an occlusion map for the jaw based on the articulation model and a three-dimensional model of the jaw.

10. The method of claim 1 , wherein the plurality of images are received in an image stream, the method further comprising:

receiving an instruction to generate a note for a current image;

receiving an audio note pertinent to the current image;

saving the current image and the audio note, wherein the current image and audio not are linked such that the audio note plays when the current image is displayed.

11. A system comprising:

a memory device; and

a processing device operatively coupled to the memory device, the processing device to:

receive, from an image capture device associated with an augmented reality (AR) display, a plurality of images of a face of a patient;

select a subset of the plurality of images that meet one or more image selection criteria, wherein selecting the subset comprises:

determining, from the plurality of images, a first image that represents a first position extreme for the face;

determining, from the plurality of images, a second image that represents a second position extreme of the face;

selecting the first image; and

selecting the second image; and

generate a model of a jaw of the patient based at least in part on the subset of the plurality of images that have been selected.

12. The system of claim 11 , wherein the processing device is further to:

discard a remainder of the plurality of images that have not been selected.

13. The system of claim 11 , wherein the first image comprises a left profile of the face and the second image comprises a right profile of the face.

14. The system of claim 11 , wherein determining that the first image represents the first position extreme of the face comprises:

performing the following for each image of the plurality of images:

identifying a tip of a nose in the image;

identifying a base of the nose in the image;

generating a vector between the base of the nose and the tip of the nose; and

determining a direction and a magnitude for a horizontal component of the vector;

comparing, between each of the plurality of images, the direction and the magnitude for the horizontal component of the vector; and

determining that the first image has a first direction and a maximum magnitude for the horizontal component of the vector.

15. The system of claim 11 , wherein the subset of the plurality of images comprises:

an image representing a left profile of the face in which a mouth of the patient is closed;

an image representing a right profile of the face in which the mouth of the patient is closed;

an image representing the left profile of the face in which the mouth of the patient is open;

an image representing the right profile of the face in which the mouth of the patient is open;

an image representing a front view of the face in which the mouth of the patient is closed; and

an image representing the front view of the face in which the mouth of the patient is open.

16. The system of claim 11 , wherein:

the first image is an image in which a lower jaw of the patient has been moved left relative to an upper jaw of the patient;

the second image is an image in which the lower jaw of the patient has been moved right relative to the upper jaw of the patient; and

the subset of the plurality of images further comprises a third image in which a mouth of the patient is maximally open.

17. The system of claim 16 , wherein determining the first image comprises:

performing the following for each image of the plurality of images:

identifying a first midline of the upper jaw;

identifying a second midline of the lower jaw; and

determining a horizontal distance between the first midline and the second midline;

comparing, between each of the plurality of images, the horizontal distance between the first midline and the second midline; and

determining that the first image has a maximum horizontal distance.

18. The system of claim 11 , wherein the model of the jaw comprises an articulation model of the jaw that defines motion vectors for the jaw.

19. The system of claim 18 , wherein the processing device is further to:

compute an occlusion map for the jaw based on the articulation model and a three-dimensional model of the jaw.

20. The system of claim 11 , wherein the plurality of images are received in an image stream, and wherein the processing device is further to:

receive an instruction to generate a note for a current image;

receive an audio note pertinent to the current image;

save the current image and the audio note, wherein the current image and audio not are linked such that the audio note plays when the current image is displayed.

21. A non-transitory computer readable storage medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

receiving, from an image capture device associated with an augmented reality (AR) display, a plurality of images of a face of a patient;

selecting a subset of the plurality of images that meet one or more image selection criteria, the selecting comprising:

determining, from the plurality of images, a first image that represents a first position extreme for the face;

determining, from the plurality of images, a second image that represents a second position extreme of the face;

selecting the first image; and

selecting the second image; and

generating a model of a jaw of the patient based at least in part on the subset of the plurality of images that have been selected.

22. The non-transitory computer readable storage medium of claim 21 , the operations further comprising:

discarding a remainder of the plurality of images that have not been selected.

23. The non-transitory computer readable storage medium of claim 21 , wherein the first image comprises a left profile of the face and the second image comprises a right profile of the face.

24. The non-transitory computer readable storage medium of claim 21 , wherein determining that the first image represents the first position extreme of the face comprises:

performing the following for each image of the plurality of images:

identifying a tip of a nose in the image;

identifying a base of the nose in the image;

generating a vector between the base of the nose and the tip of the nose; and

determining a direction and a magnitude for a horizontal component of the vector;

comparing, between each of the plurality of images, the direction and the magnitude for the horizontal component of the vector; and

determining that the first image has a first direction and a maximum magnitude for the horizontal component of the vector.

25. The non-transitory computer readable storage medium of claim 21 , wherein:

the first image is an image in which a lower jaw of the patient has been moved left relative to an upper jaw of the patient;

the second image is an image in which the lower jaw of the patient has been moved right relative to the upper jaw of the patient; and

the subset of the plurality of images further comprises a third image in which a mouth of the patient is maximally open.

26. The non-transitory computer readable storage medium of claim 25 , wherein determining the first image comprises:

performing the following for each image of the plurality of images:

identifying a first midline of the upper jaw;

identifying a second midline of the lower jaw; and

determining a horizontal distance between the first midline and the second midline ;

comparing, between each of the plurality of images, the horizontal distance between the first midline and the second midline; and

determining that the first image has a maximum horizontal distance.

27. The non-transitory computer readable storage medium of claim 26 , wherein the model of the jaw comprises an articulation model of the jaw that defines motion vectors for the jaw, the operations further comprising:

computing an occlusion map for the jaw based on the articulation model and a three-dimensional model of the jaw.

28. The non-transitory computer readable storage medium of claim 21 , wherein the plurality of images are received in an image stream, the operations further comprising:

receiving an instruction to generate a note for a current image;

receiving an audio note pertinent to the current image;

saving the current image and the audio note, wherein the current image and audio not are linked such that the audio note plays when the current image is displayed.