System and method of landmark-based segmentation and transformation of physical structures
View Patent ↗Example implementations include a method of mapping and segmenting a physical object by obtaining a plurality of two-dimensional images of a physical object, generating a three-dimensional object model of the physical object based at least partially on one or more of the two-dimensional images, obtaining a plurality of landmarks associated with the object model, one or more of the landmarks being respectively associated with corresponding three-dimensional coordinates and object plane identifiers, and generating at least one landmark plane at the object model including one or more of the landmarks including the object plane identifiers.
1. A method of mapping and segmenting a physical object, comprising:
obtaining a plurality of two-dimensional images of a physical object;
generating a three-dimensional object model of the physical object based at least partially on one or more of the two-dimensional images;
obtaining a plurality of landmarks associated with the object model, one or more of the landmarks being respectively associated with corresponding three-dimensional coordinates and object plane identifiers;
generating at least one landmark plane at the object model including one or more of the landmarks including the object plane identifiers;
generating a symmetry plane dividing the object model into a first object model region and a second object model region;
selecting a first landmark from the plurality of landmarks located within the first object model region, and a second landmark from the plurality of landmarks located within the second object model region;
extracting first coordinates from the first landmark and second coordinates from the second landmark; and
generating a symmetry metric based on the first coordinates and the second coordinates.
2. The method of claim 1 , further comprising:
modifying at least a portion of at least one of the three-dimensional coordinates to intersect with the at least one landmark plane.
3. The method of claim 1 , further comprising:
in accordance with a determination that the symmetry metric satisfies an asymmetry threshold, modifying at least one of the first landmark and the second landmark.
4. The method of claim 1 , wherein the first landmark comprises a plurality of first landmarks associated with a first structure of the object model, and the second landmark comprises a plurality of second landmarks associated with a second structure of the object model.
5. The method of claim 1 , wherein the physical object comprises a maxillofacial structure and the object model comprises a three-dimensional model of the maxillofacial structure.
6. The method of claim 1 , wherein the physical object comprises a dentition structure and the object model comprises a three-dimensional model of the dentition structure.
7. A method of mapping and segmenting a physical object, comprising:
obtaining a plurality of two-dimensional images of a physical object;
generating a three-dimensional object model of the physical object based at least partially on one or more of the two-dimensional images;
obtaining a plurality of landmarks associated with the object model, one or more of the landmarks being respectively associated with corresponding three-dimensional coordinates and object plane identifiers;
generating at least one landmark plane at the object model including one or more of the landmarks including the object plane identifiers;
selecting a first landmark set and a second landmark set from the plurality of landmarks; and
segmenting the object model into a first segmented region based on the first landmark set and a second segmented region based on the second landmark set.
8. The method of claim 7 , further comprising:
identifying a maxillofacial arch object substantially in the first segmented region; and
generating a maxillofacial arch metric associated with the maxillofacial arch object,
wherein the first segmented region is associated with a maxillofacial region of the object model.
9. The method of claim 8 , further comprising:
identifying a dental object substantially in the second segmented region; and
generating a dental object metric associated with the dental object,
wherein the second segmented region is associated with a dentition region of the object model.
10. The method of claim 9 , further comprising:
modifying at least one of the dental object and the maxillofacial arch object.
11. A system of mapping and segmenting a physical object, comprising:
an image processing engine operable by a processor to obtain a plurality of two-dimensional images of a physical object, and generate a three-dimensional object model of the physical object based at least partially on one or more of the two-dimensional images;
a landmark processing engine operable by the processor to obtain a plurality of landmarks associated with the object model, one or more of the landmarks being respectively associated with corresponding three-dimensional coordinates and object plane identifiers, and to generate at least one landmark plane at the object model including one or more of the landmarks including the object plane identifiers; and
an object model segmenter operable by the processor to select a first landmark set and a second landmark set from the plurality of landmarks, and segment the object model into a first segmented region based on the first landmark set and a second segmented region based on the second landmark set.
12. The system of claim 11 , wherein the landmark processing engine is further operable by the processor to generate a symmetry plane dividing the object model into a first object model region and a second object model region, select a first landmark from the plurality of landmarks located within the first object model region, and a second landmark from the plurality of landmarks located within the second object model region, extract first coordinates from the first landmark and second coordinates from the second landmark, and generate a symmetry metric based on the first coordinates and the second coordinates.
13. The system of claim 11 , wherein the object model segmenter is further operable by the processor to identify a maxillofacial arch object substantially in the first segmented region, and generate a maxillofacial arch metric associated with the maxillofacial arch object, and
wherein the first segmented region is associated with a maxillofacial region of the object model.
14. The system of claim 13 , wherein the object model segmenter is further operable by the processor to identify a dental object substantially in the second segmented region, and generate a dental object metric associated with the dental object, and
wherein the second segmented region is associated with a dentition region of the object model.
15. The system of claim 11 , further comprising:
a model transformation engine operable by the processor to modify at least one of the dental object, generate a transformed object based on the modified dental object, and validate the transformed object in accordance with at least one orthodontic model.