IP Library Granted Patent US 12,734,019
Granted Patent B2
US 12,734,019 · App. 18/157,067 · Granted Sep 15, 2026

Photo-based dental attachment detection

Inventors: Christopher E. Cramer (Durham, NC); Chad Clayton Brown (Cary, NC); Guotu Li (Apex, NC)
Assignee: Align Technology, Inc.
A61C7/002A61C7/08A61C7/146G06T7/0012G06T7/12G06T7/62G16H10/60G16H20/40G06T2207/30036
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,734,019
App. No.
18/157,067
Granted
Sep 15, 2026
Kind
B2
Abstract

A method for dental treatment may include receiving a plurality of images of a patient's dentition, identifying, from the plurality of images, individual teeth of the patient's dentition, detecting, from the plurality of images, one or more attachments on the patient's dentition, assigning, based on each of the plurality of images, each of the one or more attachments to one of the individual teeth in each image, and combining the assignments of each of the plurality of images for attachment detection results.

Claims (48)

1 . A system for dental treatment comprising one or more processors and a memory operably coupled to the one or more processors and storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:

receiving a plurality of images of a patient's dentition;

identifying, in each of the plurality of images, individual teeth of the patient's dentition;

detecting, in each of the plurality of images, one or more attachments on the patient's dentition;

assigning, based on the plurality of images, each of the one or more attachments to one of the individual teeth depicted in the plurality of images;

identifying a first plurality of the plurality of images in which a first tooth of the individual teeth is visible;

combining the assignments of each of the plurality of images for attachment detection results; and

determining that an expected attachment is missing from the first tooth, when, based on the combination of assignments, an attachment is not depicted on the first tooth in a majority of the first plurality of the plurality of images.

2 . The system of claim 1 , wherein identifying, from the plurality of images, individual teeth of the patient's dentition includes segmenting the individual teeth of the patient's dentition contained in the image.

3 . The system of claim 2 , wherein segmenting the individual teeth includes determining which teeth are located in the image and which pixels of the image are a part of each tooth.

4 . The system of claim 1 , wherein the identifying the individual teeth includes assigning each identified tooth to a corresponding tooth in a patient's treatment plan.

5 . The system of claim 4 , wherein the identifying the individual teeth includes removing a tooth that is not present in the patient's treatment plan.

6 . The system of claim 1 , wherein the memory storing the instructions that, when executed by the one or more processors, cause the system to perform further operations comprising:

forming a bounding box around each detected attachment.

7 . The system of claim 6 , wherein assigning each of the one or more attachments to one of the individual teeth includes:

determining a center point of the attachment bounding box; and

assigning the attachment to a tooth of the individual teeth based on where the center point is located.

8 . The system of claim 6 , wherein assigning each of the one or more attachments to one of the individual teeth includes:

determining a center point of the attachment bounding box; and

assigning the attachment to a tooth of the individual teeth based on a nearest tooth to where the center point is located.

9 . The system of claim 6 , wherein assigning each of the one or more attachments to one of the individual teeth includes:

determining an area of each tooth within the bounding box; and

assigning the attachment to the tooth based on which tooth has a greatest area within the bounding box.

10 . The system of claim 9 wherein assigning the attachment to the tooth is constrained to teeth likely to be in a photo based on a particular view from which the photo is taken.

11 . The system of claim 10 , wherein in an anterior view the teeth likely to be in the photo are central and lateral incisors and canines.

12 . The system of claim 10 , wherein in a left lateral view the teeth likely to be in the photo are central incisors, left lateral incisors, left canines, first and second left bicuspids, and first left molars.

13 . The system of claim 10 , wherein in a right lateral view the teeth likely to be in the photo are central incisors, right lateral incisors, right canines, first and second right bicuspids, and first right molars.

14 . The system of claim 6 , wherein assigning each of the one or more attachments to one of the individual teeth includes:

determining an amount of overlap of one or more teeth and a vertical mesial edge of the bounding box; and

assigning the attachment to a tooth of the one or more teeth with the greatest amount of overlap.

15 . The system of claim 1 , wherein the memory storing the instructions that, when executed by the one or more processors, cause the system to perform further operations comprising:

determining a number of attachments that should be on each tooth based on the number of attachments placed on each tooth in the patient's treatment plan.

16 . The system of claim 1 , wherein combining the assignments of each of the plurality of images for attachment detection results includes:

for each image, identifying which teeth can be seen in the image; and

determining for each respective tooth, whether or not a single image of the plurality of images depicts an expected number of attachments on the respective tooth.

17 . The system of claim 16 , wherein the memory storing the instructions that, when executed by the one or more processors, cause the system to perform further operations comprising:

determining that an attachment is missing if a single image depicts less than the expected number of attachments.

18 . The system of claim 16 , wherein the memory storing the instructions that, when executed by the one or more processors, cause the system to perform further operations comprising:

determining that an attachment is missing if the plurality of images depicts less than the expected number of attachments.

19 . The system of claim 1 , wherein combining the assignments of each of the plurality of images for attachment detection results includes:

for each image, identifying which teeth can be seen in the image; and

determining that an attachment is missing when less than a majority of the plurality of images that depict the tooth also depict an expected number of attachments.

20 . The system of claim 1 , wherein combining the assignments of each of the plurality of images for attachment detection results includes:

for each image, identifying which teeth can be seen in the image; and

determining that an attachment is missing when a majority of the plurality of images that depict the tooth also depict less than an expected number of attachments.

21 . The system of claim 1 , wherein the plurality of images include images with arches in an open-bite.

22 . The system of claim 1 , wherein the plurality of images include images with arches in a closed-bite.

23 . The system of claim 1 , wherein the plurality of images include an anterior image with arches in an open-bite, a left lateral image with the arches in the open-bite, a right lateral image with the arches in the open-bite, an anterior image with the arches in a closed-bite, a left lateral image with the arches in the closed-bite, and a right lateral image with the arches in the closed-bite.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2023
From: CRAMER, CHRISTOPHER E.; BROWN, CHAD CLAYTON; LI, GUOTU
To: ALIGN TECHNOLOGY, INC.
Reel/Frame 062788/0364 →
Continuity (2)
Provisional Application 63301412 · Jan 20, 2022
Related Publication 20230225832A1 · Jul 20, 2023
References Cited (168)
US 5975893A · Chishti et al. · 1999 [cited by applicant]
US 6227850B1 · Chishti et al. · 2001 [cited by applicant]
US 6227851B1 · Chishti et al. · 2001 [cited by applicant]
US 6299440B1 · Phan et al. · 2001 [cited by applicant]
US 6309215B1 · Phan et al. · 2001 [cited by applicant]
US 6318994B1 · Chishti et al. · 2001 [cited by applicant]
US 6371761B1 · Cheang et al. · 2002 [cited by applicant]
US 6386878B1 · Pavlovskaia et al. · 2002 [cited by applicant]
US 6406292B1 · Chishti et al. · 2002 [cited by applicant]
US 6409504B1 · Jones et al. · 2002 [cited by applicant]
US 6450807B1 · Chishti et al. · 2002 [cited by applicant]
US 6457972B1 · Chishti et al. · 2002 [cited by applicant]
US 6488499B1 · Miller · 2002 [cited by applicant]
US 6514074B1 · Chishti et al. · 2003 [cited by applicant]
US 6554611B2 · Chishti et al. · 2003 [cited by applicant]
US 6582229B1 · Miller et al. · 2003 [cited by applicant]
US 6602070B2 · Miller et al. · 2003 [cited by applicant]
US 6621491B1 · Baumrind et al. · 2003 [cited by applicant]
US 6688886B2 · Hughes et al. · 2004 [cited by applicant]
US 6726478B1 · Isiderio et al. · 2004 [cited by applicant]
US 6729876B2 · Chishti et al. · 2004 [cited by applicant]
US 6739869B1 · Taub et al. · 2004 [cited by applicant]
US 6767208B2 · Kaza · 2004 [cited by applicant]
US 6783360B2 · Chishti · 2004 [cited by applicant]
US 6830450B2 · Knopp et al. · 2004 [cited by applicant]
US 7040896B2 · Pavlovskaia et al. · 2006 [cited by applicant]
US 7063532B1 · Jones et al. · 2006 [cited by applicant]
US 7074038B1 · Miller · 2006 [cited by applicant]
US 7074039B2 · Kopelman et al. · 2006 [cited by applicant]
US 7077647B2 · Choi et al. · 2006 [cited by applicant]
US 7108508B2 · Hedge et al. · 2006 [cited by applicant]
US 7134874B2 · Chishti et al. · 2006 [cited by applicant]
US 7156661B2 · Choi et al. · 2007 [cited by applicant]
US 7160107B2 · Kopelman et al. · 2007 [cited by applicant]
US 7241142B2 · Abolfathi et al. · 2007 [cited by applicant]
US 7293988B2 · Wen · 2007 [cited by applicant]
US 7309230B2 · Wen · 2007 [cited by applicant]
US 7357634B2 · Knopp · 2008 [cited by applicant]
US 7555403B2 · Kopelman et al. · 2009 [cited by applicant]
US 7637740B2 · Knopp · 2009 [cited by applicant]
US 7689398B2 · Cheng et al. · 2010 [cited by applicant]
US 7736147B2 · Kaza et al. · 2010 [cited by applicant]
US 7746339B2 · Matov et al. · 2010 [cited by applicant]
US 7844356B2 · Matov et al. · 2010 [cited by applicant]
US 7844429B2 · Matov et al. · 2010 [cited by applicant]
US 7865259B2 · Kuo et al. · 2011 [cited by applicant]
US 7878804B2 · Korytov et al. · 2011 [cited by applicant]
US 7880751B2 · Kuo et al. · 2011 [cited by applicant]
US 7904308B2 · Arnone et al. · 2011 [cited by applicant]
US 7930189B2 · Kuo · 2011 [cited by applicant]
US 7942672B2 · Kuo · 2011 [cited by applicant]
US 7970627B2 · Kuo et al. · 2011 [cited by applicant]
US 7970628B2 · Kuo et al. · 2011 [cited by applicant]
US 8038444B2 · Kitching et al. · 2011 [cited by applicant]
US 8044954B2 · Kitching et al. · 2011 [cited by applicant]
US 8075306B2 · Kitching et al. · 2011 [cited by applicant]
US 8092215B2 · Stone-Collonge et al. · 2012 [cited by applicant]
US 8099268B2 · Kitching et al. · 2012 [cited by applicant]
US 8108189B2 · Chelnokov et al. · 2012 [cited by applicant]
US 8126726B2 · Matov et al. · 2012 [cited by applicant]
US 8260591B2 · Kass et al. · 2012 [cited by applicant]
US 8275180B2 · Kuo · 2012 [cited by applicant]
US 8401826B2 · Cheng et al. · 2013 [cited by applicant]
US 8439672B2 · Matov et al. · 2013 [cited by applicant]
US 8562338B2 · Kitching et al. · 2013 [cited by applicant]
US 8591225B2 · Wu et al. · 2013 [cited by applicant]
US 8788285B2 · Kuo · 2014 [cited by applicant]
US 8843381B2 · Kuo et al. · 2014 [cited by applicant]
US 8874452B2 · Kuo · 2014 [cited by applicant]
US 8896592B2 · Boltunov et al. · 2014 [cited by applicant]
US 8930219B2 · Trosien et al. · 2015 [cited by applicant]
US 9037439B2 · Kuo et al. · 2015 [cited by applicant]
US 9060829B2 · Sterental et al. · 2015 [cited by applicant]
US 9125709B2 · Matty · 2015 [cited by applicant]
US 9211166B2 · Kuo et al. · 2015 [cited by applicant]
US 9220580B2 · Borovinskih et al. · 2015 [cited by applicant]
US 9364296B2 · Kuo · 2016 [cited by applicant]
US 9375300B2 · Matov et al. · 2016 [cited by applicant]
US 9414897B2 · Wu et al. · 2016 [cited by applicant]
US 9492245B2 · Sherwood et al. · 2016 [cited by applicant]
US 9642678B2 · Kuo · 2017 [cited by applicant]
US 10248883B2 · Borovinskih et al. · 2019 [cited by applicant]
US 10342638B2 · Kitching et al. · 2019 [cited by applicant]
US 10463452B2 · Matov et al. · 2019 [cited by applicant]
US 10595966B2 · Carrier, Jr. et al. · 2020 [cited by applicant]
US 10617489B2 · Grove et al. · 2020 [cited by applicant]
US 10722328B2 · Velazquez et al. · 2020 [cited by applicant]
US 10758322B2 · Pokotilov et al. · 2020 [cited by applicant]
US 10779718B2 · Meyer et al. · 2020 [cited by applicant]
US 10792127B2 · Kopelman et al. · 2020 [cited by applicant]
US 10828130B2 · Pokotilov et al. · 2020 [cited by applicant]
US 10835349B2 · Cramer et al. · 2020 [cited by applicant]
US 10973611B2 · Pokotilov et al. · 2021 [cited by applicant]
US 10996813B2 · Makarenkova et al. · 2021 [cited by applicant]
US 10997727B2 · Xue et al. · 2021 [cited by applicant]
US 11020205B2 · Li et al. · 2021 [cited by applicant]
US 11020206B2 · Shi et al. · 2021 [cited by applicant]
US 11026766B2 · Chekh et al. · 2021 [cited by applicant]
US 11033359B2 · Velazquez et al. · 2021 [cited by applicant]
US 11071608B2 · Derakhshan et al. · 2021 [cited by applicant]
US 11096763B2 · Akopov et al. · 2021 [cited by applicant]
US 11116605B2 · Nyukhtikov et al. · 2021 [cited by applicant]
US 11147652B2 · Mason et al. · 2021 [cited by applicant]
US 11151753B2 · Gao et al. · 2021 [cited by applicant]
US 11154381B2 · Roschin et al. · 2021 [cited by applicant]
US 11259896B2 · Matov et al. · 2022 [cited by applicant]
US 11357598B2 · Cramer · 2022 [cited by applicant]
US 11395717B2 · Yuryev et al. · 2022 [cited by applicant]
US 11432908B2 · Kopelman et al. · 2022 [cited by applicant]
US 11464604B2 · Makarenkova et al. · 2022 [cited by applicant]
US 11478334B2 · Matov et al. · 2022 [cited by applicant]
US 11484389B2 · Sterental et al. · 2022 [cited by applicant]
US 11521732B2 · Levin et al. · 2022 [cited by applicant]
US 11534272B2 · Li et al. · 2022 [cited by applicant]
US 11553988B2 · Mednikov et al. · 2023 [cited by applicant]
US 12465464B2 · Wong · 2025 [cited by examiner]
US 20030008259A1 · Kuo et al. · 2003 [cited by applicant]
US 20030143509A1 · Kopelman et al. · 2003 [cited by applicant]
US 20030207227A1 · Abolfathi · 2003 [cited by applicant]
US 20040137400A1 · Chishti et al. · 2004 [cited by applicant]
US 20040152036A1 · Abolfathi · 2004 [cited by applicant]
US 20040197728A1 · Abolfathi et al. · 2004 [cited by applicant]
US 20040259049A1 · Kopelman et al. · 2004 [cited by applicant]
US 20050182654A1 · Abolfathi et al. · 2005 [cited by applicant]
US 20050244791A1 · Davis et al. · 2005 [cited by applicant]
US 20060127836A1 · Wen · 2006 [cited by applicant]
US 20060127852A1 · Wen · 2006 [cited by applicant]
US 20060127854A1 · Wen · 2006 [cited by applicant]
US 20060275731A1 · Wen et al. · 2006 [cited by applicant]
US 20060275736A1 · Wen et al. · 2006 [cited by applicant]
US 20080306724A1 · Kitching et al. · 2008 [cited by applicant]
US 20100009308A1 · Wen et al. · 2010 [cited by applicant]
US 20100068672A1 · Arjomand et al. · 2010 [cited by applicant]
US 20100068676A1 · Mason et al. · 2010 [cited by applicant]
US 20100092907A1 · Knopp · 2010 [cited by applicant]
US 20100167243A1 · Spiridonov et al. · 2010 [cited by applicant]
US 20130204599A1 · Matov et al. · 2013 [cited by applicant]
US 20160310235A1 · Derakhshan et al. · 2016 [cited by applicant]
US 20170273760A1 · Morton et al. · 2017 [cited by applicant]
US 20180280118A1 · Cramer · 2018 [cited by applicant]
US 20190029522A1 · Sato et al. · 2019 [cited by applicant]
US 20190029784A1 · Moalem et al. · 2019 [cited by applicant]
US 20190328487A1 · Levin et al. · 2019 [cited by applicant]
US 20190328488A1 · Levin et al. · 2019 [cited by applicant]
US 20200107915A1 · Roschin et al. · 2020 [cited by applicant]
US 20200155274A1 · Pimenov · 2020 [cited by examiner]
US 20200160497A1 · Shah et al. · 2020 [cited by applicant]
US 20200297458A1 · Roschin et al. · 2020 [cited by applicant]
US 20200306011A1 · Chekhonin et al. · 2020 [cited by applicant]
US 20200306012A1 · Roschin et al. · 2020 [cited by applicant]
US 20200360109A1 · Gao et al. · 2020 [cited by applicant]
US 20210073998A1 · Brown et al. · 2021 [cited by applicant]
US 20210134436A1 · Meyer et al. · 2021 [cited by applicant]
US 20210174477A1 · Shi et al. · 2021 [cited by applicant]
US 20210196430A1 · Wilson · 2021 [cited by examiner]
US 20210338379A1 · Salah et al. · 2021 [cited by applicant]
US 20210361387A1 · Salah et al. · 2021 [cited by applicant]
US 20220023002A1 · Cramer et al. · 2022 [cited by applicant]
US 20220215928A1 · Tabak · 2022 [cited by examiner]
US 20230404709A1 · Giegerich · 2023 [cited by examiner]
EP 3831331A1 · 2021 [cited by examiner]
WO 2021163285A1 · 2021 [cited by applicant]
Mahdi, F.P., Motoki, K. & Kobashi, S. Optimization technique combined with deep learning method for teeth recognition in dental panoramic radiographs. Sci Rep 10, 19261 (2020). https://doi.org/10.1038/s41598-020-75887-9… [cited by examiner]
Lo, Y.-C.; Chen, G.-A.; Liu, Y.-C.; Chen, Y.-H.; Hsu, J.-T.; Yu, J.-H. Prototype of Augmented Reality Technology for Orthodontic Bracket Positioning: An In Vivo Study. Appl. Sci. 2021, 11, 2315. https://doi.org/10.3390/… [cited by examiner]
R. Winter, Recommended Photography Series. Spear Digest Dental Articles. https://www.speareducation.com/spear-review/2018/04/recommended-photography-series (Year: 2018). [cited by examiner]
Litzenburger, F., Heck, K., Kaisarly, D. et al. Diagnostic validity of early proximal caries detection using near-infrared imaging technology on 3D range data of posterior teeth. Clin Oral Invest 26, 543-553. https://do… [cited by examiner]
Chen, H., Zhang, K., Lyu, P. et al. A deep learning approach to automatic teeth detection and numbering based on object detection in dental periapical films. Sci Rep 9, 3840 (2019). https://doi.org/10.1038/s41598-019-40… [cited by examiner]
Tuzoff et al. Tooth detection and numbering in panoramic radiographs using convolutional neural networks. Dentomaxillofacial Radiology. 48, 4. https://doi.org/10.1259/dmfr.20180051 (Year: 2019). [cited by examiner]