Granted Patent B2

US 12,243,293 · App. 18/449,320 · Granted Mar 4, 2025

Inventors: Anuj Doshi (Long Island City, NY); Jonathan Lee (Brooklyn, NY); John B. Putman (Celebration, FL)

Assignee: Nanotronics Imaging, Inc.

G06V10/774G06T7/001G06V10/235G06T2207/20104

Abstract

Claims (56)

1. A method, comprising:

causing, by a computing system, presentation of graphical user interface comprising an image of a specimen to a user, the image comprising a defect on the specimen;

receiving, by the computing system, a user input annotating the image on the graphical user interface, wherein the user input comprises a first indication of a location of the defect on the specimen and a second indication of a class corresponding to the defect;

automatically adjusting, by the computing system, the first indication of the location of the defect on the specimen in accordance with an error profile corresponding to the user, the error profile generated by training a machine learning model to learn an individualized defect label pattern associated with the user based on a plurality of training annotated images of specimens associated with the user, the error profile defining adjustments to annotations, including the user input, generated by the user based on a determined class corresponding to the defect; and

updating, by the computing system, the graphical user interface to display of the adjusted first indication to the user.

2. The method of claim 1 , wherein automatically adjusting, by the computing system, the first indication of the location of the defect on the specimen in accordance with the error profile corresponding to the user comprises:

converting the first indication to a predefined default shape; and

adjusting the predefined default shape based on the error profile.

3. The method of claim 1 , further comprising:

defining, by the computing system, a color pallet for the annotations, wherein each color in the color pallet corresponds to a specific class of defects.

4. The method of claim 3 , further comprising:

identifying, by the computing system, a color corresponding to the second indication; and

determining the class of the defect based on the color of the second indication.

5. The method of claim 1 , further comprising:

determining, by the computing system, that the user has annotated a threshold amount of images; and

based on the determining, initiating, by the computing system, a recalibration process for recalibrating the error profile corresponding to the user.

6. The method of claim 1 , further comprising:

identifying, by the computing system, a plurality of indications of a plurality of defects on the specimen, the plurality of indications comprising the first indication; and

filtering, by the computing system, the plurality of defects based on a defect class associated with each of the plurality of defects.

7. A non-transitory computer readable medium having one or more sequences of instructions stored thereon, which, when executed by a processor, causes a computing system to perform operations comprising:

causing, by the computing system, presentation of a graphical user interface comprising an image of a specimen to a user, the image comprising a defect on the specimen;

receiving, by the computing system, a user input annotating the image on the graphical user interface, wherein the user input comprises a first indication of a location of the defect on the specimen and a second indication of a class corresponding to the defect;

automatically adjusting, by the computing system, the first indication of the location of the defect on the specimen in accordance with an error profile corresponding to the user, the error profile generated by training a machine learning model to learn an individualized defect label pattern associated with the user based on a plurality of training annotated images of specimens associated with the user, the error profile defining adjustments to annotations, including the user input, generated by the user based on a determined class corresponding to the defect; and

updating, by the computing system, the graphical user interface to display the adjusted first indication to the user.

8. The non-transitory computer readable medium of claim 7 , wherein automatically adjusting, by the computing system, the first indication of the location of the defect on the specimen in accordance with the error profile corresponding to the user comprises:

converting the first indication to a predefined default shape; and

adjusting the predefined default shape based on the error profile.

9. The non-transitory computer readable medium of claim 7 , further comprising:

defining, by the computing system, a color pallet for the annotations, wherein each color in the color pallet corresponds to a specific class of defects.

10. The non-transitory computer readable medium of claim 9 , further comprising:

identifying, by the computing system, a color corresponding to the second indication; and

determining the class of the defect based on the color of the second indication.

11. The non-transitory computer readable medium of claim 7 , further comprising:

determining, by the computing system, that the user has annotated a threshold amount of images; and

based on the determining, initiating, by the computing system, a recalibration process for recalibrating the error profile corresponding to the user.

12. The non-transitory computer readable medium of claim 7 , further comprising:

identifying, by the computing system, a plurality of indications of a plurality of defects on the specimen, the plurality of indications comprising the first indication; and

filtering, by the computing system, the plurality of defects based on a defect class associated with each of the plurality of defects.

13. A system, comprising:

a processor; and

a memory having programming instructions stored thereon, which, when executed by the processor, causes the system to perform operations comprising:

causing presentation of a graphical user interface comprising an image of a specimen to a user, the image comprising a defect on the specimen;

receiving a user input annotating the image on the graphical user interface, wherein the user input comprises a first indication of a location of the defect on the specimen and a second indication of a class corresponding to the defect;

automatically adjusting the first indication of the location of the defect on the specimen in accordance with an error profile corresponding to the user, the error profile generated by training a machine learning model to learn an individualized defect label pattern associated with the user based on a plurality of training annotated images of specimens associated with the user, the error profile defining adjustments to annotations, including the user input, generated by the user based on a determined class corresponding to the defect; and

adjusting the user input in accordance with the error profile and the class corresponding to the defect.

14. The system of claim 13 , wherein automatically adjusting the first indication of the location of the defect on the specimen in accordance with the error profile corresponding to the user comprises:

converting the first indication to a default shape; and

adjusting the default shape based on the error profile.

15. The system of claim 13 , wherein the operations further comprise:

defining a color pallet for the annotations, wherein each color in the color pallet corresponds to a specific class of defects.

16. The system of claim 15 , wherein the operations further comprise:

identifying a color corresponding to the second indication; and

determining the class of the defect based on the color of the second indication.

17. The system of claim 13 , wherein the operations further comprise:

determining that the user has annotated a threshold amount of images; and

based on the determining, initiating a recalibration process for recalibrating the error profile corresponding to the user.

Assignments (2)

Continuity (3)

References Cited (9)