IP Library Granted Patent US 11,087,452
Granted Patent B2
US 11,087,452 · App. 16/248,897 · Granted Aug 10, 2021

False alarm reduction system for automatic manufacturing quality control

Inventors: Alexandru Niculescu-Mizil (Plainsboro, NJ); Renqiang Min (Princeton, NJ); Eric Cosatto (Red Bank, NJ); Farley Lai (Plainsboro, NJ); Hans Peter Graf (South Amboy, NJ); Xavier Fontaine (Paris, FR)
G06T7/001G06K9/4604G06K9/4628G06K9/4671G06K9/6256G06K9/6273G06K9/6284G06T3/403G06T7/0004G08B29/186G06K2209/19G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,087,452
App. No.
16/248,897
Granted
Aug 10, 2021
Kind
B2
Abstract

A false alarm reduction system and method are provided for reducing false alarms in an automatic defect detection system. The false alarm reduction system includes a defect detection system, generating a list of image boxes marking detected potential defects in an input image. The false alarm reduction system further includes a feature extractor, transforming each of the image boxes in the list into a respective set of numerical features. The false alarm reduction system also includes a classifier, computing as a classification outcome for the each of the image boxes whether the detected potential defect is a true defect or a false alarm responsive to the respective set of numerical features for each of the image boxes.

Claims (26)

1. A false alarm reduction system for reducing false alarms in an automatic defect detection system, the false alarm reduction system comprising:

a defect detection system, generating a list of image boxes marking detected potential defects in an input image;

a feature extractor, transforming each of the image boxes in the list into a respective set of numerical features; and

a classifier, computing as a classification outcome for the each of the image boxes whether the detected potential defect is a true defect or a false alarm responsive to respective values of the respective set of numerical features for each of the image boxes.

2. The false alarm reduction system of claim 1 , wherein the defect detection system generates the list of boxes marking the potential defects using at least one object selected from the group consisting of an contextual autoencoder, a deep autoencoder, a one-class Support Vector Machine, a nearest neighbor classifier, a binary classifier, and a multi-class classifier.

3. The false alarm reduction system of claim 2 , wherein the numeral features comprise features selected from the group consisting of an autoencoder output, features from intermediate layers of one or more pre-trained deep neural networks, scale invariant feature transform features, and histogram of Gabor functions features.

4. The false alarm reduction system of claim 1 , wherein the classifier computes the classification outcome using a one-class classifier selected from the group consisting of a one-class Support Vector Machine classifier and a Nearest-Neighbor classifier.

5. The false alarm reduction system of claim 4 , wherein the classifier is trained by using as training examples defects generated by the defect detection system over a set of images known to be defect free.

6. The false alarm reduction system of claim 1 , wherein the classifier computes the classification outcome using a classifier selected from the group consisting of a binary classifier and a multi-class classifier.

7. The false alarm reduction system of claim 1 , wherein the classifier comprises an object selected from the group consisting of a Support Vector Machine and a deep neural network.

8. The false alarm reduction system of claim 7 , wherein the classifier is trained by using as training examples all defects generated by the defect detection system over a set of images known to be free of defects, combined with examples known to include true defects.

9. The false alarm reduction system of claim 8 , wherein the true defects are obtained by operating the false alarm reduction system without false alarm reduction for a period of time.

10. The false alarm reduction system of claim 1 , wherein the defect detection system further includes a correction element for performing a corrective action responsive to the classification outcome being the true defect.

11. A false alarm reduction method for reducing false alarms in an automatic defect detection system, the false alarm reduction method comprising:

generating, by a defect detection system, a list of image boxes marking detected potential defects in an input image;

transforming, by a feature extractor, each of the image boxes in the list into a respective set of numerical features; and

computing, by a classifier, as a classification outcome for the each of the image boxes whether the detected potential defect is a true defect or a false alarm responsive to respective values of the respective set of numerical features for each of the image boxes.

12. The false alarm reduction method of claim 11 , wherein the list of boxes marking the potential defects are generated using at least one object selected from the group consisting of an contextual autoencoder, a deep autoencoder, a one-class Support Vector Machine, a nearest neighbor classifier, a binary classifier, and a multi-class classifier.

13. The false alarm reduction method of claim 12 , wherein the numeral features comprise features selected from the group consisting of an autoencoder output, features from intermediate layers of one or more pre-trained deep neural networks, scale invariant feature transform features, and histogram of Gabor functions features.

14. The false alarm reduction method of claim 11 , wherein the classifier computes the classification outcome using a one-class classifier selected from the group consisting of a one-class Support Vector Machine classifier and a Nearest-Neighbor classifier.

15. The false alarm reduction method of claim 14 , further comprising training the classifier by using as training examples defects generated by the defect detection system over a set of images known to be defect free.

16. The false alarm reduction method of claim 11 , wherein the classifier computes the classification outcome using a classifier selected from the group consisting of a binary classifier and a multi-class classifier.

17. The false alarm reduction method of claim 11 , wherein the classifier comprises an object selected from the group consisting of a Support Vector Machine and a deep neural network.

18. The false alarm reduction method of claim 17 , further comprising training the classifier by using as training examples all defects generated by the defect detection system over a set of images known to be free of defects, combined with examples known to include true defects.

19. The false alarm reduction method of claim 18 , wherein the true defects are obtained by operating the false alarm reduction system without false alarm reduction for a period of time.

20. The false alarm reduction method of claim 11 , further comprising performing a corrective action responsive to the classification outcome being the true defect.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2021
From: NEC LABORATORIES AMERICA, INC.
To: NEC CORPORATION
Reel/Frame 056570/0807 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2019
From: NICULESCU-MIZIL, ALEXANDRU; MIN, RENQIANG; COSATTO, ERIC; LAI, FARLEY; GRAF, HANS PETER; FONTAINE, XAVIER
To: NEC LABORATORIES AMERICA, INC.
Reel/Frame 048025/0091 →
Continuity (3)
Provisional Application 62642050 · Mar 13, 2018
Provisional Application 62626308 · Feb 5, 2018
Related Publication 20190244513A1 · Aug 8, 2019
Cited By (1)
US 12,482,085