IP Library Granted Patent US 10,674,972
Granted Patent B1
US 10,674,972 · App. 16/150,436 · Granted Jun 9, 2020

Object detection in full-height human X-ray images

Inventors: Vadzim A. Piatrou (Minsk, BY); Vladimir N. Linev (Minsk, BY); Iryna L. Slavashevich (Minsk, BY); Dmitry V. Pozdnyakov (Minsk, BY)
Assignee: Adani Systems, Inc.
A61B6/4208A61B6/461G01N23/04G01T1/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,674,972
App. No.
16/150,436
Granted
Jun 9, 2020
Kind
B1
Abstract

Detecting hidden objects on a human body includes acquiring an incoming X-ray image of the human body passing through a penetrating X-ray scanner; generating additional images based on the incoming image by performing logarithmic or saliency transformations or contrasting of the incoming image; obtaining maps for all objects and known object classes, the maps show which pixels correspond to objects or to background, by passing the incoming and the additional images through a neural network with a deep Segnet-U-Net architecture optimized for overlapping object detection with long skip connections before each downsampling layer of the neural network; using the maps, identifying unknown objects in the incoming image by recognizing all objects/objects of known classes, excluding previously classified objects from the known classes from segmented non-anatomic areas; segmenting the incoming image of the human body into multiple parts; and identifying parts containing objects belonging to both the known and unknown classes.

Claims (18)

1. A method for detecting and recognizing hidden objects on a human body, the method comprising:

acquiring an incoming X-ray image of the human body passing through a penetrating X-ray scanner;

generating additional images based on the incoming image by performing logarithmic or saliency transformations or contrasting of the incoming X-ray image;

obtaining maps for all objects and known object classes, wherein the maps show which pixels correspond to objects and which pixels correspond to background, by passing the incoming X-ray image and the additional images through a neural network with a deep Segnet-U-Net architecture that is optimized for overlapping object detection with long skip connections before each downsampling layer of the neural network;

using the maps, identifying unknown objects in the incoming X-ray image by recognizing all objects and objects of known classes, and excluding previously classified objects from the known classes from an entire set of segmented non-anatomic areas;

segmenting the incoming X-ray image into multiple parts; and

identifying parts containing objects belonging to both the known and to unknown classes.

2. The method of claim 1 , wherein the neural network is trained by:

using a dataset of images of people passing through the penetrating X-ray scanner and/or a different penetrating X-ray scanner;

generating additional images from the dataset of images by performing the logarithmic or saliency transformations of the dataset of images;

adding logarithmic brightness values of images of the dataset of images containing individual objects to logarithmic brightness values of original human images in order to enlarge the dataset of images with forbidden objects;

using parts of the original human images to train the neural network to improve recognition of objects;

using the neural network with the deep Segnet-U-Net architecture to identify known and unknown objects and the classes to which they belong; and

training the neural network using the dataset of images and maps for all objects and known classes in order to detect and classify previously unidentified classes of objects.

3. The method of claim 2 , further comprising using only those parts of images of human bodies that contain objects and excluding empty areas for neural network training in order to enhance the detection of objects on human bodies.

4. The method of claim 1 , further comprising using inpainting to conceal objects belonging to the known classes when displaying to an operator.

5. The method of claim 1 , further comprising separating the additional images into anatomic and non-anatomic areas so that only human body contours and foreign objects are displayed, while concealing the human body itself.

6. The method of claim 5 , wherein the separating uses segmentation of the additional images into separate anatomic areas so as to identify human body parts containing objects belonging to a class of prohibited objects.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF ASSIGNEE PREVIOUSLY RECORDED AT REEL: 059877 FRAME: 0690. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 22, 2022
From: LINEV SYSTEMS, INC.
To: LINEV SYSTEMS US, INC.
Reel/Frame 060403/0227 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2022
From: ADANI SYSTEMS, INC.
To: LINEV SYSTEMS, INC.
Reel/Frame 059877/0690 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2018
From: LINEV, VLADIMIR N.; PIATROU, VADZIM A.; SLAVASHEVICH, IRYNA L.; POZDNYAKOV, DMITRY V.
To: ADANI SYSTEMS, INC.
Reel/Frame 047050/0959 →
Cited By (3)
US 12,335,594 US 12,470,605 US 12,657,858