IP Library › Patent Application 16218832
Patent Application
App. No. 16/218,832

OBJECT DETECTION IN MEDICAL IMAGE

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
16/218,832
Abstract

A device to detect an object in a medical image is described. An image analysis application, executed by the device, receives the medical image as an input. The medical image is next partitioned to sub-regions. Parts of the object are detected in a selection of the sub-regions using a deep-learning neural network (DNN) model. Bounding boxes for the selection are also determined. The bounding boxes are evaluated based on a confidence score detected as above a threshold level. The confidence score designates the parts as contained within the selection. Next, a region of interest (ROI) is determined as a group including the selection. Similar orientations associated with the bounding boxes are comparable to similar orientations of a positive training model of the DNN model. Furthermore, the selection is designated as the ROI within the medical image. The medical image is provided with the ROI to a user.

Claims (56)

1 . A method to detect an object in a medical image, the method comprising:

receiving the medical image as an input;

partitioning the medical image into sub-regions;

detecting parts of an object in a selection of the sub-regions using a deep-learning neural network (DNN) model;

determining bounding boxes for the selection, wherein each of the bounding boxes are evaluated based on a confidence score detected as above a threshold level, and wherein the confidence score designates the parts as contained within the selection;

determining a region of interest (ROI) as a group comprising the selection, wherein similar orientations associated with the bounding boxes are comparable to similar orientations of a positive training model of the DNN model;

designating the selection as the ROI within the medical image; and

providing the medical image with the ROI to a user;

wherein the partitioning and detecting steps are performed before the determining steps, designating step, and providing step.

2 . The method of claim 1 , wherein the similar orientations associated with the bounding boxes include similar angular orientations between the parts of the object.

3 . The method of claim 1 , wherein the similar orientations include similar distances between the parts of the object.

4 . The method of claim 1 , further comprising:

applying a non-maximum suppression (NMS) mechanism to the selection to obtain a set of object bounding boxes.

5 . The method of claim 1 , wherein the DNN model associated with a detection of the parts of the object includes a region based convolutional neural network (R-CNN) model, a fast R-CNN model, a faster R-CNN model, a you only look once (YOLO) model, or a single shot multi-box (SSD) model.

6 . The method of claim 1 , wherein the sub-regions within the ROI are labelled with one or more annotations associated with a type of tissue.

7 . The method of claim 6 , wherein the type of tissue includes lobulated, spiculated, angular, clear boundary, oval, circumscribed, or abrupt interface.

8 . The method of claim 6 , wherein the one or more annotations include a relative position associated with a part of the object, and wherein the relative position includes top, bottom, left side, or right side.

9 . The method of claim 6 , further comprising:

providing a user interface associated with the ROI, wherein the user interface is configured to allow the user to change the one or more annotations associated with the ROI.

10 . The method of claim 9 , further comprising:

detecting the user providing a change to the one or more annotations to personalize the one or more annotations to the user; and

identifying a rate of concordance of the user in relation to the DNN model.

11 . The method of claim 10 , further comprising:

determining the concordance rate of the user as above a threshold;

re-training the DNN model based on the change to the one or more annotations;

re-processing the selection based on the change to the one or more annotations; and

re-labelling the sub-regions of the ROI based on the change to the one or more annotations to personalize the one or more annotations to one or more preferences of the user.

12 . The method of claim 10 , further comprising:

determining the concordance rate of the user as below a threshold;

rejecting the change to the one or more annotations; and

providing a notification to the user to re-evaluate the change to the one or more annotations.

13 . The method of claim 1 , wherein the ROI includes a lesion.

14 . The method of claim 1 , wherein a training mechanism associated with the DNN model includes a compensation for an unbalanced training data consisting of a majority of training medical images with no lesion and a minority of training medical images with a lesion, and wherein the training mechanism includes a down-sampling of the majority, an up-sampling of the minority, or a utilization of a cost sensitive mechanism, a gradient boost machine, or a hard negative mining mechanism.

15 . A device to detect an object in a medical image, wherein the device is configured to:

receive the medical image as an input;

partition the medical image into sub-regions;

detect parts of the object in a selection of the sub-regions using a deep-learning neural network (DNN) model;

determine bounding boxes for the selection, wherein each of the bounding boxes are evaluated based on a confidence score detected as above a threshold level, and wherein the confidence score designates the parts as contained within the selection;

determine a region of interest (ROI) as a group comprising the selection, wherein similar orientations associated with the bounding boxes are comparable to similar orientations of a positive training model of the DNN model;

designate the selection as the ROI within the medical image;

label the selection within the ROI with one or more annotations associated with a type of tissue, wherein the type of tissue includes lobulated, spiculated, angular, clear boundary, oval, circumscribed, or abrupt interface; and

provide the medical image with the one or more annotations and the ROI to a user;

wherein the partitioning and detecting steps are performed before the determining steps, designating step, labeling step, and providing step.

16 . A device for detecting an object in a medical image, the device comprising:

a memory configured to store instructions associated with an image analysis application,

a processor coupled to the memory, the processor executing the instructions associated with the image analysis application, wherein the image analysis application includes:

a computer assisted detection module configured to:

receive the medical image as an input;

partition the medical image into sub-regions;

detect parts of the object in a selection of the sub-regions using a deep-learning neural network (DNN) model;

determine bounding boxes for the selection, wherein each of the bounding boxes are evaluated based on a confidence score detected as above a threshold level, and wherein the confidence score designates the parts as contained within the selection;

determine a region of interest (ROI) as a group comprising the selection, wherein similar orientations associated with the bounding boxes are comparable to similar orientations of a positive training model of the DNN model;

designate the selection as the ROI within the medical image;

label the selection within the ROI with one or more annotations associated with a type of tissue, wherein the type of tissue includes lobulated, spiculated, angular, clear boundary, oval, circumscribed, or abrupt interface; and

provide the medical image with the one or more annotations and the ROI to a user;

wherein the partitioning and detecting steps are performed before the determining steps, designating step, labeling step, and providing step.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2019
From: SONAVISTA, INC.
To: RUTGERS, THE STATE UNIVERSITY OF NEW JERSEY
Reel/Frame 051195/0334 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2018
From: PODILCHUK, CHRISTINE I; MAMMONE, RICHARD
To: SONAVISTA, INC.
Reel/Frame 047765/0659 →