IP Library › Granted Patent US 10,453,570
Granted Patent B1
US 10,453,570 · App. 16/190,598 · Granted Oct 22, 2019

Device to enhance and present medical image using corrective mechanism

Inventors: Christine I. Podilchuk (Warren, NJ); Richard Mammone (Warren, NJ)
Assignee: SONAVISTA, INC.
G16H30/40G06T7/0012G06K9/4661G06K2209/05G06T5/002G06T5/003G06T5/006G06T7/90G06T2207/10004G06T2207/10024G06T2207/10081G06T2207/10088G06T2207/10104G06T2207/10116G06T2207/10132G06T2207/20076G06T2207/20104G06T2207/20201G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,453,570
App. No.
16/190,598
Granted
Oct 22, 2019
Kind
B1
Abstract

A device to enhance and present a medical image using a corrective mechanism is described. An image analysis application executed by the device captures a digital copy of the medical image displayed on a display device. A flawed photography effect associated with the digital copy is identified by processing the digital copy. Next, the digital copy is enhanced based on the flawed photography effect. Furthermore, the enhanced digital copy can be processed with an artificial intelligence mechanism to generate an annotation. The annotation is associated with a cancer identification. In addition, the enhanced digital copy and the annotation are displayed.

Claims (64)

1. A device to enhance and present a medical image using a corrective mechanism, wherein the device performs one or more operations comprising:

receiving a digital copy from a camera, wherein the camera captured the digital copy of the medical image displayed on a monitor, and wherein the monitor is external to the camera;

identifying a flawed photography effect associated with the digital copy by processing the digital copy using a deep learning mechanism performed by a computer analysis and correction module (CACM);

enhancing the digital copy using the deep learning mechanism performed by the CACM based on the flawed photography effect;

processing the enhanced digital copy using the deep learning mechanism performed by the CACM to generate an annotation, wherein the annotation is associated with a cancer identification; and

displaying one or more of the enhanced digital copy and the annotation overlaid by an augmented reality mechanism on to the monitor displaying the medical image.

2. The device of claim 1 , wherein

the camera includes a polarizer to reduce one or more of a reflection effect and a glare effect associated with capturing the digital copy of the medical image.

3. The device of claim 1 , wherein the device performs one or more additional operations comprising:

analyzing one or more non-image information associated with the digital copy and the camera using the deep learning mechanism performed by the CACM, wherein the non-image information includes one or more of a flash information, a focal length, a shutter speed, a camera model information, an aperture setting, and a capture date and time information;

identifying the flawed digital effect from the one or more analyzed non-image information using the deep learning mechanism performed by the CACM; and

enhancing the digital copy to correct the flawed digital effect using the deep learning mechanism performed by the CACM.

4. The device of claim 1 , wherein the device performs one or more additional operations comprising:

analyzing one or more image characteristic information associated with the digital copy using the deep learning mechanism performed by the CACM, wherein the one or more characteristic information includes an orientation, a red-eye detection, a blur, a color balance, an exposure, and a noise information;

identifying the flawed digital effect from the one or more analyzed characteristic information using the deep learning mechanism performed by the CACM; and

enhancing the digital copy to correct the flawed digital effect using the deep learning mechanism performed by the CACM.

5. The device of claim 1 , wherein the mobile device performs one or more additional operations comprising:

identifying a region of interest (ROI) within the digital copy automatically using the deep learning mechanism performed by the CACM; and

processing the ROI to identify the flawed photography effect using the deep learning mechanism performed by the CACM.

6. The device of claim 1 , wherein the mobile device performs one or more additional operations comprising:

receiving a selection of a region of interest (ROI) within the digital copy from a user using the deep learning mechanism performed by the CACM; and

processing the ROI to identify the flawed photography effect using the deep learning mechanism performed by the CACM.

7. The device of claim 1 , wherein the mobile device performs one or more additional operations comprising:

identifying a glare effect within the digital copy as the flawed photography effect using the deep learning mechanism performed by the CACM; and

enhancing the digital copy to correct the flawed photography effect using the deep learning mechanism performed by the CACM.

8. The device of claim 1 , wherein the mobile device performs one or more additional operations comprising:

identifying a reflection effect within the digital copy as the flawed photography effect using the deep learning mechanism performed by the CACM; and

enhancing the digital copy to correct the flawed photography effect using the deep learning mechanism performed by the CACM.

9. The device of claim 1 , wherein the mobile device performs one or more additional operations comprising:

identifying a moiré pattern within the digital copy as the flawed photography effect using the deep learning mechanism performed by the CACM; and

enhancing the digital copy to correct the flawed photography effect using the deep learning mechanism performed by the CACM.

10. The device of claim 1 , wherein the mobile device performs one or more additional operations comprising:

identifying a geometric distortion within the digital copy as the flawed photography effect using the deep learning mechanism performed by the CACM; and

enhancing the digital copy to correct the flawed photography effect using the deep learning mechanism performed by the CACM.

11. The device of claim 1 , wherein the mobile device performs one or more additional operations comprising:

identifying a noise within the digital copy as the flawed photography effect using the deep learning mechanism performed by the CACM; and

enhancing the digital copy to correct the flawed photography effect using the deep learning mechanism performed by the CACM.

12. The device of claim 1 , wherein the mobile device performs one or more additional operations comprising:

identifying a light exposure issue as the flawed photography effect using the deep learning mechanism performed by the CACM; and

enhancing the digital copy to correct the flawed photography effect using the deep learning mechanism performed by the CACM.

13. The device of claim 1 , wherein the mobile device performs one or more additional operations comprising:

providing a color map of a region of interest (ROI) within the digital copy as the annotation using the deep learning mechanism performed by the CACM, wherein the color map describes a probability of a malignancy associated with the ROI.

14. The device of claim 1 , wherein the mobile device performs one or more additional operations comprising:

identifying a motion blur as the flawed photography effect using the deep learning mechanism performed by the CACM; and

enhancing the digital copy to correct the flawed photography effect using the deep learning mechanism performed by the CACM.

15. A mobile device for enhancing and presenting a medical image using a corrective mechanism, the mobile device comprising:

a display component configured to accept an input and display an output associated with an image analysis application,

a camera component configured to capture a first digital copy of the medical image displayed on a monitor in relation to the image analysis application, wherein the camera component is external to the monitor,

a memory configured to store instructions associated with the image analysis application,

a processor coupled to the display component, the camera component, and the memory, the processor executing the instructions associated with the image analysis application, wherein the image analysis application includes:

a computer analysis and correction module (CACM) performing one or more operations comprising:

receiving a first digital copy of the medical image from the camera component;

identifying a flawed photography effect associated with the first digital copy by processing the first digital copy using a deep learning mechanism;

enhancing the first digital copy based on the flawed photography effect using the deep learning mechanism;

processing the first digital copy using the deep learning mechanism to generate an annotation, wherein the annotation includes one of a suspicious label, a not suspicious label, and a follow-up label associated with a cancer identification; and

displaying the first digital copy and the annotation overlaid by an augmented reality mechanism on to the monitor displaying the medical image.

16. The mobile device of claim 15 , wherein the medical image includes one of an ultrasound scan, a x-ray scan, a magnetic resonance imaging (MRI) scan, a computed tomography (CT) scan, and a positron emission tomography (PET) scan.

17. The mobile device of claim 15 , wherein the flawed photography effect is identified by processing a second digital copy of the medical image using the deep learning mechanism, wherein the second digital copy is received from the camera component.

18. A method of enhancing and presenting a medical image using a corrective mechanism, the method comprising:

receiving a digital copy of the medical image displayed on a monitor, wherein the digital copy is captured by an image source, wherein the monitor is external to the image source;

identifying a flawed photography effect associated with the digital copy by processing the digital copy using a deep learning mechanism;

enhancing the digital copy based on the flawed photography effect using the deep learning mechanism;

processing the digital copy using the deep learning mechanism to generate an annotation, wherein the annotation includes one of a suspicious label, a not suspicious label, and a follow-up label associated with a cancer identification; and

providing the digital copy and the annotation for a presentation overlaid by an augmented reality mechanism on to the monitor displaying the medical image.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2019
From: SONAVISTA, INC.
To: RUTGERS, THE STATE UNIVERSITY OF NEW JERSEY
Reel/Frame 051195/0334 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2018
From: PODILCHUK, CHRISTINE I.; MAMMONE, RICHARD
To: SONAVISTA, INC.
Reel/Frame 047500/0585 →
Continuity (2)
Provisional Application 62680230 · Jun 4, 2018
Provisional Application 62690008 · Jun 26, 2018