IP Library › Granted Patent US 11,023,765
Granted Patent B2
US 11,023,765 · App. 15/837,848 · Granted Jun 1, 2021

Apparatus and method for providing additional information for each region of interest

Inventors: Chon Hee Lee (Nonsan-si, KR); Yeong Kyeong Seong (Yongin-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06K9/46A61B8/06A61B8/469A61B8/485A61B8/5246A61B8/5261G06T7/0012A61B8/0825A61B8/4416A61B8/461G06T2207/10081G06T2207/10088G06T2207/10116G06T2207/10132G06T2207/20104
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,023,765
App. No.
15/837,848
Granted
Jun 1, 2021
Kind
B2
Abstract

An apparatus and method for providing additional information for region of interest. The apparatus includes a region of interest extractor configured to extract regions of interest from a first medical image and at least one second medical image, a region of interest merger configured to merge a region of interest of the at least one second medical image into the first medical image, an additional information determiner configured to determine additional information required for each region of interest, and an additional information provider configured to provide the determined additional information for the each region of interest.

Claims (62)

1. An apparatus for providing additional information for region of interest, the apparatus comprising:

a memory configured to store instructions; and

at least one processor electrically connected to the memory,

wherein the at least one processor, upon executing the stored instructions, is configured to:

detect one or more regions of interest from a first medical image of a patient,

detect one or more regions of interest from a second medical image of the patient,

extract one or more features of each of the one or more regions of interest detected from the first medical image based on the one or more regions of interest detected from the first medical image and the one or more regions of interest detected from the second medical image,

determine additional information needed for a diagnosis of each of the one or more regions of interest detected from the first medical image based on the one or more features extracted from each of the one or more regions of interest,

provide the determined additional information, and

at least one of:

acquire the determined additional information for each of the one or more regions of interest by changing an imaging mode of an ultrasonic imaging device based on the determined additional information, or

control a display to display a message for notifying a user of an imaging mode, needed to acquire the determined additional information, of the ultrasonic imaging device, and change the imaging mode of the ultrasonic imaging device based on a user's selection,

wherein the determined additional information comprises examination-related information of the patient previously stored in a medical database.

2. The apparatus of claim 1 , further comprising:

a display configured to display the determined additional information.

3. The apparatus of claim 2 ,

wherein the determined additional information is displayed as a hyperlink at a bottom of each of the one or more regions of interest, and

wherein the at least one processor, upon executing the stored instructions, is further configured to provide the determined additional information on a region of interest, among the one or more regions of interest, corresponding to a hyperlink selected by a user through the display.

4. The apparatus of claim 1 ,

wherein the at least one processor, upon executing the stored instructions, is further configured to merge the one or more regions of interest detected from the second medical image into the first medical image, and

wherein the second medical image comprises one or more medical images captured prior to the first medical image.

5. The apparatus of claim 4 , wherein the first medical image and the second medical image are captured by different modalities.

6. The apparatus of claim 4 , wherein the second medical image comprises one or more images of a portion identical to a portion captured by the first medical image.

7. The apparatus of claim 1 , further comprising:

a memory configured to store at least one rule that defines features of regions of interest and at least one additional information required for the features.

8. The apparatus of claim 7 , wherein the at least one processor, upon executing the stored instructions, is further configured to:

retrieve at least one rule from the stored at least one rule based on the one or more features extracted from each of the one or more regions of interest; and

determine the additional information based on the retrieved at least one rule.

9. The apparatus of claim 1 , wherein the at least one processor, upon executing the stored instructions, is further configured to acquire the determined additional information.

10. The apparatus of claim 9 , wherein the apparatus is configured to be installed in an ultrasonic imaging device comprising at least two imaging modes of:

a bloodstream imaging mode for obtaining a bloodstream image,

an elastography mode for obtaining an elastography image,

a general ultrasonic mode for obtaining a general ultrasonic mode, or

a high-resolution ultrasonic mode for obtaining a high-resolution ultrasonic image.

11. The apparatus of claim 1 , wherein the determined additional information further comprises:

new additional information that refers to information associated with examinations to be additionally conducted.

12. A method for providing additional information for region of interest, the method comprising:

detecting one or more regions of interest from a first medical image of a patient;

detecting one or more regions of interest from a second medical image of the patient;

extracting one or more features of each of the one or more regions of interest detected from the first medical image based on the one or more regions of interest detected from the first medical image and the one or more regions of interest detected from the second medical image;

determining additional information needed for a diagnosis of each of the one or more regions of interest detected from the first medical image based on the one or more features extracted from each of the one or more regions of interest

providing, via a user interface, the determined additional information, the determined additional information comprises examination-related information of the patient previously stored in a medical database; and

at least one of acquiring the determined additional information for each of the one or more regions of interest by changing an imaging mode of an ultrasonic imaging device based on the determined additional information, or controlling a display to display a message for notifying a user of an imaging mode, needed to acquire the determined additional information, of the ultrasonic imaging device, and changing the imaging mode of the ultrasonic imaging device based on a user's selection.

13. The method of claim 12 , wherein the providing of the additional information comprises:

displaying the determined additional information as a hyperlink at a bottom of each of the one or more regions of interest; and

providing the determined additional information on a region of interest, among the one or more regions of interest, corresponding to a hyperlink selected by a user.

14. The method of claim 12 , further comprising:

merging the one or more regions of interest detected from the second medical image into the first medical image,

wherein the second medical image comprises one or more medical images captured prior to the first medical image.

15. The method of claim 14 , wherein the first medical image and the second medical image are captured by different modalities.

16. The method of claim 12 , wherein the determining of the additional information comprises:

retrieving at least one rule from among one or more pre-stored rules based on the one or more features extracted from each of the one or more regions of interest; and

determining the additional information based on the retrieved at least one rule.

17. The method of claim 12 , wherein the determined additional information further comprises:

new additional information that refers to information associated with examinations to be additionally conducted.

18. A computer program product comprising a non-transitory computer-readable recording medium having recorded thereon at least one program comprising commands, which when executed by a computer, performs a method, the method comprising:

detecting one or more regions of interest from a first medical image of a patient;

detecting one or more regions of interest from a second medical image of the patient;

extracting one or more features of each of the one or more regions of interest detected from the first medical image based on the one or more regions of interest detected from the first medical image and the one or more regions of interest detected from the second medical image;

determining additional information needed for a diagnosis of each of the one or more regions of interest detected from the first medical image based on the one or more features extracted from each of the one or more regions of interest;

providing, via a user interface, the determined additional information, the determined additional information comprises examination-related information of the patient previously stored in a medical database; and

at least one of acquiring the determined additional information for each of the one or more regions of interest by changing an imaging mode of an ultrasonic imaging device based on the determined additional information, or controlling a display to display a message for notifying a user of an imaging mode, needed to acquire the determined additional information, of the ultrasonic imaging device, and changing the imaging mode of the ultrasonic imaging device based on a user's selection.

Priority Claims (1)
KR 10-2014-0052823 · Apr 30, 2014 · national
Continuity (2)
Continuation 14700338 · Apr 30, 2015
Related Publication 20180114086A1 · Apr 26, 2018