IP Library Granted Patent US 10,013,757
Granted Patent B2
US 10,013,757 · App. 15/113,644 · Granted Jul 3, 2018

Classification apparatus for pathologic diagnosis of medical image, and pathologic diagnosis system using the same

Inventors: Hyo-eun Kim (Seoul, KR); Sang-heum Hwang (Seoul, KR); Seung-wook Paek (Seoul, KR); Jung-in Lee (Seoul, KR); Min-hong Jang (Seoul, KR); Dong-geun Yoo (Daejeon, KR); Kyung-hyun Paeng (Busan, KR); Sung-gyun Park (Gyeonggi-do, KR)
Assignee: LUNIT INC.
G06T7/0012G06F17/30244G06F19/321G06K9/481G06K9/6267G06K9/66G06N99/005G06T7/11A61B8/0825G06F19/345G06K2209/05G06T2207/20021G06T2207/20081G06T2207/30096G16H50/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,013,757
App. No.
15/113,644
Granted
Jul 3, 2018
Kind
B2
Abstract

The present invention relates to a classification apparatus for pathologic diagnosis of a medical image and a pathologic diagnosis system using the same. According to the present invention, there is provided a classification apparatus for pathologic diagnosis of a medical image, including: a feature extraction unit configured to extract feature data for an input image using a feature extraction variable; a feature vector transformation unit configured to transform the extracted feature data into a feature vector using a vector transform variable; and a vector classification unit configured to classify the feature vector using a classification variable, and to output the results of the classification of pathologic diagnosis for the input image; wherein the feature extraction unit, the feature vector transformation unit and the vector classification unit are trained based on a first tagged image, a second tagged image, and an image having no tag information.

Claims (36)

1. A classification apparatus for pathologic diagnosis of medical image, comprising:

a processor; and

a non-transitory storage medium having program instructions stored thereon, execution of which by the processor causes the classification apparatus to provide functions of:

a feature extraction unit configured to extract feature data for an input image using a feature extraction variable;

a feature vector transformation unit configured to transform the extracted feature data into a feature vector using a vector transform variable; and

a vector classification unit configured to classify the feature vector using a classification variable, and to output results of the classification of pathologic diagnosis for the input image;

wherein the feature extraction unit, the feature vector transformation unit and the vector classification unit are trained based on a first tagged image having a first tag indicative of presence or absence of a lesion and pathologic diagnosis information, a second tagged image having a first tag as well as a second tag indicative of location information of the lesion, and an image having no tag, and

wherein the feature extraction variable is trained based on the second tagged image; the transform variable is trained based on at least one of the first tagged image, the second tagged image and the image having no tag; and the classification variable is trained based on at least one of the first tagged image and the second tagged image.

2. The apparatus of claim 1 , wherein:

the feature extraction unit receives the plurality of patch images obtained by segmenting the input image, and extracts feature data for each of the patch images using the feature extraction variable;

the feature vector transformation unit transforms the feature data for the patch images into a fixed length feature vector using the transform variable; and

the vector classification unit classifies the fixed length feature vector using the classification variable, and outputs results of classification of pathologic diagnosis for the input image.

3. A pathologic diagnosis system, comprising:

the classification apparatus for pathologic diagnosis of a medical image set forth in claim 1 ;

another processor; and

another non-transitory storage medium having program instructions stored thereon, execution of which by the another processor causes the pathologic diagnosis system to provide functions of:

a testing module configured to output final analysis information for an input image based on results of pathologic diagnosis output for the input image by the apparatus for classification of pathologic diagnosis of a medical image;

a training module configured to train the apparatus for classification of pathologic diagnosis of a medical image based on tagged images stored in a tagged image database; and

a tagged image database configured to store tagged images, including first tagged images each having a first tag indicative of presence or absence of a lesion and pathologic diagnosis information, and second tagged images each having a second tag indicative of location information of a lesion as well as a first tag.

4. The system of claim 3 , wherein:

the training module:

generates patch images that are partial images of the input image input to the feature extraction unit, and separates the patch images into data for training and data for verification; and

adjusts the feature extraction variable of the feature extraction unit by repeating a process of adjusting the feature extraction variable and the classification variable so that a cost function is minimized for the data for training until a time at which the cost function for the data for verification is minimized.

5. The system of claim 4 , wherein:

the training module:

sets initial values of the feature extraction variable and the classification variable; and

adjusts the feature extraction variable and the classification variable by repeating i) a first process of calculating feature data and results of the classification based on a current feature extraction variable and a current classification variable, ii) a second process of calculating costs for the feature extraction variable and the classification variable using cost functions, and iii) a third process of calculating variations of the feature extraction variable and the classification variable so that the costs are minimized, calculating differences with respect to an existing feature extraction variable and an existing classification variable, and updating the feature extraction variable and the classification variable.

6. The system of claim 5 , wherein the training module extracts a plurality of pieces of feature data by inputting the plurality of patch images for the input image to the feature extraction unit, and estimates the transform variable adapted to transform the feature data into a fixed length feature vector, thereby enabling the feature vector transformation unit to be trained.

7. The system of claim 2 , wherein:

the training module:

generates patch images that are partial images of the input image, and separates the patch images into data for learning and data for verification; and

adjusts the classification variable of the vector classification unit by repeating a process of adjusting the classification variable so that a cost function is minimized for the data for training until a time at which a cost function for the data for verification is minimized.

8. The system of claim 7 , wherein:

the training module:

sets an initial value of the classification variable; and

adjusts the classification variable by repeating i) a first process of calculating results of the classification based on a current classification variable, ii) a second process of calculating a cost for the classification variable using a cost function, and iii) a third process of calculating a variation of the classification variable so that the cost is minimized, calculating a difference with respect to an existing classification variable, and updating the classification variable.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2016
From: KIM, HYO-EUN; HWANG, SANG-HEUM; PAEK, SEUNG-WOOK; LEE, JUNG-IN; JANG, MIN-HONG; YOO, DONG-GEUN; PAENG, KYUNG-HYUN; PARK, SUNG-GYUN
To: LUNIT INC.
Reel/Frame 039232/0906 →
Priority Claims (1)
KR 10-2015-0111277 · Aug 6, 2015 · national
Continuity (1)
Related Publication 20170236271A1 · Aug 17, 2017
Cited By (1)
US 12,260,952