IP Library › Granted Patent US 11,842,556
Granted Patent B2
US 11,842,556 · App. 17/352,488 · Granted Dec 12, 2023

Image analysis method, apparatus, program, and learned deep learning algorithm

Inventors: Yosuke Sekiguchi (Kobe, JP); Kazumi Hakamada (Kobe, JP); Yuki Aihara (Kobe, JP); Kohei Yamada (Kobe, JP); Kanako Masumoto (Kobe, JP); Krupali Jain (Kobe, JP)
Assignee: SYSMEX CORPORATION
G06V20/698G06T7/0014G06T7/74G06T7/90G06V10/44G06V10/56G06T2207/20084G06T2207/30024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,842,556
App. No.
17/352,488
Granted
Dec 12, 2023
Kind
B2
Abstract

The present invention provides an image analysis method for generating data indicating a region of a cell nucleus in an image of a tissue or a cell. The image analysis method is a method for analyzing an image of a tissue or a cell using a deep learning algorithm of a neural network structure, and generates data indicating a region of a cell nucleus in an analysis target image by the deep learning algorithm by generating analysis data from the analysis target image including an analysis target tissue or cell, and inputting the analysis data in the deep learning algorithm.

Claims (37)

1. An image analysis method for analyzing an image of a tissue or a cell to be analyzed using a deep learning algorithm of a neural network structure, the method comprising:

generating analysis data from an analysis target image that include the tissue or the cell to be analyzed;

inputting the analysis data to the deep learning algorithm, and

generating data indicating a region of a cell nucleus in the analysis target image by the deep learning algorithm,

wherein training data used for learning of the deep learning algorithm are generated based on a bright field image of a tissue specimen or a sample containing a cell captured under a bright field microscope and a fluorescence image of a cell nucleus in the same tissue specimen or the same sample prepared by applying fluorescent nuclear stain to the same tissue specimen or the same sample for fluorescence observation by a fluorescence microscope, wherein the fluorescence image is converted to binary data indicating which part of the fluorescence image is the cell nucleus region, and

the analysis target image is a bright field image.

2. The image analysis method according to claim 1 , wherein

the analysis target image is an image of a tissue diagnostic sample, and the analysis target image includes a hue comprised of one primary color or a hue obtained by combining two or more primary colors.

3. The image analysis method according to claim 1 , wherein

the analysis target image is an image of a cell diagnostic sample, and the analysis target image includes a hue comprised of one primary color or a hue obtained by combining two or more primary colors.

4. The image analysis method according to according to claim 1 , wherein

the deep learning algorithm determines whether an arbitrary position in the analysis target image is a region of a cell nucleus.

5. The image analysis method according to claim 1 , wherein

analysis data are generated for each region of the predetermined number of pixels including peripheral pixels circumscribing a predetermined pixel; and

the deep learning algorithm generates a label indicating whether the predetermined pixel is one of the region of the cell nucleus.

6. The image analysis method according to claim 1 , wherein

a number of nodes of the input layer of the neural network corresponds to a product of the predetermined number of pixels of the analysis data and a number of combined primary colors.

7. The image analysis method according to claim 2 , wherein

the tissue diagnostic sample is a stained sample, and the analysis target image is an image obtained by imaging the stained sample under a bright field microscope.

8. The image analysis method according to claim 2 , wherein

the cell diagnostic sample is a stained sample, and the analysis target image is an image obtained by imaging the stained sample under a bright field microscope.

9. The image analysis method according to claim 7 , wherein

a stain for bright-field observation comprises hematoxylin-eosin.

10. The image analysis method of claim 8 , wherein

a stain for bright field observation is Papanicolaou.

11. The image analysis method according to claim 1 , wherein

the deep learning algorithm classifies the analysis data into classes indicating a region of a cell nucleus contained in the analysis target image.

12. The image analysis method according to claim 1 , wherein

an output layer of the neural network comprises a node having a softmax function as an activation function.

13. The image analysis method according to claim 1 , further comprising

outputting a cell nucleus region weighted image that the region of the cell nucleus is superimposed on the analysis target image.

14. An image analysis apparatus for analyzing an image of a tissue or a cell using a deep learning algorithm of a neural network structure, the apparatus comprising a system configured to:

generating analysis data from an analysis target image that include the tissue or the cell to be analyzed;

inputting the analysis data to the deep learning algorithm, and

generating data indicating a region of a cell nucleus in the analysis target image by the deep learning algorithm,

wherein training data used for learning of the deep learning algorithm are generated based on a bright field image of a tissue specimen or a sample containing a cell captured under a bright field microscope and a fluorescence image of a cell nucleus in the same tissue specimen or the same sample prepared by applying fluorescent nuclear stain to the same tissue specimen or the same sample for fluorescence observation by a fluorescence microscope, wherein the fluorescence image is converted to binary data indicating which part of the fluorescence image is the cell nucleus region, and

the analysis target image is a bright field image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2021
From: SEKIGUCHI, YOSUKE; HAKAMADA, KAZUMI; AIHARA, YUKI; YAMADA, KOHEI; MASUMOTO, KANAKO; JAIN, KRUPALI
To: SYSMEX CORPORATION
Reel/Frame 056599/0581 →
Priority Claims (1)
JP 2017-222178 · Nov 17, 2017 · national
Continuity (2)
Continuation 16193422 · Nov 16, 2018
Related Publication 20210312627A1 · Oct 7, 2021
Cited By (1)
US 12,333,726