IP Library › Granted Patent US 12,394,170
Granted Patent B2
US 12,394,170 · App. 17/578,179 · Granted Aug 19, 2025

Cell image analysis method and cell image analyzer

Inventor: Wataru Takahashi (Kyoto, JP)
Assignee: SHIMADZU CORPORATION
G06V10/235C12M1/34C12Q1/04G06V10/46G06V10/70G06V10/774G06V20/69G06V20/695
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,394,170
App. No.
17/578,179
Granted
Aug 19, 2025
Kind
B2
Abstract

A cell image analysis method includes converting a first image into a label image by performing a segmentation process to identify a region of a cell that has already started differentiation and a region of an undifferentiated cell in the first image, acquiring a shape feature amount from the label image, and determining whether or not a cell colony includes a colony region that is a candidate for a search target based on the shape feature amount and a determination criterion.

Claims (34)

1. A cell image analysis method comprising:

acquiring a first image of a cell colony including a cell having differentiation potential;

converting the first image into a label image by performing a segmentation process to identify a colony region of a cell that has already started differentiation and a colony region of an undifferentiated cell in the cell colony in the first image;

acquiring a numerical value of a shape feature which is a numerical value that expresses a shape of the cell colony in the label image from the label image;

receiving an input regarding a colony region of a search target from a user using a computer;

setting a determination criterion for the numerical value of the shape feature based on the user's input; and

determining whether or not the cell colony includes a colony region that is a candidate for the search target based on the numerical value of the shape feature and the determination criterion,

wherein in the receiving of the input regarding the colony region of the search target, an input is received, from the user, of selection information as to whether or not the cell colony in an image group of the cell colony including cells having differentiation potential includes a desired colony region as a target for picking which is an extraction operation of the cell,

wherein the setting of the determination criterion includes setting the determination criterion based on the received selection information,

wherein the setting of the determination criterion includes creating a first trained model that has acquired the determination criterion for the numerical value of the shape feature by machine learning using the numerical value of the shape feature acquired from the label image of the first image as input data and the selection information as teaching data, and

wherein the determining of whether or not the cell colony includes the colony region that is the candidate for the search target includes inputting the numerical value of the shape feature acquired from the label image of the first image to the first trained model to generate a determination result.

2. The cell image analysis method according to claim 1 , wherein the receiving of the input of the selection information includes allowing the user to specify the colony region in the first image or the label image of the first image or allowing the user to pick the colony region.

3. The cell image analysis method according to claim 1 , wherein the numerical value of the shape feature includes the numerical value of the shape feature related to at least one of i) an entire region of the cell colony included in the label image, ii) the colony region of the undifferentiated cell included in the cell colony, or iii) the colony region of the cell that has started differentiation included in the cell colony.

4. The cell image analysis method according to claim 3 , wherein the numerical value of the shape feature includes at least one of i) an area of a region, ii) a contour length of the region, iii) a degree of circularity of the region, iv) an aspect ratio of a minimum circumscribed rectangle of the region, or v) an area ratio of the colony region to the entire region of the cell colony.

5. The cell image analysis method according to claim 1 , wherein the converting of the first image into the label image includes generating the label image by a second trained model configured to assign a segmentation result label to the colony region, using a microscope image of the cell colony as input data.

6. A cell picking method utilizing the cell image analysis method according to claim 1 , comprising:

setting picking coordinates of the colony region determined to be desired by the user based on a determination result as to whether or not the cell colony includes the colony region that is the candidate for the search target; and

picking a cell at the picking coordinates from a culture vessel.

7. A cell image analyzer comprising:

a storage configured to allow a microscope image of a cell colony including a cell having differentiation potential to be input thereto;

a processor configured to convert the microscope image into a label image by performing a segmentation process to identify a colony region of a cell that has already started differentiation and a colony region of an undifferentiated cell in the cell colony in the microscope image; and

an input configured to receive an input, from a user, regarding a colony region of a search target,

wherein the processor is further configured to determine whether or not the cell colony included in the microscope image includes the colony region that is a candidate for the search target,

wherein the processor is further configured to acquire a numerical value of a shape feature which is a numerical value that express a shape of the cell colony in the label image from the label image and determine a colony region based on the numerical value of the shape feature and a determination criterion for the numerical value of the shape feature set based on a user's input,

wherein the input is configured to receive an input, from the user, of selection information as to whether or not the cell colony in an image group of the cell colony including cells having differentiation potential includes a desired colony region as a target for picking which is an extraction operation of the cell,

wherein the processor is further configured to set the determination criterion based on the received selection information,

wherein the processor is further configured to create a first trained model that has acquired the determination criterion for the numerical value of the shape feature by machine learning using the numerical value of the shape feature acquired from the label image of the microscope image as input data and the selection information as teaching data, and

wherein the processor is further configured to input the numerical value of the shape feature acquired from the label image of the microscope image to the first trained model to generate a determination result, in determining whether or not the cell colony includes the colony region.

8. The cell image analysis method according to claim 1 , wherein

in the step of converting the first image into a label image, the first image is converted into the label image including a label region of the identified region among at least two label regions, the colony region of the undifferentiated cell and the colony region of the cell that has started differentiation,

in the step of determining whether or not the cell colony includes the colony region that is the candidate for the search target, for each of the cell colonies in the first image whether or not the colony regions that are candidates for the search target are included, based on the numerical values of the shape feature of the label regions obtained from the label image and the determination criterion input by the user by using the computer.

9. The cell image analysis method according to claim 1 , wherein

in the step of converting the first image into a label image, the first image is converted into the label image including a label region of the identified region among at least two label regions, the colony region of the undifferentiated cell and the colony region of the cell that has started differentiation, and

in the step of determining whether or not the cell colony includes the colony region that is the candidate for the search target, for each of the cell colonies in the first image whether or not the colony regions that are candidates for the search target are included, based on the numerical values of the shape feature of the label regions obtained from the label image and the determination criterion input by the user by using the computer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2022
From: TAKAHASHI, WATARU
To: SHIMADZU CORPORATION
Reel/Frame 059593/0446 →
Continuity (2)
Continuation PCTJP2019028268 · Jul 18, 2019
Related Publication 20220148282A1 · May 12, 2022
References Cited (24)
US 8902306B2 · Mimura et al. · 2014 [cited by applicant]
US 20150087240A1 · Loewke · 2015 [cited by examiner]
US 20160370569A1 · Matsumoto · 2016 [cited by examiner]
US 20190287244A1 · Wakui · 2019 [cited by examiner]
US 20200135328A1 · Yamada · 2020 [cited by examiner]
US 20200192059A1 · Wakui · 2020 [cited by applicant]
US 20200342597A1 · Chukka · 2020 [cited by examiner]
US 20210117729A1 · Bharti · 2021 [cited by examiner]
US 20210133963A1 · Takahashi · 2021 [cited by examiner]
US 20210272288A1 · Takahashi · 2021 [cited by examiner]
JP 2011229409A · 2011 [cited by applicant]
JP 4968595B2 · 2012 [cited by applicant]
JP 5181385B2 · 2013 [cited by applicant]
WO 2017056600A1 · 2017 [cited by applicant]
WO 2018105432A1 · 2018 [cited by applicant]
WO 2019044424A1 · 2019 [cited by applicant]
Written Opinion by the International Search Authority for PCT application PCT/JP2019/028268 dated Jan. 10, 2019, submitted with a machine translation. [cited by applicant]
Takahashi et al., “Development segmentation technique for recognition of undifferentiated aberrant colonies of iPS Cells Using deep learning”, 2018, Medical Science Digest, vol. 44, No. 9, p. 483-486. [cited by applicant]
Cell Culture Analysis Device CS-1, online search on Feb. 14, 2017, URL: https://www.an.shimadzu.co.jp/bio/cell/cs1/index.htm. [cited by applicant]
Long et al., “Fully Convolutional Networks for Semantic Segmentation”, The IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 3431-3440 URL:https://people.eecs.berkeley.edu/˜jonlong/long_shelhamer_fcn… [cited by applicant]
Ronneberger et al., “U-Net: Convolutional Networks for Biomedical Image Segmentation”, Computer Science Department and BIOSS Centre for Biological Signalling Studies, University of Freiburg, Germany URL:https://arxiv.or… [cited by applicant]
Notice of Reasons for Refusal dated Nov. 1, 2022 for corresponding Japanese Patent Application No. JP 2021-532644. [cited by applicant]
First Office Action dated Dec. 28, 2023 issued in relation to the corresponding Chinese Patent Application No. 201980098569.7 together with a machine English translation thereof. [cited by applicant]
Second Office Action dated Jul. 9, 2024 for corresponding Chinese Patent Application No. 201980098569.7. [cited by applicant]