IP Library Granted Patent US 12,462,378
Granted Patent B2
US 12,462,378 · App. 17/614,218 · Granted Nov 4, 2025

Information processing device, screening device, information processing method, screening method, and program

Inventors: Haruhisa Inoue (Kyoto, JP); Takayuki Kondo (Kyoto, JP); Yuichiro Yada (Kyoto, JP)
Assignee: Kyoto University
G06T7/0012A61B5/4076A61B5/4082A61B5/4088G06N20/20G16H30/20G16H50/20G16H50/30G16H50/70G06T2207/30016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,462,378
App. No.
17/614,218
Granted
Nov 4, 2025
Kind
B2
Abstract

An information processing device includes: an acquirer configured to acquire images obtained by imaging cells differentiated from pluripotent stem cells derived from a subject; and a predictor configured to input the images acquired by the acquirer to a model trained on data in which information indicating at least a neurodegenerative disease is associated with the image obtained by imaging the cells of the neurodegenerative disease differentiated from the pluripotent stem cells, and predict an onset of the neurodegenerative disease of the subject or effects of drugs on the neurodegenerative disease, based on output results of the model to which the images were input.

Claims (50)

1 . An information processing device comprising:

an acquirer configured to acquire images obtained by imaging cells differentiated from pluripotent stem cells derived from a subject; and

a predictor configured to:

input the images acquired by the acquirer to a neural network trained on training data in which information indicating at least a phenotype of neurodegenerative disease is associated with an image obtained by imaging cells of the neurodegenerative disease differentiated from the pluripotent stem cells, the training data used for training the neural network includes data in which at least information showing the phenotype of the neurodegenerative disease that is more prominent at a second time after a first time when the cells of the neurodegenerative disease were captured than that at the first time, is associated with the image obtained by imaging the cells of the neurodegenerative disease, and

predict an onset of the neurodegenerative disease of the subject or effects of drugs on the neurodegenerative disease based on the information indicating the phenotype output by the neural network in response to the images input.

2 . The information processing device according to claim 1 , wherein:

the neural network outputs a score indicating a likelihood that the cells showed the phenotype when the images obtained by imaging the cells were input, and

the predictor predicts the onset of the neurodegenerative disease of the subject based on the score output by the neural network.

3 . The information processing device according to claim 2 , wherein:

the training data used for training the neural network includes data in which a time period from the first time to the second time is further associated with the image obtained by imaging the cells of the neurodegenerative disease,

the neural network outputs a time period until the cells will show the phenotype from when the images obtained by imaging the cells were input, and

the predictor further predicts a time period until the onset of the neurodegenerative disease of the subject based on the time period output by the neural network.

4 . The information processing device according to claim 1 , wherein:

the training data used for training the neural network further includes data in which information that a cell does not show the phenotype of the neurodegenerative disease is associated with the image obtained by imaging the cells differentiated from the pluripotent stem cells derived from a healthy subject.

5 . The information processing device according to claim 1 , further comprising:

a learner configured to learn the neural network trained on the training data.

6 . The information processing device according to claim 5 , wherein:

the neural network includes a plurality of weak learners, and

the learner ensemble-learns the plurality of weak learners.

7 . The information processing device according to claim 6 , wherein:

the predictor inputs the images acquired by the acquirer to each of the plurality of weak learners, and predicts the onset of the neurodegenerative disease of the subject based on the information indicating the phenotype output by each of the plurality of weak learners in response to the images input.

8 . The information processing device according to claim 1 , wherein:

the cells differentiated from the pluripotent stem cells are nerve cells, glial cells, vascular endothelial cells, pericytes, choroid plexus cells, or immune system cells, and

the neurodegenerative diseases are Alzheimer's disease, Parkinson's disease, amyotrophic lateral sclerosis (ALS), spinocerebellar degeneration, frontotemporal lobar degeneration, Lewy body dementia, multiple system atrophy, Huntington's disease, progressive supranuclear palsy, or corticobasal degeneration.

9 . A screening device comprising:

an acquirer configured to acquire images obtained by imaging cells of a neurodegenerative disease, which are in contact with a test substance and differentiated from pluripotent stem cells;

a predictor configured to:

input the images acquired by the acquirer to a neural network trained on training data in which information indicating at least a phenotype of the neurodegenerative disease is associated with the image obtained by imaging the cells of the neurodegenerative disease differentiated from the pluripotent stem cells, the training data used for training the neural network includes data in which at least information showing the phenotype of the neurodegenerative disease that is more prominent at a second time after a first time when the cells of the neurodegenerative disease were captured than that at the first time, is associated with the image obtained by imaging the cells of the neurodegenerative disease, and

predict whether or not the phenotype of the neurodegenerative disease will appear in the cells of the neurodegenerative disease differentiated from the pluripotent stem cells based on the information indicating the phenotype output by the neural network in response to the images input; and

a determiner configured to determine whether the test substance is a preventive or a therapeutic agent for the neurodegenerative diseases based on prediction results of the predictor.

10 . The screening device according to claim 9 , wherein:

the determiner determines that the test substance is a preventive or a therapeutic agent for the neurodegenerative diseases in a case where the predictor predicts that the phenotype does not appear in the cells of the neurodegenerative disease differentiated from the pluripotent stem cells.

11 . An information processing method in which a computer:

acquires images obtained by imaging cells differentiated from pluripotent stem cells derived from a subject,

inputs the acquired images to a neural network trained on training data in which information indicating at least a phenotype of a neurodegenerative disease is associated with the image obtained by imaging the cells of the neurodegenerative disease differentiated from the pluripotent stem cells, the training data used for training the neural network includes data in which at least information showing the phenotype of the neurodegenerative disease that is more prominent at a second time after a first time when the cells of the neurodegenerative disease were captured than that at the first time, is associated with the image obtained by imaging the cells of the neurodegenerative disease, and

predicts an onset of the neurodegenerative disease of the subject or effects of drugs on the neurodegenerative disease based on the information indicating the phenotype output by the neural network in response to the images input.

12 . A screening method in which a computer:

acquires images obtained by imaging cells of a neurodegenerative disease, which are in contact with a test substance and differentiated from pluripotent stem cells,

inputs the acquired images to a neural network trained on training data in which information indicating at least a phenotype of the neurodegenerative disease is associated with the image obtained by imaging the cells of the neurodegenerative disease differentiated from the pluripotent stem cells, the training data used for training the neural network includes data in which at least information showing the phenotype of the neurodegenerative disease that is more prominent at a second time after a first time when the cells of the neurodegenerative disease were captured than that at the first time, is associated with the image obtained by imaging the cells of the neurodegenerative disease,

predicts whether or not the phenotype of the neurodegenerative disease will appear in the cells of the neurodegenerative disease differentiated from the pluripotent stem cells based on the information indicating the phenotype output by the neural network in response to the images input, and

determines whether the test substance is a preventive or a therapeutic agent for the neurodegenerative diseases based on prediction results.

13 . A computer-readable non-transitory storage medium storing a program causing a computer to execute:

acquires images obtained by imaging cells differentiated from pluripotent stem cells derived from a subject,

inputs the acquired images to a neural network trained on training data in which information indicating at least a phenotype of a neurodegenerative disease is associated with the image obtained by imaging the cells of the neurodegenerative disease differentiated from the pluripotent stem cells, the training data used for training the neural network includes data in which at least information showing the phenotype of the neurodegenerative disease that is more prominent at a second time after a first time when the cells of the neurodegenerative disease were captured than that at the first time, is associated with the image obtained by imaging the cells of the neurodegenerative disease, and

predicts an onset of the neurodegenerative disease of the subject or effects of drugs on the neurodegenerative disease based on the information indicating the phenotype output by the neural network in response to the images input.

14 . A computer-readable non-transitory storage medium storing a program causing a computer to execute:

acquires images obtained by imaging cells of a neurodegenerative disease, which are in contact with a test substance and differentiated from pluripotent stem cells,

inputs the acquired images to a neural network trained on training data in which information indicating at least a phenotype of the neurodegenerative disease is associated with the image obtained by imaging the cells of the neurodegenerative disease differentiated from the pluripotent stem cells, the training data used for training the neural network includes data in which at least information showing the phenotype of the neurodegenerative disease that is more prominent at a second time after a first time when the cells of the neurodegenerative disease were captured than that at the first time, is associated with the image obtained by imaging the cells of the neurodegenerative disease,

predicts whether or not the phenotype of the neurodegenerative disease will appear in the cells of the neurodegenerative disease differentiated from the pluripotent stem cells based on the information indicating the phenotype output by the neural network in response to the images input, and

determines whether the test substance is a preventive or a therapeutic agent for the neurodegenerative diseases based on prediction results.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 24, 2021
From: INOUE, HARUHISA; KONDO, TAKAYUKI; YADA, YUICHIRO
To: KYOTO UNIVERSITY
Reel/Frame 058207/0537 →
Priority Claims (1)
JP 2019-103293 · May 31, 2019 · national
Continuity (1)
Related Publication 20220215543A1 · Jul 7, 2022
References Cited (41)
US 7711174B2 · Sammak et al. · 2010 [cited by applicant]
US 9097727B2 · Inoue et al. · 2015 [cited by applicant]
US 10249389B2 · Athey et al. · 2019 [cited by applicant]
US 11037292B2 · Wakui · 2021 [cited by applicant]
US 20060039593A1 · Sammak et al. · 2006 [cited by applicant]
US 20130034858A1 · Inoue et al. · 2013 [cited by applicant]
US 20150301028A1 · Eggan · 2015 [cited by examiner]
US 20150301030A1 · Eggan et al. · 2015 [cited by applicant]
US 20160186146A1 · Thomson · 2016 [cited by examiner]
US 20180082215A1 · Mizobuchi · 2018 [cited by applicant]
US 20220028488A1 · Rubin et al. · 2022 [cited by applicant]
US 20220215543A1 · Inoue et al. · 2022 [cited by applicant]
JP 2013520960 · 2013 [cited by applicant]
JP 2018045559 · 2018 [cited by applicant]
WO WO2011047103A3 · 2011 [cited by applicant]
WO WO2011108766 · 2011 [cited by applicant]
WO WO2016144838A · 2016 [cited by applicant]
WO WO2017022854 · 2017 [cited by applicant]
WO WO2017136285A1 · 2017 [cited by applicant]
WO WO2018211687 · 2018 [cited by applicant]
WO WO2018216705 · 2018 [cited by applicant]
WO WO2020118158A1 · 2020 [cited by applicant]
Witmer, A. and Bhanu, B., Aug. 2018. Multi-label classification of stem cell microscopy images using deep learning. In 2018 24th International Conference on Pattern Recognition (ICPR) (pp. 1408-1413). IEEE. [cited by examiner]
Witmer, A. and Bhanu, B., 2018, August. Multi-label classification of stem cell microscopy images using deep learning. In 2018 24th International Conference on Pattern Recognition (ICPR) (pp. 1408-1413). IEEE. [cited by examiner]
Tong, T., Ledig, C., Guerrero, R., Schuh, A., Koikkalainen, J., Tolonen, A., Rhodius, H., Barkhof, F., Tijms, B., Lemstra, A.W. and Soininen, H., 2017. Five-class differential diagnostics of neurodegenerative diseases u… [cited by examiner]
Office Action for corresponding SG Application No. 11202113016U, dated Jul. 13, 2023, 11 pages. [cited by applicant]
Supplementary European Search Report received in corresponding Application No. EP 20 81 4392, dated May 26, 2023, 12 pages. [cited by applicant]
Eric M. Christiansen et al., In silico labeling: Predicting fluorescent labels in unlabeled images, Cell. Apr. 19, 2018; 173(3): 792-803. [cited by applicant]
Nicolas Coudray et al., Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning, Nature Medicine, vol. 24, Oct. 2018, 1559-1567. [cited by applicant]
T. Kondo et al., 15. Therapeutic application of iPS cells, Nihon Naika Gakkai Zasshi, 2013, vol. 102, No. 8, pp. 2015-2022. [cited by applicant]
International Search Report for PCT/JP2020/021177 mailed Aug. 18, 2020, 5 pages. [cited by applicant]
Vlachostergiou et al., “Multi-Task Learning for Predicting Parkinson's Disease Based on Medical Imaging Information”, 25 [cited by applicant]
Centeno et al., “2D versus 3D human induced pluripotent stem cell-derived cultures for neurodegenerative disease modelling.” Molecular Neurodegeneration, vol. 13, No. 27, 2018, pp. 1-15. [cited by applicant]
European Search Report for corresponding European Application No. 20812823.1, mailed May 8, 2023, 15 pages. [cited by applicant]
Fan et al., “A Machine Learning Assisted, Label-Free, Non-invasive Approach for Somatic Reprogramming in Induced Pluripotent Stem Cell Colony Formation Detection and Prediction”, 2017, pp. 1-9. [cited by applicant]
International Search Report (w/English translation) for corresponding PCT/JP2020/021384, mailed Aug. 18, 2020, 5 pages. [cited by applicant]
Kusumoto et al., “Automated Deep Learning-Based System to Identify Endothelial Cells Derived from Induced Pluripotent Stem Cells”, vol. 10, Stem Cell Reports, Jun. 5, 2018, pp. 1687-1695. [cited by applicant]
Office Action for corresponding SG Application No. 11202113100T, dated Jul. 13, 2023, 14 pages. [cited by applicant]
Waisman et al., “Deep Learning Neural Networks Highly Predict Very Early Onset of Pluripotent Stem Cell Differentiation”, vol. 12, Stem Cell Reports, 2019, pp. 845-859. [cited by applicant]
Shi et al., “A Human Stem Cell Model of Early Alzheimer's Disease Pathology in Down Syndrome”, Science Translation Medicine, vol. 4, Issue 124, Mar. 7, 2012, 9 pages. [cited by applicant]
Imaizumi et al., “Modeling human neurological disorders with induced pluripotent stem cells”, Journal of Neurochemistry, 129, 2014, pp. 388-399. [cited by applicant]