IP Library Granted Patent US 12,412,266
Granted Patent B2
US 12,412,266 · App. 17/614,243 · Granted Sep 9, 2025

Information processing device, screening device, information processing method, screening method, and program

Inventors: Haruhisa Inoue (Kyoto, JP); Keiko Imamura (Kyoto, JP); Yuichiro Yada (Kyoto, JP)
Assignee: Kyoto University
G06T7/0012G16H50/20G06T2207/10056G06T2207/20081G06T2207/30024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,412,266
App. No.
17/614,243
Granted
Sep 9, 2025
Kind
B2
Abstract

An information processing device includes: an acquirer configured to acquire images obtained by imaging cells differentiated from pluripotent stem cells derived from a subject; and a predictor configured to input the images acquired by the acquirer to a model trained on data in which information indicating at least an intractable neurological disease is associated with an image obtained by imaging the cells of the intractable neurological disease differentiated from the pluripotent stem cells, and predict an onset of the intractable neurological disease of the subject based on output results of the model to which the images were input.

Claims (98)

1. An information processing device comprising:

a processor configured to:

acquire images obtained by imaging cells differentiated from pluripotent stem cells derived from a subject;

input the acquired images to a neural network trained on training data in which information indicating at least a phenotype of a neurological disease is associated with an image obtained by imaging cells of the neurological disease differentiated from the pluripotent stem cells; and

predict an onset of the neurological disease of the subject based on the information indicating the phenotype output by the neural network in response to the acquired images input,

wherein:

the training data used for training the neural network is data in which age at the onset of the neurological disease is further associated with the image obtained by imaging the cells of the neurological disease,

the neural network outputs the age when the acquired images obtained by imaging the cells are input, and

the processor being further configured to predict a time period until the onset of the neurological disease of the subject based on the age output by the neural network.

2. The information processing device according to claim 1 , wherein:

the training data used for training the neural network is data in which a symptomatic period of the neurological disease is further associated with the image obtained by imaging the cells of the neurological disease,

the neural network outputs the symptomatic period when the acquired images obtained by imaging the cells are input, and

the processor being further configured to predict a progression rate of the neurological disease that the subject develops based on the symptomatic period output by the neural network.

3. The information processing device according to claim 1 , wherein:

the training data used for training the neural network further includes data in which information indicating that a cell does not show the phenotype of the neurological disease is associated with the image obtained by imaging the cells differentiated from the pluripotent stem cells derived from a healthy subject.

4. The information processing device according to claim 1 , wherein:

the training data used for training the neural network further includes, in addition to the images obtained by imaging the cells of the neurological disease, data in which information indicating the phenotype of the neurological disease is associated with personal information indicating the sex and presence or absence of genetic polymorphism or a specific gene of the patient with the neurological disease,

the processor being further configured to:

acquire personal information on the sex and the presence or absence of genetic polymorphism or a specific gene of the subject,

input the acquired images and the acquired personal information to the neural network, and

predict the onset of the neurological disease of the subject based on the information indicating the phenotype output by the neural network in response to the acquired images and the acquired personal information input.

5. The information processing device according to claim 1 , the processor being further configured to train the neural network based on the training data.

6. The information processing device according to claim 1 , wherein:

the cells differentiated from the pluripotent stem cells are nerve cells, glial cells, vascular endothelial cells, pericytes, choroid plexus cells, or immune system cells.

7. The information processing device according to claim 1 ,

wherein the neurological disease includes at least one of amyotrophic lateral sclerosis (ALS), Alzheimer's disease, Parkinson's disease, spinocerebellar degeneration, frontotemporal lobar degeneration, Lewy body dementia, multiple system atrophy, Huntington's disease, progressive supranuclear palsy, or Corticobasal degeneration.

8. An information processing method performed by a computer, the method comprising:

acquiring images obtained by imaging cells differentiated from pluripotent stem cells derived from a subject,

inputting the acquired images to a neural network trained on training data in which information indicating at least a phenotype of a neurological disease is associated with an image obtained by imaging the cells of the neurological disease differentiated from the pluripotent stem cells, and

predicting an onset of the neurological disease of the subject based on the information indicating the phenotype output by the neural network in response to the acquired images input,

wherein:

the training data used for training the neural network is data in which age at the onset of the neurological disease is further associated with the image obtained by imaging the cells of the neurological disease,

the neural network outputs the age when the acquired images obtained by imaging the cells are input, and

the method further comprising predicting a time period until the onset of the neurological disease of the subject based on the age output by the neural network.

9. A computer-readable non-transitory storage medium storing a program causing a computer to execute instructions, the instructions including:

acquiring images obtained by imaging cells differentiated from pluripotent stem cells derived from a subject,

inputting the acquired images to a neural network trained on training data in which information indicating at least a phenotype of a neurological disease is associated with an image obtained by imaging the cells of the neurological disease differentiated from the pluripotent stem cells, and

predicting an onset of the neurological disease of the subject based on the information indicating the phenotype output by the neural network in response to the acquired images input,

wherein:

the training data used for training the neural network is data in which age at the onset of the neurological disease is further associated with the image obtained by imaging the cells of the neurological disease,

the neural network outputs the age when the acquired images obtained by imaging the cells are input, and

the instructions further including predicting a time period until the onset of the neurological disease of the subject based on the age output by the neural network.

10. An information processing device comprising:

a processor configured to:

acquire images obtained by imaging cells differentiated from pluripotent stem cells derived from a subject;

input the acquired images to a neural network trained on training data in which information indicating at least a phenotype of a neurological disease is associated with an image obtained by imaging cells of the neurological disease differentiated from the pluripotent stem cells; and

predict an onset of the neurological disease of the subject based on the information indicating the phenotype output by the neural network in response to the acquired images input,

wherein:

the training data used for training the neural network is data in which a symptomatic period of the neurological disease is further associated with the image obtained by imaging the cells of the neurological disease,

the neural network outputs the symptomatic period when the acquired images obtained by imaging the cells are input, and

the processor being further configured to predict a progression rate of the neurological disease that the subject develops based on the symptomatic period output by the neural network.

11. An information processing device comprising:

a processor configured to:

acquire images obtained by imaging cells differentiated from pluripotent stem cells derived from a subject;

input the acquired images to a neural network trained on training data in which information indicating at least a phenotype of a neurological disease is associated with an image obtained by imaging cells of the neurological disease differentiated from the pluripotent stem cells; and

predict an onset of the neurological disease of the subject based on the information indicating the phenotype output by the neural network in response to the acquired images input,

wherein:

the training data used for training the neural network further includes, in addition to the images obtained by imaging the cells of the neurological disease, data in which information indicating the phenotype of the neurological disease is associated with personal information indicating the sex and presence or absence of genetic polymorphism or a specific gene of the patient with the neurological disease,

the processor being further configured to:

acquire personal information on the sex and the presence or absence of genetic polymorphism or a specific gene of the subject,

input the acquired images and the acquired personal information to the neural network, and

predict the onset of the neurological disease of the subject based on the information indicating the phenotype output by the neural network in response to the acquired images and the acquired personal information input.

12. An information processing method performed by a computer, the method comprising:

acquiring images obtained by imaging cells differentiated from pluripotent stem cells derived from a subject,

inputting the acquired images to a neural network trained on training data in which information indicating at least a phenotype of a neurological disease is associated with an image obtained by imaging the cells of the neurological disease differentiated from the pluripotent stem cells, and

predicting an onset of the neurological disease of the subject based on the information indicating the phenotype output by the neural network in response to the acquired images input,

wherein:

the training data used for training the neural network is data in which a symptomatic period of the neurological disease is further associated with the image obtained by imaging the cells of the neurological disease,

the neural network outputs the symptomatic period when the acquired images obtained by imaging the cells are input, and

the method further comprising predicting a progression rate of the neurological disease that the subject develops based on the symptomatic period output by the neural network.

13. An information processing method performed by a computer, the method comprising:

acquiring images obtained by imaging cells differentiated from pluripotent stem cells derived from a subject,

inputting the acquired images to a neural network trained on training data in which information indicating at least a phenotype of a neurological disease is associated with an image obtained by imaging the cells of the neurological disease differentiated from the pluripotent stem cells, and

predicting an onset of the neurological disease of the subject based on the information indicating the phenotype output by the neural network in response to the acquired images input,

wherein:

the training data used for training the neural network further includes, in addition to the images obtained by imaging the cells of the neurological disease, data in which information indicating the phenotype of the neurological disease is associated with personal information indicating the sex and presence or absence of genetic polymorphism or a specific gene of the patient with the neurological disease,

the method further comprising:

acquiring personal information on the sex and the presence or absence of genetic polymorphism or a specific gene of the subject,

inputting the acquired images and the acquired personal information to the neural network, and

predicting the onset of the neurological disease of the subject based on the information indicating the phenotype output by the neural network in response to the acquired images and the acquired personal information input.

14. A computer-readable non-transitory storage medium storing a program causing a computer to execute instructions, the instructions including:

acquiring images obtained by imaging cells differentiated from pluripotent stem cells derived from a subject,

inputting the acquired images to a neural network trained on training data in which information indicating at least a phenotype of a neurological disease is associated with an image obtained by imaging the cells of the neurological disease differentiated from the pluripotent stem cells, and

predicting an onset of the neurological disease of the subject based on the information indicating the phenotype output by the neural network in response to the acquired images input,

wherein:

the training data used for training the neural network is data in which a symptomatic period of the neurological disease is further associated with the image obtained by imaging the cells of the neurological disease,

the neural network outputs the symptomatic period when the acquired images obtained by imaging the cells are input, and

the instructions further including predicting a progression rate of the neurological disease that the subject develops based on the symptomatic period output by the neural network.

15. A computer-readable non-transitory storage medium storing a program causing a computer to execute instructions, the instructions including:

acquiring images obtained by imaging cells differentiated from pluripotent stem cells derived from a subject,

inputting the acquired images to a neural network trained on training data in which information indicating at least a phenotype of a neurological disease is associated with an image obtained by imaging the cells of the neurological disease differentiated from the pluripotent stem cells, and

predicting an onset of the neurological disease of the subject based on the information indicating the phenotype output by the neural network in response to the acquired images input,

wherein:

the training data used for training the neural network further includes, in addition to the images obtained by imaging the cells of the neurological disease, data in which information indicating the phenotype of the neurological disease is associated with personal information indicating the sex and presence or absence of genetic polymorphism or a specific gene of the patient with the neurological disease,

the instructions further including:

acquiring personal information on the sex and the presence or absence of genetic polymorphism or a specific gene of the subject,

inputting the acquired images and the acquired personal information to the neural network, and

predicting the onset of the neurological disease of the subject based on the information indicating the phenotype output by the neural network in response to the acquired images and the acquired personal information input.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 24, 2021
From: INOUE, HARUHISA; IMAMURA, KEIKO; YADA, YUICHIRO
To: KYOTO UNIVERSITY
Reel/Frame 058207/0952 →
Priority Claims (1)
JP 2019-103294 · May 31, 2019 · national
Continuity (1)
Related Publication 20220215544A1 · Jul 7, 2022
References Cited (42)
US 7711174B2 · Sammak · 2010 [cited by examiner]
US 9097727B2 · Inque et al. · 2015 [cited by applicant]
US 10249389B2 · Athey · 2019 [cited by examiner]
US 11037292B2 · Wakui · 2021 [cited by examiner]
US 20060039593A1 · Sammak · 2006 [cited by examiner]
US 20130034858A1 · Inoue · 2013 [cited by examiner]
US 20150301028A1 · Eggan · 2015 [cited by examiner]
US 20150301030A1 · Eggan · 2015 [cited by examiner]
US 20160186146A1 · Thomson et al. · 2016 [cited by applicant]
US 20180082215A1 · Mizobuchi · 2018 [cited by applicant]
US 20220028488A1 · Rubin · 2022 [cited by examiner]
US 20220215543A1 · Inoue · 2022 [cited by examiner]
JP 2013520960 · 2013 [cited by applicant]
JP 2018045559 · 2018 [cited by applicant]
WO WO2011108766 · 2011 [cited by applicant]
WO WO2011047103A3 · 2011 [cited by examiner]
WO WO2016144838 · 2016 [cited by applicant]
WO WO2017022854 · 2017 [cited by applicant]
WO WO2017136285 · 2017 [cited by applicant]
WO WO2018211687 · 2018 [cited by applicant]
WO WO2018216705 · 2018 [cited by applicant]
WO WO2020118158A1 · 2020 [cited by examiner]
Aggeliki Vlachostergiou et al., “Multi-Task Learning for Predicting Parkinson's Disease Based on Medical Imaging Information,” 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece, 2018, pp… [cited by examiner]
Yichen Shi et al., “A Human Stem Cell Model of Early Alzheimer's Disease Pathology in Down Syndrome”. Sci. Transl. Med.4, 124ra29-124ra29(2012).DOI:10.1126/scitranslmed.3003771 (Year: 2012). [cited by examiner]
Yoichi Imaizumi et al., “Modeling human neurological disorders with induced pluripotent stem cells,”J. Neurochem. (2014) 129, 388-399, doi: 10.1111/jnc.12625 (Year: 2014). [cited by examiner]
Witmer et al., 2018, “Multi-label Classification of Stem Cell Microscopy Images using Deep Learning” (pp. 1408-1413). (Year: 2018). [cited by examiner]
Waisman et al., Apr. 9, 2019, “Deep Learning Neural Networks Highly Predict Very Early Onset of Pluripotent Stem Cell Differentiation” (pp. 845-859) (Year: 2019). [cited by examiner]
Kusumoto et al., 2018, “Automated Deep Learning-Based System to Identify Endothelial Cells Derived from Induced Pluripotent Stem Cells” (pp. 1687-1695) (Year: 2018). [cited by examiner]
Fan et al., 2017, “A Machine Learning Assisted, Label-free, Non-invasive Approach for Somatic Reprogramming in Induced Pluripotent Stem Cell” (pp. 1-9). (Year: 2017). [cited by examiner]
Eric M. Christiansen et al., In silico labeling: Predicting fluorescent labels in unlabeled images, Cell. Apr. 19, 2018; 173(3): 792-803. [cited by applicant]
Nicolas Coudray et al., Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning, Nature Medicine, vol. 24, Oct. 2018, 1559-1567. [cited by applicant]
T. Kondo et al., 15. Therapeutic application of iPS cells, Nihon Naika Gakkai Zasshi, 2013, vol. 102, No. 8, pp. 2015-2022. [cited by applicant]
PCT International Search Report for PCT/JP2020/021384, mailed Aug. 18, 2020. [cited by applicant]
Centeno, E. G. Z. et al., “2D versus 3D human induced pluripotent stem cell-derived cultures for neurodegenerative disease modelling.”, Molecular Neurodegeneration, May 22, 2018, vol. 13, No. 27, pp. 1-15. [cited by applicant]
Office Action for corresponding SG Application No. 11202113100T, dated Jul. 13, 2023, 14 pages. [cited by applicant]
European Search Report for corresponding European Application No. 20812823.1, mailed May 8, 2023, 15 pages. [cited by applicant]
International Search Report for corresponding PCT/JP2020/021177, mailed Aug. 18, 2020, 5 pages. [cited by applicant]
Office Action for corresponding SG Application No. 11202113016U, dated Jul. 13, 2023, 11 pages. [cited by applicant]
Supplementary European Search Report received in corresponding Application No. EP20814392, dated May 26, 2023, 12 pages. [cited by applicant]
Tong et al., “Five-class differential diagnostics of neurodegenerative diseases using random undersampling boosting”, NeuroImage: Clinical, 15, Mar. 9, 2017 pp. 613-624. [cited by applicant]
[Corrected] Supplementary European Search Report received in corresponding Application No. EP20814392, dated May 5, 2023, 12 pages. [cited by applicant]
[Corrected] Supplementary European Search Report received in corresponding Application No. EP 20814392.5, dated Jun. 5, 2023, 12 pages. [cited by applicant]