Assessing disease risks from user captured images
In some examples, an apparatus, such as a mobile phone can include an input module such as a touch screen, a camera, a processor, and computer readable medium. The camera captures one or more images of a person. The processor can use a single machine learning model to estimate the human body features of the person based on the captured images, and use the human body features to generate a disease risk assessment value associated with diabetes and cardiovascular disease risks. The human body features can include at least one or more of: 3D body shape, or body shape indicators; and one or more of: blood flow, blood pressure, heart rate, respiratory rate, heart rate variability, cardiac workload, irregular heartbeats, or stress index. The machine learning model can be trained over a set of training images.
1. An apparatus comprising:
an input data module configured to retrieve first input data and second input data;
a processor; and
a computer readable medium containing programming instructions that, when executed, will cause the processor to:
create a 3D body shape model from the first input data and the second input data, the 3D body shape model including biometrics;
extract biomarker data from the second input data;
use the biometrics and biomarker data to generate health risk indicators and assessments including a first disease risk assessment value;
generate a second risk assessment value based on the second input data; and
fuse the biometrics with the first and second input data, and optionally the first disease risk assessment value and the second disease risk assessment value to generate a multi-category disease risk assessment value.
2. The apparatus of claim 1 , wherein the input data module is integrated with an image capturing device configured to capture one or more images of a subject.
3. The apparatus of claim 2 , wherein the second input data includes the one or more images of the subject.
4. The apparatus of claim 3 , wherein the first disease risk assessment value is based on the one or more images.
5. The apparatus of claim 1 , wherein the first disease includes diabetes.
6. The apparatus of claim 5 , wherein the second disease includes cardiovascular disease.
7. An apparatus comprising:
an image capturing device configured to capture one or more images of a subject;
a processor; and
computer readable medium containing programming instructions that, when executed, will cause the processor to:
use a 3D body shape model to generate a diabetes risk assessment value based on the one or more images;
extract biomarker data from the one or more images;
use biomarker data to generate a cardiovascular risk assessment value based on the one or more images; and
fuse the diabetes risk assessment value and the cardiovascular risk assessment value to generate a disease risk assessment value.
8. The apparatus of claim 7 , wherein the programming instructions are further configured to update the 3D body shape model based on an output of the fusion of the diabetes risk assessment value and the cardiovascular risk assessment value.
9. The apparatus of claim 7 , wherein the programming instructions are further configured to:
use the 3D body shape model to generate first biomarkers from the one or more images, the first biomarkers representing body features; and
generate the diabetes risk assessment value based on the body features.
10. The apparatus of claim 9 , wherein the first biomarkers comprise one or more of: 3D body shapes or body shape indicators.
11. The apparatus of claim 10 , wherein the diabetes risk assessment value indicates a risk associated with one or more of: type-2 diabetes, obesity, central obesity, or metabolic syndrome.
12. The apparatus of claim 7 , wherein the programming instructions are further configured to:
generate second biomarkers from the one or more images, the second biomarkers representing heart disease related biomarkers; and
generate the cardiovascular assessment value based on the second biomarkers.
13. The apparatus of claim 12 , wherein the second biomarkers comprise one or more of: blood flow, blood pressure, heart rate, respiratory rate, heart rate variability, cardiac workload, irregular heartbeats, or stress index.
14. The apparatus of claim 13 , wherein the cardiovascular risk assessment value indicates a risk associated with one or more of: cardiovascular disease, heart attack, or stroke.
15. The apparatus of claim 12 , wherein the programming instructions are further configured to generate the second biomarkers from facial images of the one or more images, wherein the second biomarkers comprise at least blood flow.
16. An apparatus comprising:
an input data module configured to retrieve input data of a subject;
a processor; and
computer readable medium containing programming instructions that, when executed, will cause the processor to:
use a disease risk model to generate a human body feature from the input data; and
generate a disease risk assessment value based on the human body feature;
wherein the human body feature comprises at least:
one or more of: 3D body shape, or body shape indicators; and
one or more of: blood flow, blood pressure, heart rate, respiratory rate, heart rate variability, cardiac workload, irregular heartbeats, or stress index.
17. The apparatus of claim 16 , wherein the disease risk assessment value indicates a risk associated with at least:
one or more of: type-2 diabetes, obesity, central obesity, or metabolic syndrome; and
one or more of: cardiovascular disease, heart attack, or stroke.
18. The apparatus of claim 17 , wherein the programming instructions are further configured to generate the disease risk model from one or more training images using a machine learning network.
19. The apparatus of claim 16 , wherein the input data module comprises an image capture device configured to capture one or more images of the subject.
20. The apparatus of claim 19 , wherein the input data comprises the one or more images of the subject.