System and methods for determining health-related metrics from collected physiological data
Techniques and systems include predicting various health conditions using a photoplethysmography (PPG) signal or a video signal based on images of a patient's fingertip or other body portion captured using a mobile device. The video signal may be transformed into a pseudo PPG signal to measure blood volume changes in the patient's blood flow to derive data indicating a disease state or health-related characteristic, such as blood oxygen level, blood glucose level, heart rate variability, hemoglobin, respiration rate, or arrhythmia. Techniques involve real-time environment assessment and problematic issue detection, training an artificial intelligence (AI) model to measure signal quality so as to select high-quality signals from a range of signals, and domain adaption and transfer learning to make use of publicly available datasets.
1. A method of obtaining a physiological signal representing a patient metric, the method comprising:
acquiring patient physiological data from a sensor operating in ambient conditions;
generating a Photoplethysmography (PPG) signal or a pseudo PPG signal from the acquired patient physiological data, the PPG signal or the pseudo PPG signal having a signal quality characteristic associated with a quality indicator of the PPG signal or the pseudo PPG signal;
comparing the signal quality characteristic of the PPG signal or the pseudo PPG signal to a correlating signal quality characteristic or parameter of a deep learning-based model PPG signal; and
determining that the comparison of the signal quality characteristic of the PPG signal or the pseudo PPG signal to the signal quality characteristic or parameter of the deep-learning based model PPG signal does not meet a signal quality criterion.
2. The method of claim 1 , further comprising adjusting in real-time a parameter of the ambient conditions, the adjusting based on the determination that the signal quality characteristic of the PPG signal or the pseudo PPG signal does not meet the signal quality criterion, wherein the ambient conditions include motion and lighting associated with the sensor.
3. The method of claim 1 , further comprising, when the comparison of the signal quality characteristic of the PPG signal or the pseudo PPG signal to the signal quality characteristic or parameter of the model PPG signal does not meet the signal quality criterion, discarding the acquired patient physiological data, adjusting in real-time the ambient conditions, and acquiring new patient physiological data from the sensor.
4. The method of claim 1 , further comprising, when the comparison of the signal quality characteristic of the PPG signal or the pseudo PPG signal to the signal quality characteristic or parameter of the model PPG signal does not meet the signal quality criterion:
discarding the acquired patient physiological data;
causing to display in real-time an indication of insufficient or improper sensor detection conditions; and
acquiring new patient physiological data from the sensor.
5. The method of claim 4 , wherein the patient physiological data comprises metadata measured by an inertial measurement unit (IMU) of the mobile device.
6. The method of claim 5 , wherein the indication of insufficient or improper sensor detection conditions is based, at least in part, on the metadata.
7. The method of claim 1 , wherein acquiring the patient physiological data from the sensor further comprises capturing image frames using a camera of a mobile device.
8. The method of claim 7 , wherein the image frames comprise images of at least a portion of a fingertip of a person.
9. The method of claim 8 , wherein acquiring the patient physiological data from the sensor further comprises:
monitoring for problematic issues, in real-time, during the acquisition of the patient physiological data, wherein the problematic issues are based, at least in part, on relative motion between the fingertip and the camera.
10. The method of claim 9 , wherein the relative motion between the fingertip and the camera is determined by an accelerometer of the mobile device.
11. The method of claim 9 , wherein the relative motion between the fingertip and the camera is determined based, at least in part, on intensity measurements of pixel data of the image frames.
12. The method of claim 7 , wherein generating the PPG signal or the pseudo PPG signal from the acquired patient physiological data comprises using a deep-learning model applied to one or more individual frames of the image frames.
13. The method of claim 7 , wherein generating the PPG signal or the pseudo PPG signal from the acquired patient physiological data comprises using a deep-learning model applied simultaneously to at least two of the image frames.
14. The method of claim 7 , wherein the image frames comprise red, green, blue (RGB) pixel data, and wherein the patient physiological data is based, at least in part, on the red pixel data.
15. The method of claim 7 , wherein the image frames comprise a time-series of image frames that are partitioned into video chunks that each have a predetermined time span.
16. The method of claim 15 , wherein two contiguous video chunks are combined into a video segment having a portion that comprises an overlap between the two contiguous video chunks.
17. The method of claim 15 , wherein the deep-learning based model PPG signal is based, at least in part, on a neural network that is trained using transfer learning on pulse oximeter PPG data and information collected or produced by the mobile device, wherein the information includes the video chunks or blood pressure data previously determined by the mobile device.
18. The method of claim 1 , wherein the sensor is a camera of a mobile device, and wherein acquiring the patient physiological data from the sensor further comprises controlling a flash of the mobile device.
19. The method of claim 1 , wherein the sensor is a camera of a mobile device, and wherein acquiring the patient physiological data from the sensor further comprises controlling light sensitivity of the camera.
20. The method of claim 1 , wherein the determining that the comparison of the signal quality characteristic of the PPG signal or the pseudo PPG signal to the correlating signal quality characteristic or parameter of the model PPG signal does not meet the quality criterion is performed by a process based on a trained blood pressure deep-learning based model.