Vital sign monitoring system using an optical sensor
View Patent ↗A vital sign monitoring system using an optical sensor is provided. The vital sign monitoring system, and related methods and devices described herein, is equipped with a camera or other optical sensor to remotely detect and measure one or more physiological parameters (e.g., vital signs) of a subject. For example, the vital sign monitoring system can detect, measure, and/or monitor heart rates and respiration rates from one or multiple subjects simultaneously using advanced signal processing techniques, including adaptive color beamforming to more accurately detect and measure the vital sign(s) of interest.
1. A method for remotely monitoring a physiological parameter, the method comprising:
sensing optical video data of a subject;
analyzing the optical video data to track color changes in a region of interest of the subject over a period of time;
identifying the region of interest on skin of the subject;
tracking movement of the region of interest across multiple frames of the optical video data; and
extracting physiological parameter data of the subject by adaptively beamforming the color changes.
2. The method of claim 1 , further comprising spatially averaging color changes in the region of interest across the period of time to extract the physiological parameter data.
3. The method of claim 1 , wherein changes in more than two colors are tracked over time.
4. The method of claim 3 , wherein the color changes are adaptively beamformed using red, green and blue color components.
5. The method of claim 1 , wherein extracting the physiological parameter data further comprises spectrally analyzing the color changes after beamforming.
6. The method of claim 1 , wherein the physiological parameter is a heart rate of the subject.
7. The method of claim 1 , wherein the physiological parameter is a respiration rate of the subject.
8. The method of claim 1 , further comprising pre-processing the optical video data to magnify the physiological parameter to be extracted.
9. A device, comprising:
an optical image sensor; and
an image processor configured to:
receive optical video data from the optical image sensor;
analyze the optical video data to track color changes in a region of interest of a subject over time;
identify the region of interest on skin of the subject;
track movement of the region of interest across multiple frames of the optical video data;
adaptively beamform the color changes;
analyze the adaptively beamformed color changes to determine a physiological parameter of the subject; and
extract physiological parameter data of the subject from the analyzed adaptively beamformed color changes.
10. The device of claim 9 , wherein the device is an unmanned aerial vehicle (UAV).
11. The device of claim 10 , wherein the image processor is further configured to suppress UAV motion artifacts in the optical video data.
12. The device of claim 9 , wherein the image processor is further configured to apply a facial recognition algorithm to the optical video data to determine the region of interest on skin of the subject.
13. The device of claim 12 , wherein the facial recognition algorithm is further configured to track a corresponding region of interest for each of a plurality of subjects.
14. The device of claim 13 , wherein the image processor is further configured to determine the physiological parameter data of each of the plurality of subjects.
15. A vital sign monitoring system, comprising:
a device comprising an optical image sensor; and
an image processor in communication with the optical image sensor, the image processor configured to:
receive optical video data from the optical image sensor;
analyze the optical video data to track color changes in a region of interest over time;
identify the region of interest on skin of the subject;
track movement of the region of interest across multiple frames of the optical video data; and
extract physiological parameter data of a human subject by adaptively beamforming the color changes.
16. The vital sign monitoring system of claim 15 , further comprising a plurality of unmanned aerial vehicles (UAVs), each of which comprises a corresponding optical image sensor.
17. The vital sign monitoring system of claim 16 , wherein the image processor is in communication with each of the corresponding optical image sensors of the plurality of UAVs and further configured to:
analyze optical video data from the corresponding optical image sensor of each of the plurality of UAVs; and
identify corresponding regions of interest for the subject in the corresponding optical video data.
18. A method for remotely monitoring a physiological parameter, the method comprising:
sensing optical video data of a subject;
analyzing the optical video data to track color changes in a region of interest of the subject over a period of time; and
extracting physiological parameter data of the subject by adaptively beamforming the color changes;
wherein the method further comprises at least one of the following features (a) to (c);
(a) the method further comprises spatially averaging color changes in the region of interest across the period of time to extract the physiological parameter data;
(b) the method further comprises tracking changes in more than two colors over time; and
(c) the extracting of the physiological parameter data further comprises spectrally analyzing the color changes after beamforming.