Contactless sensor-driven device, system, and method enabling ambient health monitoring and predictive assessment
An ambient monitoring device includes a housing, contactless sensors coupled to the housing, and a processing device disposed in the housing. The processing device is coupled to the contactless sensors. The processing device is to receive, from one or more contactless sensors of the plurality of contactless sensors, historical sensor data. The processing device is further to determine baseline vital signs based on the historical sensor data. The processing device is further to receive, from the one or more contactless sensors, current sensor data associated with a user that is within a threshold distance of the ambient monitoring device without contacting the ambient monitoring device. The processing device is further to determine, based on the current sensor data, current vital signs of the user. Responsive to determining the current vital signs do not meet the baseline vital signs, the processing device is to provide an alert.
1. An ambient monitoring device comprising:
a plurality of contactless sensors, the plurality of contactless sensors comprising at least a millimeter wave (mmWave) radar sensor and a remote photoplethysmography (rPPG) enabled camera sensor;
a processing device coupled to the plurality of contactless sensors, wherein the processing device is configured to:
receive, from at least one sensor of the plurality of contactless sensors, data associated with a user that is located within a threshold distance of the ambient monitoring device, wherein the at least one sensor does not make physical contact with the user;
determine a current vital sign of the user located within the threshold distance by deriving the current vital sign in part from a pleth waveform generated by the rPPG enabled camera sensor and point cloud data generated by the mm Wave radar sensor; and
generate an alert responsive to a determination that the current vital sign does not meet an acceptable measure, wherein the determination is based at least in part on a corresponding baseline vital sign measurement derived from historical sensor data associated with the user.
2. The ambient monitoring device of claim 1 , wherein the current vital sign comprises one of:
a heart rate;
a breathing rate;
a body temperature;
a body movement;
a body position;
a user activity in ambient surroundings;
a hydration level;
a blood pressure; or
a change in skin color tone.
3. The ambient monitoring device of claim 1 , wherein the processing device is further configured to communicate the alert via one or more of an audio component of the ambient monitoring device, a user interface of the ambient monitoring device, or a computing device remote from the ambient monitoring device.
4. The ambient monitoring device of claim 1 , wherein the plurality of contactless sensors comprise one or more of:
a high-resolution visible light camera;
an infrared imaging sensor;
a motion radar imaging sensor;
a microphone array sensor;
a vibration sensor;
an accelerometer sensor;
a depth sensor;
an ambient temperature sensor; or
an ambient humidity sensor.
5. The ambient monitoring device of claim 1 , wherein data received from the plurality of sensors comprises a first data subset from a first contactless sensor and a second data subset from a second contactless sensor, wherein the processing device is further configured to combine the first data subset and the second data subset to form structured data, and wherein the current vital sign is based on the structured data.
6. The ambient monitoring device of claim 1 , wherein the processing device is further configured to:
determine an indoor space based on the historical sensor data; and
determine movements of the user in the indoor space based on the data received from the at least one sensor.
7. The ambient monitoring device of claim 6 , wherein a first subset of the data received from the at least one sensor comprises short wave radar sensor data and a second subset of the data received from the at least one sensor comprises long wave radar sensor data, and wherein the processing device is configured to determine the movements of the user based on the short wave radar sensor data and the long wave radar sensor data.
8. The ambient monitoring device of claim 1 , wherein the processing device is further configured to:
receive user input indicative of a health condition of the user; and
determine, based on the user input, whether the current vital sign meets an acceptable measure associated with the health condition.
9. The ambient monitoring device of claim 1 , wherein the processing device is further configured to:
provide the data received from the at least one sensor as input to a trained machine learning model; and
receive a prediction of whether the current vital sign meets the corresponding baseline vital sign based at least in part on one or more outputs of the trained machine learning model.