Non-contact monitoring of spatio-temporal respiratory mechanics via depth sensing
View Patent ↗Systems and methods are proposed for non-contact monitoring of spatio-temporal mechanics comprising motion patterns of respiratory muscles, lungs and diaphragm. The depth capable sensors system is comprised of modules, including a depth estimation module, a reference shape generation module, a region of interest shape estimation module, and a shape comparison module. A recommender module is optionally included. The acquisition of spatio-temporal respiratory mechanic data comprising a time varying sequence of spatially dependent representations of the respiratory mechanics of the subject are processed for identifying differences between the subject's actual respiratory mechanics and desired mechanics that can improve the health of the subject, or identify particular maladies.
1. A system for generating a representation of spatio-temporal respiratory mechanics of a subject via non-contact depth sensing, comprising:
a reference shape generation processor configured for generating reference shape descriptor values;
a depth sensing device configured for determining a time-varying sequence of spatially dependent representations of the respiratory mechanics of the subject wherein the sequence includes a depth map including a 3D shape descriptor; and
an interest shape estimation processor configured for:
receiving the representations and segregating selected areas of the representations and converting the representations into subject shape descriptor values for comparison with the reference shape descriptor values;
comparing the representations shape descriptor values with the reference shape descriptor values for identifying respiratory mechanics including identifying differences in the respiratory mechanics between the areas over a selected corresponding time varied sequence;
generating a visual indicator of the difference for recommending actions to the subject for minimizing the differences; and
displaying the visual indicator as difference maps representing the identified differences in depth and curvature domains of the 3D shape descriptor.
2. The system of claim 1 wherein the representations comprise a target region of interest of the subject.
3. The system of claim 2 wherein the target region comprises one of: the subject's anterior thoracic region, a region of the subject's dorsal body, and a side view containing the subject's thoracic region.
4. The system of claim 1 wherein the representations include a time-varying sequence of depth maps of a target region of interest of the subject being monitored for identification of the respiratory mechanics.
5. The system of claim 4 wherein the depth maps are selectively obtained from either images captured using an image-based depth sensing device comprising any of: a red green blue depth (RGBD) camera, an infrared depth camera, a passive stereo camera, an array of cameras, an active stereo camera, and a 2D monocular video camera, or from data captured using a non-image-based depth sensing device comprising any of: a LADAR device, a LiDAR device, a photo wave device, and a time-of-flight measurement device.
6. The system of claim 1 wherein the comparing comprises identifying differences in the selected areas includes differences in respiratory mechanics between two comparable portions of the target region of interest.
7. The system of claim 6 wherein the comparable portions comprise first and second lung areas of the subject and the identifying differences include determining different lung area expansion and contraction, respectively.
8. The system of claim 1 wherein the comparing includes recommending improved respiratory mechanics for achieving better subject health.
9. The system of claim 1 wherein the comparing includes obtaining a reference shape on the subject at a reference time and obtaining an estimated shape at a later time for tracking progress of respiratory health of the subject over time.
10. The system of claim 9 wherein the comparing includes obtaining a reference shape on the subject at a time that the subject is released from a hospital to track respiratory health of the subject over time since the hospital release.