Depth sensing visualization modes for non-contact monitoring
The present invention relates to the field of medical monitoring, and, in particular, to non-contact detecting and monitoring of patient breathing. Systems, methods, and computer readable media are described for calculating a change in depth of a region of interest (ROI) on a patient and assigning one or more visual indicators to at least a portion of a graphic based on the calculated changes in depth and/or based on a tidal volume signal generated for the patient. In some embodiments, the systems, methods, and/or computer readable media can display the visual indicators overlaid onto at least the portion in real-time and/or can display the tidal volume signal in real-time. The systems, methods, and/or computer readable media can trigger an alert and/or an alarm when a breathing abnormality is detected.
1. A video-based patient monitoring system, comprising:
at least one processor configured to define a region of interest (ROI) on a patient; and
a non-contact detector having at least one image capture device, wherein the at least one image capture device is configured to capture two or more images of the ROI, and wherein the at least one processor is further configured to:
calculate a change in depth of at least a portion of the ROI within the two or more images;
assign a visual indicator to a display based at least in part on the calculated change in depth; and
one or more of:
instruct the display to display the visual indicator overlaid onto at least the portion of the ROI on the display in real-time;
generate one or more breathing parameter signals for the ROI, wherein the one or more breathing parameter signals includes a tidal volume signal; and
instruct the display to display the tidal volume signal in real-time.
2. The video-based patient monitoring system of claim 1 , wherein one of the at least one image capture devices is a depth-sensing camera, an RGB camera, or an infrared camera.
3. The video-based patient monitoring system of claim 1 further comprising the display.
4. The video-based patient monitoring system of claim 1 , wherein the at least one processor is configured to assign the visual indicator to the display based at least in part on a sign or a magnitude of the calculated change in depth.
5. The video-based patient monitoring system of claim 1 , wherein the visual indicator includes a color, a shade, a pattern, a concentration, or an intensity.
6. The video-based patient monitoring system of claim 1 , wherein the at least one processor is configured to assign the visual indicator to the display based at least in part on an average change in depth of at least the portion of the ROI over time.
7. The video-based patient monitoring system of claim 1 , wherein the at least one processor is configured to assign the visual indicator to the display based at least in part on an instantaneous average change in depth of at least the portion of the ROI.
8. The video-based patient monitoring system of claim 1 , wherein the at least one processor is configured to assign the visual indicator to the display of at least the portion of the ROI.
9. The video-based patient monitoring system of claim 8 , wherein the visual indicator assigned to the display of at least the portion of the ROI is uniform across the display of at least the portion of the ROI.
10. The video-based patient monitoring system of claim 8 , wherein the visual indicator assigned to the display of at least the portion of the ROI spatially varies across the display of at least the portion of the ROI.
11. The video-based patient monitoring system of claim 1 , wherein the at least one processor is further configured to assign the visual indicator to the display when the tidal volume signal indicates the patient is inhaling.
12. The video-based patient monitoring system of claim 1 , wherein the at least one processor is further configured to assign the visual indicator to the display when the tidal volume signal indicates the patient is exhaling.
13. A video-based patient monitoring system, comprising:
at least one processor configured to define a region of interest (ROI) on a patient; and
a non-contact detector having at least one image capture device, wherein the at least one image capture device is configured to capture two or more images of the ROI, and wherein the at least one processor is further configured to:
calculate a change in depth of at least a portion of the ROI within the two or more images;
generate a tidal volume signal for the patient;
assign one or more visual indicators to at least a portion of a graphic based at least in part on the tidal volume signal, wherein the one or more visual indicators includes a first visual indicator and a second visual indicator;
assign the first visual indicator to at least the portion of the graphic when the tidal volume signal indicates the patient is inhaling; and
assign the second visual indicator to at least the portion of the graphic when the tidal volume signal indicates the patient is exhaling.
14. The video-based patient monitoring system of claim 13 , wherein the graphic is a graphic of a lung or a graphic of the ROI.
15. The video-based patient monitoring system of claim 13 , wherein the first visual indicator or the second visual indicator is uniform across at least the portion of the graphic.
16. The video-based patient monitoring system of claim 13 , wherein the first visual indicator or the second visual indicator spatially varies across at least the portion of the graphic.
17. The video-based patient monitoring system of claim 13 , wherein the one or more visual indicators assigned to at least the portion of the graphic vary as the tidal volume signal increases or as the tidal volume signal decreases.
18. The video-based patient monitoring system of claim 17 , wherein intensity of the one or more visual indicators assigned to at least the portion of the graphic varies as the tidal volume signal increases or as the tidal volume signal decreases.
19. The video-based patient monitoring system of claim 13 , wherein an amount of at least the portion of the graphic filled with the one or more visual indicators increases as the tidal volume signal increases or decreases as the tidal volume signal decreases.
20. The video-based patient monitoring system of claim 13 , wherein an amount of at least the portion of the graphic filled with the one or more visual indicators decreases as the tidal volume signal increases or increases as the tidal volume signal decreases.
21. The video-based patient monitoring system of claim 13 , wherein the at least one processor is configured to define or receive one or more threshold target tidal volumes, wherein the one or more threshold target tidal volumes are defined for the patient based at least in part on the patient's demographics or disease state.
22. The video-based patient monitoring system of claim 21 , wherein the one or more threshold target tidal volumes includes (i) a first inhalation threshold target tidal volume representing a first volume of air below which the patient is at risk of hypoventilation, (ii) a second inhalation threshold target tidal volume representing a second volume of air above which the patient is at risk of hyperventilation, (iii) a first exhalation threshold target tidal volume representing a third volume of air above which indicates obstructive lung disease, (iv) a second exhalation threshold target tidal volume representing a fourth volume of air less than the third volume of air, (v) a third inhalation threshold target tidal volume and a fourth inhalation threshold target tidal volume defining a first range of normal patient ventilation, or (vi) a third exhalation threshold target tidal volume and a fourth exhalation threshold target tidal volume defining a second range of normal patient ventilation.
23. The video-based patient monitoring system of claim 22 , wherein the one or more visual indicators includes a third visual indicator, a fourth visual indicator, a fifth visual indicator, a sixth visual indicator, a seventh visual indicator, or an eighth visual indicator; and wherein the at least one processor is further configured to:
assign the third visual indicator to at least the portion of the graphic when the patient is inhaling and the tidal volume signal meets or exceeds the first inhalation threshold target tidal volume,
assign the fourth visual indicator to at least the portion of the graphic when the patient is inhaling and the tidal volume signal meets or exceeds the second inhalation threshold target tidal volume,
assign the fifth visual indicator to at least the portion of the graphic when the patient has finished inhaling and the tidal volume signal does not meet or exceed the first inhalation threshold target tidal volume,
assign the sixth visual indicator to at least the portion of the graphic when the patient is exhaling and the tidal volume signal meets or drops below the first exhalation threshold target tidal volume,
assign the seventh visual indicator to at least the portion of the graphic when the patient is exhaling and the tidal volume signal meets or drops below the second exhalation threshold target tidal volume, or
assign the eighth visual indicator to at least the portion of the graphic when the patient has finished exhaling and the tidal volume signal does not meet or drop below the first exhalation threshold target tidal volume.
24. The video-based patient monitoring system of claim 22 , wherein the at least one processor is further configured to:
trigger a first audio or visual alert or alarm when the patient is inhaling and the tidal volume signal meets or exceeds the first inhalation threshold target tidal volume, trigger a second audio or visual alert or alarm when the patient is inhaling and the tidal volume signal meets or exceeds the second inhalation threshold target tidal volume,
trigger a third audio or visual alert or alarm when the patient has finished inhaling and the tidal volume signal does not meet or exceed the first inhalation threshold target tidal volume,
trigger a fourth audio or visual alert or alarm when the patient is exhaling and the tidal volume signal meets or drops below the first exhalation threshold target tidal volume,
trigger a fifth audio or visual alert or alarm when the patient is exhaling and the tidal volume signal meets or drops below the second exhalation threshold target tidal volume, or
trigger a sixth audio or visual alert or alarm when the patient has finished exhaling and the tidal volume signal does not meet or drop below the first exhalation threshold target tidal volume.
25. The video-based patient monitoring system of claim 22 , wherein the one or more visual indicators includes a third visual indicator, a fourth visual indicator, a fifth visual indicator, a sixth visual indicator, a seventh visual indicator, or an eighth visual indicator; and wherein the at least one processor is further configured to:
assign the third visual indicator to at least the portion of the graphic or (ii) trigger a first audio or visual alert or alarm when the patient is inhaling and the tidal volume signal meets the first range of normal patient ventilation,
assign the fourth visual indicator to at least the portion of the graphic or (ii) trigger a second audio or visual alert or alarm when the patient is inhaling and the tidal volume signal exceeds the first range of normal patient ventilation,
assign the fifth visual indicator to at least the portion of the graphic or (ii) trigger a third audio or visual alert or alarm when the patient has finished inhaling and the tidal volume signal does not meet the first range of normal patient ventilation,
assign the sixth visual indicator to at least the portion of the graphic or (ii) trigger a fourth audio or visual alert or alarm when the patient is exhaling and the tidal volume signal meets the second range of normal patient ventilation,
assign the seventh visual indicator to at least the portion of the graphic or (ii) trigger a fifth audio or visual alert or alarm when the patient is exhaling and the tidal volume signal drops below the second range of normal patient ventilation, or
assign the eighth visual indicator to at least the portion of the graphic or (ii) trigger a sixth audio or visual alert or alarm when the patient has finished exhaling and the tidal volume signal does not meet the second range of normal patient ventilation.
26. The video-based patient monitoring system of claim 13 further comprising a display, and wherein the at least one processor is further configured to:
display the graphic overlaid onto a depth image of the patient, an RGB image of the patient, an infrared image of the patient, a CT image of the patient, or an MM image of the patient; and
display the one or more visual indicators overlaid onto at least the portion of the graphic.