Software application for a portable device for CPR guidance using augmented reality
A method for guiding a user in performing a Cardio-Pulmonary Resuscitation (CPR) procedure on a patient involving a user portable device comprising a camera, and a display. The method includes receiving a video of the patient captured by the camera, and processing the video to segment a chest region of the patient. A target position on the chest where to position hands for performing CPR is then determined, and this position is then shown on the display, hereby guiding the user in obtaining a suitable hand position for performing CPR. The method can be implemented as a software application in a personal portable device such as a smart phone, a tablet application software, a wearable computer with head-mounted display etc. Further, the video of the scene captured by the camera can be processed to provide information regarding functional quality of CPR, e.g. compression frequency and depth, during the CPR procedure. Further, vital signs of the patient such as heart rate, respiration rate, and blood oxygen saturation may be derived by image processing on the video, i.e. without any dedicated medical sensors. All such information can be provided as visual and/or audible feedback to the user during the CPR procedure, thus improving CPR effectiveness, also in case of an untrained user.
1. A method for guiding a user in performing a Cardio-Pulmonary Resuscitation procedure on a patient involving a portable device comprising a camera, and a display, the method comprising
a) receiving data representing a video of the patient captured by the camera,
b) processing the video to segment a chest region of the patient,
c) determining a target position on the chest region where to position hands for performing Cardio-Pulmonary Resuscitation, and
d) visualizing the target position on the chest region by displaying the video of the patient overlaid with an image of the determined target position on the display so as to guide the user in obtaining a suitable hand position for performing the Cardio-Pulmonary Resuscitation procedure,
wherein the overlaying further comprises graphics symbols of two arms, wherein the graphics symbols of two arms are animated to guide the user in obtaining a correct hand position for performing the Cardio-Pulmonary Resuscitation procedure.
2. Method according to claim 1 , wherein said processing of the video in step b) is performed by a processor in the portable device.
3. Method according to claim 1 , comprising processing the video to calculate at least one measure indicative of functional Cardio-Pulmonary Resuscitation performance during the Cardio-Pulmonary Resuscitation procedure, and providing feedback to the user in response to said at least one measure indicative of functional Cardio-Pulmonary Resuscitation performance.
4. Method according to claim 3 , comprising calculating, in response to the video, at least one of: a measure of depth of compressions of the patient's chest, and a frequency of compressions of the patient's chest, during the user performing the Cardio-Pulmonary Resuscitation procedure.
5. Method according to claim 1 , comprising processing the video to calculate at least one vital sign parameter of the patient indicative of a physical state of the patient, and providing guidance to the user in response to said at least one vital sign parameter of the patient.
6. Method according to claim 1 , comprising providing visual guidance on the display to the user in response to at least one of: a measure indicative of functional Cardio-Pulmonary Resuscitation performance, and a measure of a vital sign parameter of the patient.
7. Method according to claim 1 , comprising providing audible guidance to the user in response to at least one of: a measure indicative of functional Cardio-Pulmonary Resuscitation performance, and a measure of a vital sign parameter of the patient.
8. Method according to claim 1 , comprising an initial step of processing the video to calculate at least one vital sign parameter of the patient indicative of a physical state of the patient, processing said at least one vital sign parameter according to a predetermined algorithm to determine if Cardio-Pulmonary Resuscitation should be performed, and providing the user with feedback accordingly.
9. Method according to claim 1 , comprising processing the video to identify a position of the user's hands, and providing visual feedback to the user on the display so as to guide the user to move his/her hands towards the target position.
10. A computer program as embodied in a non-transitory computer readable medium, and adapted to cause a portable device comprising a camera, and a display, to perform:
a) receiving data representing a video of the patient captured by the camera,
b) processing the video to segment a chest region of the patient,
c) determining a target position on the chest region where to position hands for performing Cardio-Pulmonary Resuscitation, and
d) visualizing the target position on the chest region by displaying the video of the patient overlaid with an image of the determined target position on the display so as to guide the user in obtaining a suitable hand position for performing the Cardio-Pulmonary Resuscitation procedure, wherein the overlaying further comprises graphics symbols of two arms which are animated to guide the user in obtaining a correct hand position for performing the Cardio-Pulmonary Resuscitation procedure.
11. A portable device comprising a processor, a camera, and a display, wherein the portable device is configured for:
a) receiving data representing a video of the patient captured by the camera,
b) processing the video to segment a chest region of the patient,
c) determining a target position on the chest region where to position hands for performing Cardio-Pulmonary Resuscitation, and
d) visualizing the target position on the chest region by displaying the video of the patient overlaid with an image of the determined target position on the display so as to guide the user in obtaining a suitable hand position for performing the Cardio-Pulmonary Resuscitation procedure, wherein the overlaying further comprises graphics symbols of two arms, wherein the graphics symbols of two arms are animated to guide the user in obtaining a correct hand position for performing the Cardio-Pulmonary Resuscitation procedure.
12. Portable device according to claim 11 , comprising one of: a mobile phone, a tablet, and a wearable computer with an optical head-mounted display.