Medical assistant
A wearable device can present virtual content to the wearer for many applications in a healthcare setting. The wearer may be a patient or a healthcare provider (HCP). Such applications can include, but are not limited to, access, display, and modification of patient medical records and sharing patient medical records among authorized HCPs.
1. A wearable system for managing medical information, the wearable system comprising:
a head-mounted display (HMD) comprising a display configured to present virtual content to a user;
one or more environmental sensors configured to obtain data associated with the user's environment;
a hardware processor in communication with the display and the one or more environmental sensors, and programmed to:
monitor the user's environment via the one or more environmental sensors;
detect an initiation condition based at least partly on first data acquired by the one or more environmental sensors;
document at least a portion of an interaction with a patient via an environmental sensor in response to the detection of the initiation condition, wherein the portion of the interaction comprises second data acquired by the one or more environmental sensors;
analyze the second data to extract relevant medical information related to the interaction with the patient based on contextual information; and
initiate storage of the relevant medical information to a healthcare database system,
wherein the display of the HMD is configured to present the virtual content with varying amounts of light ray divergence corresponding to a plurality of different depth planes,
wherein the hardware processor is further programmed to:
identify a medical instrument mentioned in audio data obtained from the one or more environmental sensors, wherein the audio data is associated with the interaction with the patient, and
cause the HMD to present the virtual content to indicate a physical object in a field of view (FOV) of the user as perceived through the HMD based on whether the physical object in the FOV of the user matches the medical instrument identified in the audio data, wherein the virtual content comprises an alert based on determining that the physical object in the FOV of the user does not match the medical instrument identified in the audio data.
2. The wearable system of claim 1 , wherein the one or more environmental sensors comprise at least an outward-facing camera or a microphone.
3. The wearable system of claim 1 , wherein to analyze the second data to extract the relevant medical information, the hardware processor is programmed to:
determine an audio stream spoken by the patient or the user of the wearable system, wherein the audio data is included in the audio stream;
convert the audio stream to a text; and
parse the text to identify phrases describing the patient's medical condition or history.
4. The wearable system of claim 1 , wherein to initiate storage of the relevant medical information, the hardware processor is programmed to:
verify the patient's identity based at least partly on at least one of the first data or the second data acquired by the one or more environmental sensors; and
update a medical record stored in the healthcare database system with the relevant medical information captured from the interaction between the patient and the user.
5. The wearable system of claim 1 , wherein the hardware processor is further programmed to:
detect a triggering event for sharing healthcare information with a second wearable system;
determine an access privilege associated with the second wearable system; and
cause at least a portion of the healthcare information to be communicated to the second wearable system in response to a determination that the second wearable system has the access privilege.
6. The wearable system of claim 5 , wherein the hardware processor is further programmed to provide an indication to the second wearable system in response to a determination that the second wearable system has insufficient access privilege.
7. The wearable system of claim 5 , wherein the access privilege associated with the second wearable system is configured by the patient.
8. The wearable system of claim 5 , wherein the healthcare information comprises at least a portion of the FOV of the user as captured by an outward-facing camera.
9. The wearable system of claim 5 , wherein the hardware processor is further programmed to share the healthcare information and an annotation associated with the healthcare information with the second wearable system.
10. The wearable system of claim 1 , wherein the contextual information comprises at least one of a location of the user, a pose of the user, a level of access privilege of the user, a symptom or a condition of the patient in the FOV of the user, or an identity of the patient in the FOV of the user.
11. The wearable system of claim 1 , wherein the hardware processor is further programmed to cause the HMD to present second virtual content to the user related to the interaction with the patient.
12. The wearable system of claim 11 , wherein the second virtual content comprises at least one of a portion of a patient medical record or information related to the patient's physiological parameters received from a medical device.
13. The wearable system of claim 11 , wherein the contextual information comprises information about one or more medical instruments used during a medical procedure on a patient, and wherein the second virtual content comprises information relating to location of the one or more medical instruments.
14. The wearable system of claim 13 , wherein the second virtual content comprises an alert that the medical instrument in the FOV of the user is inappropriate or unrequested for a medical procedure.
15. A method for managing medical information, the method comprising:
under control of a first wearable device comprising an outward-facing imaging system, a hardware processor, and a head-mounted display (HMD):
monitoring physical objects in a user's environment via the outward-facing imaging system;
determining physical objects in the user's field of view (FOV) as perceived through the HMD;
detecting a triggering event for a sharing session with a second wearable device, wherein the sharing session comprises sharing at least first information associated with a first physical object in the user's FOV with a second wearable device, wherein the first physical object is outside of a FOV of the second wearable device;
communicating the first information to the second wearable device;
receiving virtual content from the second wearable device, wherein the virtual content comprises second information associated with a second physical object which is outside of the user's FOV; and
presenting the virtual content received from the second wearable device to the user via the HMD, wherein the HMD is configured to present the virtual content with varying amounts of light ray divergence corresponding to a plurality of different depth planes,
wherein the method further comprises, under control of the first wearable device:
identifying a medical instrument mentioned in audio data obtained from a microphone during an interaction between the user and a patient, wherein the audio data is associated with the interaction with the patient, and
presenting the virtual content to indicate the first physical object in the user's FOV, as perceived through the HMD, based on whether the first physical object matches the medical instrument identified in the audio data, wherein the virtual content comprises an alert based on determining that the first physical object in the FOV of the user does not match the medical instrument identified in the audio data.
16. The method of claim 15 , further comprising: receiving an annotation associated with the first physical object in the user's FOV via the first wearable device, and wherein communicating the first information to the second wearable device comprises communicating the annotation and an image of the first physical object to the second wearable device.
17. The method of claim 16 , wherein the annotation comprises one or more virtual flags placed on a portion of a patient's body part, wherein the one or more virtual flags indicate an orientation of the portion of the patient's body part, an orientation of a camera that captured the image, or contextual information associated with the image or the portion of the patient's body part.
18. The method of claim 15 , wherein the sharing session is part of an interaction between the user and a patient, and the method further comprises:
documenting the interaction between the user and the patient using at least one of the outward-facing imaging system or the microphone;
identifying relevant medical information from the interaction; and
updating a medical record of the patient with the relevant medical information.
19. The method of claim 15 , further comprising:
verifying an access privilege of the second wearable device; and
sharing at least a portion of the first information to which the access privilege of the second wearable device is sufficient.
20. The method of claim 19 , wherein the access privilege is managed by a patient whose medical information is being shared between the first wearable device and the second wearable device.