Aligning image data of a patient with actual views of the patient using an optical code affixed to the patient
Aligning image data of a patient with actual views of the patient using an optical code affixed to the patient. In some embodiments, a method may include affixing an optical code to a patient, affixing a pattern of markers to the patient, capturing image data of the patient, sensing the optical code affixed to the patient and a position of the optical code in a 3D space, accessing the image data, calculating the position of the pattern of markers in the 3D space, registering the position of the inner layer of the patient in the 3D space by aligning the calculated position of the pattern of markers in the 3D space with the position of the pattern of markers in the image data, and displaying in real-time, in an alternate reality (AR) headset, the inner layer of the patient from the image data projected onto actual views of the patient.
1. A method for aligning image data of a patient with actual views of the patient using an optical code affixed to the patient, the method comprising:
affixing an optical code to a patient, the optical code being perceptible to an optical sensor;
affixing a pattern of markers to the patient in a fixed position relative to a position of the optical code, the pattern of markers being perceptible to a non-optical imaging modality;
capturing image data of the patient using the non-optical imaging modality, the image data including an inner layer of the patient, the image data further including the pattern of markers in a fixed position relative to a position of the inner layer of the patient;
sensing, with an optical sensor of an augmented reality (AR) headset, the optical code affixed to the patient and a position of the optical code in a 3D space;
accessing the image data, the accessing being performed by the AR headset accessing a network computer where the image data is stored;
calculating, based on the sensed position of the optical code in the 3D space and the fixed position of the pattern of markers relative to the position of the optical code, the position of the pattern of markers in the 3D space;
registering, based on the calculated position of the pattern of markers in the 3D space and the fixed position in the image data of the pattern of markers relative to the position of the inner layer of the patient, the position of the inner layer of the patient in the 3D space by aligning the calculated position of the pattern of markers in the 3D space with the position of the pattern of markers in the image data, the registering being performed by the AR headset; and
displaying in real-time, in the AR headset and based on the registering, the inner layer of the patient from the image data projected onto actual views of the patient.
2. The method as recited in claim 1 , wherein the affixing of the optical code to the patient includes affixing a bandage with the optical code printed thereon to an outside layer of the patient.
3. The method as recited in claim 2 , wherein the affixing of the pattern of markers to the patient in the fixed position relative to the position of the optical code includes the pattern of markers being affixed to the bandage in the fixed position relative to the position of the optical code.
4. The method as recited in claim 3 , wherein the pattern of markers is embedded within the bandage.
5. The method as recited in claim 3 , wherein:
the pattern of markers is embedded within an ink with which the optical code is printed on the bandage; and
the ink includes a material that is perceptible to the non-optical imaging modality.
6. The method as recited in claim 5 , wherein the material that is perceptible to the non-optical imaging modality is a radio-opaque material that is not transparent to X-rays, a magnetically visible material, or a radioactive material.
7. The method as recited in claim 1 , wherein the non-optical imaging modality includes a Magnetic Resonance Imaging (MRI) modality, a Computerized Tomography (CT) scan modality, an X-ray modality, a Positron Emission Tomography (PET) modality, an ultrasound modality, a fluorescence modality, an Infrared Thermography (IRT) modality, or a Single-Photon Emission Computed Tomography (SPECT) scan modality.
8. The method as recited in claim 1 , wherein the image data includes two-dimensional (2D) image data, three-dimensional (3D) image data, four-dimensional (4D) image data, or some combination thereof.
9. The method as recited in claim 1 , wherein the optical code is a linear barcode, a matrix two-dimensional (2D) barcode, a Quick Response (QR) code, or some combination thereof.
10. The method as recited in claim 1 , wherein the optical code is linked to medical data of the patient such that the medical data of the patient can be accessed with the optical code.
11. The method as recited in claim 1 , wherein
the optical code is a security credential linked to medical data of the patient such that the medical data of the patient is accessed with the optical code without additional security credentials.
12. The method as recited in claim 11 , wherein the affixing of the optical code to the patient includes printing the optical code on skin of the patient.
13. The method as recited in claim 11 , wherein the affixing of the optical code to the patient includes placing an article of clothing on the patient with the optical code printed thereon.
14. The method as recited in claim 2 , wherein the bandage is formed from a material that is sterilizable.
15. A method for aligning image data of a patient with actual views of the patient using an optical code affixed to the patient, the method comprising:
affixing a bandage to a patient, the bandage including an optical code printed thereon and a pattern of markers affixed thereto, the pattern of markers having a fixed position in the bandage relative to a position of the optical code on the bandage, the optical code being perceptible to an optical sensor, the pattern of markers being perceptible to a non-optical imaging modality;
capturing image data of the patient using the non-optical imaging modality, the image data including an inner layer of the patient, the image data further including the pattern of markers in a fixed position relative to a position of the inner layer of the patient;
sensing, with an optical sensor of an augmented reality (AR) headset, the optical code affixed to the patient and a position of the optical code in a 3D space;
accessing the image data, the accessing being performed by the AR headset accessing a network computer where the image data is stored;
calculating, based on the sensed position of the optical code in the 3D space and the fixed position of the pattern of markers relative in the bandage to the position of the optical code on the bandage, the position of the pattern of markers in the 3D space;
registering, based on the calculated position of the pattern of markers in the 3D space and the fixed position in the image data of the pattern of markers relative to the position of the inner layer of the patient, the position of the inner layer of the patient in the 3D space by aligning the calculated position of the pattern of markers in the 3D space with the position of the pattern of markers in the image data, the registering being performed by the AR headset; and
displaying in real-time, in the AR headset and based on the registering, the inner layer of the patient from the image data projected onto actual views of the patient.
16. The method as recited in claim 15 , wherein:
the pattern of markers is embedded within an ink with which the optical code is printed on the bandage; and
the ink includes a radio-opaque material that is not transparent to X-rays, a magnetically visible material, or a radioactive material.
17. The method as recited in claim 15 , wherein the optical code is a security credential linked to medical data of the patient such that the medical data of the patient can be accessed with the optical code without additional security credentials.