Methods and systems for alignment of a subject for medical imaging
Methods and systems for alignment of a subject for medical imaging are disclosed, and involve providing a reference image of an anatomical region of the subject, the anatomical region comprising a target tissue, processing the reference image to generate an alignment reference image, displaying the alignment reference image concurrently with real-time video of the anatomical region, and aligning the real-time video with the alignment reference image to overlay the real-time video with the alignment reference image. Following such alignment, the subject may be imaged using, for example, fluorescence imaging, wherein the fluorescence imaging may be performed by an image acquisition assembly aligned in accordance with the alignment.
1. A method of aligning a camera, the method comprising:
receiving a reference image of an anatomical region of a subject, the anatomical region comprising a target tissue;
processing the reference image to generate an alignment reference image;
displaying the alignment reference image on a display concurrently with real-time video of the anatomical region acquired from the camera;
dynamically updating the displayed real-time video to reflect adjustments to a current alignment of the camera relative to the anatomical region of the subject; and
displaying the real-time video and the alignment reference image as overlaid with one another when the current alignment of the camera is aligned with a predefined alignment associated with the reference image;
determining that the current alignment is aligned with the predefined alignment, wherein the determination is performed before initiating illuminating, by a light source, of the target tissue to induce fluorescence emission and is performed before initiating capturing, by the camera, of a time series of fluorescence input data from the fluorescence emission;
in response to the determining that the current alignment is aligned with the predefined alignment:
initiating the illuminating, by the light source, the target tissue to induce the fluorescence emission;
initiating the capturing, by the camera, the time series of fluorescence input data from the fluorescence emission, wherein the camera is configured to receive fluorescence images for fluorescence medical imaging.
2. The method of claim 1 , wherein the fluorescence medical imaging comprises quantitative fluorescence imaging, qualitative fluorescence imaging, or a combination thereof.
3. The method of claim 1 , comprising, in response to detecting that the current alignment is not aligned with the predefined alignment, ceasing the illuminating and the capturing.
4. The method of claim 1 , wherein inducing fluorescence emission comprises inducing fluorescence emission from an endogenous fluorophore, from an exogenous fluorescence imaging agent, or a combination thereof.
5. The method of claim 4 , wherein the exogenous fluorescence imaging agent comprises indocyanine green (ICG).
6. The method of claim 1 , further comprising quantifying the fluorescence input data.
7. The method of claim 1 , further comprising, while the current alignment is aligned with the predefined alignment, acquiring the real-time video and processing the real-time video to quantify the target tissue.
8. The method of claim 7 , wherein the acquiring and processing of the real time video is initiated in response to detecting that the current alignment is aligned with the predefined alignment.
9. The method of claim 7 , wherein quantifying the target tissue comprises calculating a dimension of the target tissue.
10. The method of claim 7 , further comprising, in response to detecting that the current alignment is not aligned with the predefined alignment, ceasing the acquiring and processing of the real-time video.
11. The method of claim 1 , wherein receiving the reference image comprises receiving the reference image from a camera.
12. The method of claim 1 , wherein receiving the reference image comprises retrieving stored data representing the reference image.
13. The method of claim 1 , wherein the reference image is a white light image, a white light-derived image, a fluorescence image, a fluorescence-derived image, or a combination of any one or more thereof.
14. The method of claim 1 , wherein processing the reference image to generate the alignment reference image comprises applying transparency to the reference image.
15. The method of claim 1 , further comprising displaying an alignment indicator on the display, wherein the alignment indicator indicates a difference between the current alignment and the predefined alignment, and wherein the alignment indicator is distinct from the real-time video and the alignment reference image.
16. The method of claim 15 , wherein indicating a difference between the current alignment and the predefined alignment comprises displaying a line between a first portion of the alignment reference image depicting a portion of the anatomical region and a corresponding portion of the real-time video depicting the portion of the anatomical region.
17. The method of claim 16 , wherein the line indicates a direction in which the current alignment should be adjusted to align with the predefined alignment.
18. The method of claim 1 , further comprising, in response to detecting that the current alignment is aligned with the predefined alignment, displaying on the display a notification that the current alignment is aligned with the predefined alignment, wherein the notification is distinct from the real-time video and the alignment reference image.
19. The method of claim 1 , further comprising, in response to detecting that the current alignment is aligned with the predefined alignment, providing one of an auditory and a haptic notification that the current alignment is aligned with the predefined alignment.
20. The method of claim 1 , wherein the reference image comprises one or both of a white light image and a processed image.
21. The method of claim 1 , wherein the real-time video comprises one or both of a white light image and a processed image.
22. The method of claim 1 , further comprising applying an algorithm to determine that the current alignment is aligned with the predefined alignment.
23. The method of claim 22 , wherein applying the algorithm comprises calculating an image transformation matrix including a translation and a rotation for aligning the current alignment and the predefined alignment.
24. A fluorescence imaging agent for use in the method of claim 1 for aligning the camera.
25. The fluorescence imaging agent of claim 24 , wherein aligning the camera comprises aligning for blood flow imaging, tissue perfusion imaging, lymphatic imaging, or a combination thereof.
26. The fluorescence imaging agent of claim 25 , wherein the blood flow imaging, tissue perfusion imaging, and/or lymphatic imaging comprises blood flow imaging, tissue perfusion imaging, and/or lymphatic imaging during an invasive surgical procedure, a minimally invasive surgical procedure, or during a non-invasive surgical procedure.
27. The fluorescence imaging agent of claim 26 , wherein the invasive surgical procedure comprises a cardiac-related surgical procedure or a reconstructive surgical procedure.
28. The fluorescence imaging agent of claim 27 , wherein the cardiac-related surgical procedure comprises a cardiac coronary artery bypass graft (CABG) procedure.
29. The fluorescence imaging agent of claim 28 , wherein the CABG procedure is on pump or off pump.
30. The method of claim 1 , wherein the camera is mounted on a camera arm.
31. An alignment system comprising:
a display;
a camera;
a processor; and
memory storing instructions that, when executed by the processor, cause the processor to:
receive a reference image of an anatomical region of a subject, the anatomical region comprising a target tissue;
process the reference image to generate an alignment reference image;
display the alignment reference image on a display concurrently with real-time video of the anatomical region acquired from the camera;
update the displayed real-time video to reflect adjustments to a current alignment of the camera relative to the anatomical region of the subject; and
display the real-time video and the alignment reference image as overlaid with one another when the current alignment of the camera is aligned with a predefined alignment associated with the reference image;
determine that the current alignment is aligned with the predefined alignment, wherein the determination is performed before initiating illuminating, by a light source, of the target tissue to induce fluorescence emission and is performed before initiating capturing, by the camera, of a time series of fluorescence input data from the fluorescence emission;
in response to the determining that the current alignment is aligned with the predefined alignment, the instructions further cause the processor to:
initiate the illumination, by the light source, of the target tissue to induce the fluorescence emission;
initiate the capture, by the camera, of the time series of fluorescence input data from the fluorescence emission, wherein the camera is configured to receive fluorescence images for fluorescence medical imaging.
32. The system of claim 31 , wherein the fluorescence images are for fluorescence imaging, the fluorescence imaging comprising quantitative fluorescence imaging, qualitative fluorescence imaging, or a combination thereof.
33. The system of claim 31 , wherein the instructions cause the processor to, in response to detecting that the current alignment is not aligned with the predefined alignment, cease the illuminating and the capturing.
34. The system of claim 31 , wherein inducing fluorescence emission comprises inducing fluorescence emission from an endogenous fluorophore, from an exogenous fluorescence imaging agent, or a combination thereof.
35. The system of claim 34 , wherein the exogenous fluorescence imaging agent comprises indocyanine green (ICG).
36. The system of claim 35 , wherein the instructions cause the processor to quantify the fluorescence input data.
37. The system of claim 31 , wherein the instructions cause the processor to, while the current alignment is aligned with the predefined alignment, acquire the real-time video and process the real-time video to quantify the target tissue.
38. The system of claim 37 , wherein the acquiring and processing of the real time video is initiated in response to detecting that the current alignment is aligned with the predefined alignment.
39. The system of claim 37 , wherein quantifying the target tissue comprises calculating a dimension of the target tissue.
40. The system of claim 37 , wherein the instructions cause the processor to, in response to detecting that the current alignment is not aligned with the predefined alignment, cease the acquiring and processing of the real-time video.
41. The system of claim 31 , wherein receiving the reference image comprises receiving the reference image from a camera.
42. The system of claim 31 , wherein receiving the reference image comprises retrieving stored data representing the reference image.
43. The system of claim 31 , wherein the reference image is a white light image, a white light-derived image, a fluorescence image, a fluorescence-derived image, or a combination of any one or more thereof.
44. The system of claim 31 , wherein processing the reference image to generate the alignment reference image comprises applying transparency to the reference image.
45. The system of claim 31 , wherein the instructions cause the processor to display an alignment indicator on the display, wherein the alignment indicator indicates a difference between the current alignment and the predefined alignment, and wherein the alignment indicator is distinct from the real-time video and the alignment reference image.
46. The system of claim 45 , wherein indicating a difference between the current alignment and the predefined alignment comprises displaying a line between a first portion of the alignment reference image depicting a portion of the anatomical region and a corresponding portion of the real-time video depicting the portion of the anatomical region.
47. The system of claim 46 , wherein the line indicates a direction in which the current alignment should be adjusted to align with the predefined alignment.
48. The system of claim 47 , wherein the instructions cause the processor to, in response to detecting that the current alignment is aligned with the predefined alignment, display on the display a notification that the current alignment is aligned with the predefined alignment, wherein the notification is distinct from the real-time video and the alignment reference image.
49. The system of claim 31 , wherein the instructions cause the processor to, in response to detecting that the current alignment is aligned with the predefined alignment, provide one of an auditory and a haptic notification that the current alignment is aligned with the predefined alignment.
50. The system of claim 31 , wherein the reference image comprises one or both of a white light image and a processed image.
51. The system of claim 31 , wherein the real-time video comprises one or both of a white light image and a processed image.
52. The system of claim 31 , wherein the instructions cause the processor to apply an algorithm to determine that the current alignment is aligned with the predefined alignment.
53. The system of claim 52 , wherein applying the algorithm comprises calculating an image transformation matrix including a translation and a rotation for aligning the current alignment and the predefined alignment.
54. A kit for aligning a camera, the kit comprising the system of claim 31 and a fluorescence imaging agent.
55. A fluorescence imaging agent for use in the system of claim 31 for aligning the camera.
56. The system of claim 31 , comprising a camera arm on which the camera is mounted.
57. A non-transitory computer readable storage medium storing instructions, wherein the instructions are executable by a system having a display, a camera, and a processor to cause the system to:
receive a reference image of an anatomical region of a subject, the anatomical region comprising a target tissue;
process the reference image to generate an alignment reference image;
display the alignment reference image on a display concurrently with real-time video of the anatomical region acquired from the camera;
update the displayed real-time video to reflect adjustments to a current alignment of the camera relative to the anatomical region of the subject; and
display the real-time video and the alignment reference image as overlaid with one another when the current alignment of the camera is aligned with a predefined alignment associated with the reference image;
determine that the current alignment is aligned with the predefined alignment, wherein the determination is performed before initiating illuminating, by a light source, of the target tissue to induce fluorescence emission and is performed before initiating capturing, by the camera, of a time series of fluorescence input data from the fluorescence emission;
in response to the determining that the current alignment is aligned with the predefined alignment, the instructions further cause the processor to:
initiate the illumination, by the light source, of the target tissue to induce the fluorescence emission;
initiate the capture, by the camera, of the time series of fluorescence input data from the fluorescence emission, wherein the camera is configured to receive fluorescence images for fluorescence medical imaging.
58. The non-transitory computer readable storage medium of claim 57 , wherein the fluorescence images are for fluorescence imaging, the fluorescence imaging comprising quantitative fluorescence imaging, qualitative fluorescence imaging, or a combination thereof.
59. The non-transitory computer readable storage medium of claim 57 , wherein the instructions cause the processor to, in response to detecting that the current alignment is not aligned with the predefined alignment, cease the illuminating and the capturing.
60. The non-transitory computer readable storage medium of claim 57 , wherein inducing fluorescence emission comprises inducing fluorescence emission from an endogenous fluorophore, from an exogenous fluorescence imaging agent, or a combination thereof.
61. The non-transitory computer readable storage medium of claim 60 , wherein the exogenous fluorescence imaging agent comprises indocyanine green (ICG).
62. The non-transitory computer readable storage medium of claim 61 , wherein the instructions cause the processor to quantify the fluorescence input data.
63. The non-transitory computer readable storage medium of claim 57 , wherein the instructions cause the processor to, while the current alignment is aligned with the predefined alignment, acquire the real-time video and process the real-time video to quantify the target tissue.
64. The non-transitory computer readable storage medium of claim 63 , wherein the acquiring and processing of the real time video is initiated in response to detecting that the current alignment is aligned with the predefined alignment.
65. The non-transitory computer readable storage medium of claim 63 , wherein quantifying the target tissue comprises calculating a dimension of the target tissue.
66. The non-transitory computer readable storage medium of claim 63 , wherein the instructions cause the processor to, in response to detecting that the current alignment is not aligned with the predefined alignment, cease the acquiring and processing of the real-time video.
67. The non-transitory computer readable storage medium of claim 57 , wherein receiving the reference image comprises receiving the reference image from a camera.
68. The non-transitory computer readable storage medium of claim 57 , wherein receiving the reference image comprises retrieving stored data representing the reference image.
69. The non-transitory computer readable storage medium of claim 57 , wherein the reference image is a white light image, a white light-derived image, a fluorescence image, a fluorescence-derived image, or a combination of any one or more thereof.
70. The non-transitory computer readable storage medium of claim 57 , wherein processing the reference image to generate the alignment reference image comprises applying transparency to the reference image.
71. The non-transitory computer readable storage medium of claim 57 , wherein the instructions cause the processor to display an alignment indicator on the display, wherein the alignment indicator indicates a difference between the current alignment and the predefined alignment, and wherein the alignment indicator is distinct from the real-time video and the alignment reference image.
72. The non-transitory computer readable storage medium of claim 71 , wherein indicating a difference between the current alignment and the predefined alignment comprises displaying a line between a first portion of the alignment reference image depicting a portion of the anatomical region and a corresponding portion of the real-time video depicting the portion of the anatomical region.
73. The non-transitory computer readable storage medium of claim 72 , wherein the line indicates a direction in which the current alignment should be adjusted to align with the predefined alignment.
74. The non-transitory computer readable storage medium of claim 73 , wherein the instructions cause the processor to, in response to detecting that the current alignment is aligned with the predefined alignment, display on the display a notification that the current alignment is aligned with the predefined alignment, wherein the notification is distinct from the real-time video and the alignment reference image.
75. The non-transitory computer readable storage medium of claim 57 , wherein the instructions cause the processor to, in response to detecting that the current alignment is aligned with the predefined alignment, provide one of an auditory and a haptic notification that the current alignment is aligned with the predefined alignment.
76. The non-transitory computer readable storage medium of claim 57 , wherein the reference image comprises one or both of a white light image and a processed image.
77. The non-transitory computer readable storage medium of claim 57 , wherein the real-time video comprises one or both of a white light image and a processed image.
78. The non-transitory computer readable storage medium of claim 57 , wherein the instructions cause the processor to apply an algorithm to determine that the current alignment is aligned with the predefined alignment.
79. The non-transitory computer readable storage medium of claim 78 , wherein applying the algorithm comprises calculating an image transformation matrix including a translation and a rotation for aligning the current alignment and the predefined alignment.
80. The non-transitory computer readable storage medium of claim 57 , wherein the camera is mounted on a camera arm.