Image acquisition visuals for augmented reality
Various embodiments of the present disclosure encompass a visual image sequence controller ( 40 ) for controlling an augmentation of a visual imaging sequence acquisition of an interventional imaging sequence in a rendered augmented view of an image-guided intervention by an augmented reality device ( 30 ). The visual imaging sequence acquisition ( 42 ) includes, for each interventional image of the interventional imaging sequence ( 23 ), an interactive virtual indicator of a sequence number of a corresponding interventional image within the interventional imaging sequence ( 23 ) and an imaging parameter of the imaging modality ( 20 ) (e.g., a direction, a rotation and/or an angulation of the imaging modality ( 20 )) during an acquisition of the corresponding interventional image by the imaging modality ( 20 ). The controller ( 40 ) interfaces with the imaging modality ( 20 ) and/or a display ( 24, 31 ) responsive to a user interaction with at least one of the interactive virtual indicators.
1 . A controller for rendering an augmented view of an image-guided intervention, the controller comprising:
at least one processor configured to:
obtain a sequence of images acquired by an image modality during the image-guided intervention;
access geometric information associated with the acquisition of the sequence of images by the imaging modality during the image-guided intervention;
augment the sequence of images with virtual interactive indicators, wherein for each image of the sequence of images, the at least one processor is configured to:
(i) based on the geometric information, determine an imaging parameter of the imaging modality during acquisition of the image,
(ii) generate a first interactive virtual indicator indicating a sequence number of the image within the sequence of images and a second interactive virtual indicator indicating the imaging parameter of the imaging modality during the acquisition of the image, and
(iii) augment the image with the first interactive virtual indicator and the second interactive virtual indicator;
provide the augmented sequence of images to an augmented reality device to augment a view of the image-guided intervention; and
responsive to a user interaction with at least one of the interactive virtual indicators, adjust the imaging modality to acquire a further image.
2 . The controller of claim 1 , wherein the at least one processor is further configured to annotate the augmented sequence of images based on the geometric information.
3 . The controller of claim 1 , wherein the at least one processor is further configured to control display of the augmented sequence of images in the augmented view of the image-guided intervention.
4 . The controller of claim 1 , wherein, responsive to the user interaction with at least one of the interactive virtual indicators, the at least one processor is further configured to adjust a pose of the imaging modality to acquire the further image.
5 . The controller of claim 1 , wherein the controller is installable within the augmented reality device.
6 . The controller of claim 1 , wherein:
the controller is installable within the imaging modality; and
the at least one processor is further configured to communicate the augmented sequence of images from the imaging modality to the augmented reality device.
7 . The controller of claim 1 , wherein:
the controller is installable within an auxiliary intervention device; and
the at least one processor is further configured to communicate the augmented sequence of images from the auxiliary intervention device to the augmented reality device.
8 . A system for rendering an augmented view of an image-guided intervention, the system comprising:
an augmented reality device configured to render an augmented view of an image-guided intervention; and
a controller comprising at least one processor configured to:
obtain a sequence of images acquired by an image modality during the image-guided intervention;
access geometric information associated with the acquisition of the sequence of images by the imaging modality during the image-guided intervention;
augment the sequence of images with virtual interactive indicators, wherein for each image of the sequence of images, the at least one processor is further configured to:
(i) based on the geometric information, determine an imaging parameter of the imaging modality during acquisition of the image,
(ii) generate a first interactive virtual indicator indicating a sequence number of the image within the sequence of images and a second interactive virtual indicator indicating the imaging parameter of the imaging modality during the acquisition of the image, and
(iii) augment the image with the first interactive virtual indicator and the second interactive virtual indicator;
provide the augmented sequence of images to the augmented reality device to augment a view of the image-guided intervention; and
responsive to a user interaction with at least one of the interactive virtual indicators, adjust the imaging modality to acquire a further image.
9 . The system of claim 8 , wherein the at least one processor is further configured to annotate the augmented sequence of images based on the geometric information.
10 . The system of claim 8 , wherein the at least one processor is further configured to control display of the augmented sequence of images in the augmented view of the image-guided intervention.
11 . The system of claim 8 , wherein, responsive to the user interaction with at least one of the interactive virtual indicators, the at least one processor is further configured to adjust a pose of the imaging modality to acquire the further image.
12 . The system of claim 8 , wherein the augmented reality device comprises the controller.
13 . The system of claim 8 , wherein:
the controller is installable within the imaging modality; and
the at least one processor is further configured to communicate the augmented sequence of images from the imaging modality to the augmented reality device.
14 . The system of claim 8 , wherein:
the controller is installable within an auxiliary intervention device; and
wherein the at least one processor is further configured to communicate the augmented sequence of images from the auxiliary intervention device to the augmented reality device.
15 . A method of rendering an augmented view of an image-guided intervention, the method comprising:
obtaining a sequence of images acquired by an image modality during the image-guided intervention;
accessing geometric information associated with the acquisition of the sequence of images by the imaging modality during the image-guided intervention;
augmenting the sequence of images with virtual interactive indicators by, for each image of the sequence of images:
(i) based on the geometric information, determining an imaging parameter of the imaging modality during acquisition of the image,
(ii) generating a first interactive virtual indicator indicating a sequence number of the image within the sequence of images and a second interactive virtual indicator indicating the imaging parameter of the imaging modality during the acquisition of the image, and
(iii) augmenting the image with the first interactive virtual indicator and the second interactive virtual indicator;
augmented, by an augmented reality device, a view of the image-guided intervention based on the augmented sequence of images; and
responsive to a user interaction with at least one of the interactive virtual indicators, adjusting the imaging modality to acquire a further image.
16 . The method of claim 15 , further comprising annotating the augmented sequence of images based on the geometric information.
17 . The method of claim 15 , further comprising controlling display of the augmented sequence of images in the augmented view of the image-guided intervention.
18 . The method of claim 15 , further comprising, responsive to the user interaction with at least one of the interactive virtual indicators, adjusting a pose of the imaging modality to acquire the further image.