Navigational aid
A surgical robotic system for augmenting a representation of at least a portion of a surgical site for aiding in orienting the representation is disclosed. The system can receive an imaging device signal indicative of the location and orientation of an imaging device relative to a surgical site. The system can augment a representation of at least a portion of the surgical site depending on the received imaging device signal. The system further can receive a further imaging device signal indicative of an updated location and/or orientation of the imaging device. The system can determine a change in at least one of the location and orientation of the imaging device in dependence on the imaging device signal and the further imaging device signal. The system additionally can update the augmented representation in dependence on the determined change; and a display configured to display at least part of the augmented representation.
1. A surgical robotic system for augmenting a representation of at least a portion of a surgical site for aiding in orienting the representation, the system comprising:
a processor configured to:
receive an imaging device signal during a surgical procedure indicative of the location and/or orientation of an imaging device relative to a surgical site,
augment in real time, using an augmentation signal from a controller of the surgical robotic system, a representation of at least a portion of the surgical site in dependence on the received imaging device signal, the augmentation indicating an orientation of the representation of the surgical site,
receive a further imaging device signal during the surgical procedure indicative of an updated location and/or orientation of the imaging device,
determine a change in at least one of the location and orientation of the imaging device in dependence on the imaging device signal and the further imaging device signal, and
update the augmented representation in real time in dependence on the determined change; and
a display configured to display at least part of the augmented representation, wherein the augmentation comprises an indication of one or more of:
a direction opposite to a gravitational direction; and
a direction perpendicular to a plane of a patient table.
2. A surgical robotic system according to claim 1 , in which the augmentation further comprises an indication of one or more of:
an artificial horizon;
a direction towards a portion of the surgical site as a whole; and
a direction towards a portion of a patient's body.
3. A surgical robotic system according to claim 1 , in which the processor is configured to augment the representation at a location indicated by an indicator displayed on the display, the indicator comprising one or more of:
a physical indicator viewable on the display; and
a tip or other predetermined portion of a surgical end effector viewable on the display.
4. A surgical robotic system according to claim 3 , in which the processor is configured to:
augment the representation at one or more points along an edge of an anatomical feature of the representation indicated by the indicator; and
interpolate and/or extrapolate a remainder of the edge from the indicated one or more points.
5. A surgical robotic system according to claim 1 , in which the processor is configured to group augmentations into one or more group of augmentations, the grouping being carried out according to one or more of a system user, a procedure being carried out, a type of procedure being carried out, a feature being augmented, a type of feature being augmented, a point at which action is desired, and time.
6. A surgical robotic system according to claim 5 , in which the processor is configured to determine one or more of:
a distance between augmentations in a group of augmentations;
an area enclosed by augmentations in a group of augmentations; and
a volume enclosed by augmentations in a group of augmentations.
7. A surgical robotic system according to claim 1 , in which the processor is configured to associate the augmentation with a confidence factor indicative of confidence that the augmentation is appropriate for a current procedure.
8. A surgical robotic system according to claim 7 , in which the confidence factor is determined in dependence on one or more of:
a similarity between the current procedure and an earlier procedure;
a similarity between a model used in the current procedure and a model used in an earlier procedure; and
a user who performed the earlier procedure.
9. A surgical robotic system according to claim 1 , in which the processor is configured to:
augment the representation in dependence on a comparison of a current procedure with one or more previous procedures, and/or
augment the representation at a location at which an action is taken.
10. A surgical robotic system according to claim 1 , in which, where the augmentation is not visible on the display, the processor is configured to add a further augmentation indicative of the direction and/or distance to a feature of the representation.
11. A surgical robotic system according to claim 1 , in which at least one of the received imaging device signal and the received further imaging device signal comprises kinematics data relating to the imaging device.
12. A surgical robotic system according to claim 1 , in which the processor is configured to:
determine the augmentation in dependence on augmentation data, the augmentation data comprising the augmentation signal and the augmentation signal being indicative of user input relating to the representation, and/or
track a location of a feature in the representation, and update the augmented representation in dependence on the tracked location and a change in at least one of the imaging device orientation, the imaging device location, a field of view of the imaging device and a field of view of a displayed portion of the representation.
13. A surgical robotic system according to claim 1 , in which the representation is obtained in dependence on 3D model data of a 3D model of at least a portion of the surgical site.
14. A surgical robotic system according to claim 1 , further comprising a memory coupled to the processor, the memory being configured to store at least one of the representation of the surgical site and the augmentation.
15. A method for augmenting a representation of at least a portion of a surgical site for aiding in orienting the representation, the method comprising:
receiving an imaging device signal during a surgical procedure indicative of the location and/or orientation of an imaging device relative to a surgical site,
augmenting in real time, using an augmentation signal from a controller of the surgical robotic system, a representation of at least a portion of the surgical site in dependence on the received imaging device signal, the augmentation indicating an orientation of the representation of the surgical site,
receiving a further imaging device signal during the surgical procedure indicative of an updated location and/or orientation of the imaging device,
determining a change in at least one of the location and orientation of the imaging device in dependence on the imaging device signal and the further imaging device signal,
updating the augmented representation in real time in dependence on the determined change, and
displaying at least part of the augmented representation, wherein the augmentation comprises an indication of one or more of:
a direction opposite to a gravitational direction; and
a direction perpendicular to a plane of a patient table.
16. A method according to claim 15 , comprising one or more of:
determining the augmentation: in dependence on a feature in the representation of the surgical site and/or in dependence on a feature that is not present in a displayed portion of the representation; and
receiving augmentation data, and determining the augmentation in dependence on the received augmentation data.
17. A method according to claim 15 , comprising receiving augmentation data, and determining the augmentation in dependence on the received augmentation data, in which the augmentation data comprises: data indicative of a feature in the representation and/or the augmentation signal, the augmentation signal being indicative of user input relating to the representation.
18. A method according to claim 17 , in which the data indicative of a feature in the representation is indicative of one or more feature group of a set of feature groups.
19. A method according to claim 15 , comprising tracking a location of a feature in the representation, and updating the augmented representation in dependence on the tracked location and a change in at least one of the imaging device orientation, the imaging device location, a field of view of the imaging device and a field of view of a displayed portion of the representation.
20. A surgical robotic system for augmenting a representation of at least a portion of a surgical site for aiding in orienting the representation, the representation being changeable as a result of an imaging device moving relative to the surgical site, the system comprising:
a processor configured to:
receive an imaging device signal during a surgical procedure indicative of the location and/or orientation of an imaging device relative to a surgical site,
augment in real time, using an augmentation signal from a controller of the surgical robotic system, a representation of at least a portion of the surgical site in dependence on the received imaging device signal, the augmentation comprising an artificial horizon indicating an orientation of the representation relative to an operating room in which the surgical procedure is being performed, the augmentation being configured to change as a result of the imaging device moving relative to the surgical site;
receive a further imaging device signal during the surgical procedure indicative of an updated location and/or orientation of the imaging device,
determine a change in at least one of the location and orientation of the imaging device in dependence on the imaging device signal and the further imaging device signal, and
update the augmented representation in real time in dependence on the determined change; and
a display configured to display at least part of the augmented representation.