Systems and methods related to robotic guidance in surgery
A surgical implant planning computer positions an implant device relative to a bone of a patient. An initial image of a bone is obtained. An initial location data structure is obtained that contains data defining mapping between locations on the implant device and corresponding locations relative to the bone in the initial image. A target image of the bone of the patient is obtained. A transformation matrix is generated that transforms a contour of a portion of the bone in the initial image to satisfy a defined rule for conforming to a contour of a corresponding portion of the bone in the target image. A transformed location data structure is generated based on applying the transformation matrix to the initial location data structure. A graphical representation of the implant device is displayed overlaid at locations on the target image of the bone determined based on the transformed location data structure.
1. A method by a surgical implant planning computer for positioning a surgical implant device relative to a bone of a patient, the method comprising:
generating a transformation matrix that transforms a portion of the bone in an initial image to satisfy a defined rule for conforming to a corresponding portion of the bone in a target image;
generating a transformed location data structure based on applying the transformation matrix to an initial location data structure, wherein the initial data structure includes data defining mapping between a set of locations on the surgical implant device and a corresponding set of locations relative to the bone in the initial image; and
displaying a graphical representation of the surgical implant device overlaid at locations on the target image of the bone determined based on the transformed location data structure.
2. The method of claim 1 , wherein the surgical implant device comprises a surgical screw, and further comprising:
determining locations of a tip and a tail of the surgical screw relative to the bone in the initial image based on the data in the initial location data structure.
3. The method of claim 1 , wherein the generation of the transformation matrix comprises:
modifying a size and/or a rotational angle of the portion of the bone in the initial image to satisfy the defined rule for conforming to a size and/or a rotational angle of the corresponding portion of the bone in the target image.
4. The method of claim 3 , further comprising:
repeating the modification of the size and/or the rotational angle of a plurality of portions of the bone in the initial image to satisfy the defined rule for conforming to the size and/or the rotational angle of a corresponding plurality of portions of the bone in the target image.
5. The method of claim 3 , wherein the modification of the size and/or the rotational angle of the portion of the bone in the initial image, comprises:
applying a best fit transformation of the size and/or the rotational angle of the portion of the bone in the initial image to satisfy the defined rule for conforming to the size and/or the rotational angle of the corresponding portion of the bone in the target image.
6. The method of claim 3 , wherein the modification of the size and/or the rotational angle of the portion of the bone in the initial image, comprises:
applying an affine transformation of the size and/or the rotational angle of the portion of the bone in the initial image to satisfy the defined rule for conforming to the size and/or the rotational angle of the corresponding portion of the bone in the target image.
7. The method of claim 1 , wherein the generation of the transformed location data structure based on applying the transformation matrix to the initial location data structure, comprises:
for a first one of the locations on the surgical implant device defined in the initial location data structure, applying the transformation matrix to transform a corresponding first one of the locations defined by the initial location data structure relative to the bone in the initial image to a transformed first location defined relative to the bone in the target image; and
storing the transformed first location in the transformed location data structure with an association to the first one of the locations on the surgical implant device.
8. The method of claim 7 , further comprising:
generating another transformation matrix that transforms another portion of the bone in the initial image to satisfy the defined rule for conforming to a corresponding another portion of the bone in the target image,
wherein the generation of the transformed location data structure based on applying the transformation matrix to the initial location data structure, further comprises:
for a second one of the locations on the surgical implant device defined in the initial location data structure, applying the other transformation matrix to transform a corresponding second one of the locations defined by the initial location data structure relative to the bone in the initial image to a transformed second location defined relative to the bone in the target image; and
storing the transformed second location in the transformed location data structure with an association to the second one of the locations on the surgical implant device.
9. The method of claim 7 , wherein:
the surgical implant device comprises a surgical screw having a tip location and a tail location defined in the initial location data structure relative to the bone in the initial image; and
the generation of the transformed location data structure based on applying the transformation matrix to the initial location data structure, comprises:
generating a first transformation matrix that transforms a first portion of the bone in the initial image to satisfy the defined rule for conforming to a corresponding first portion of the bone in the target image;
for the tip location on the surgical screw defined in the initial location data structure, applying the first transformation matrix to transform a corresponding first location defined by the initial location data structure relative to the bone in the initial image to a transformed first location defined relative to the bone in the target image;
storing the transformed first location in the transformed location data structure with an association to the tip location on the surgical screw;
generating a second transformation matrix that transforms a second portion of the bone in the initial image to satisfy the defined rule for conforming to a corresponding second portion of the bone in the target image,
for the tail location on the surgical screw defined in the initial location data structure, applying the second transformation matrix to transform a corresponding second location defined by the initial location data structure relative to the bone in the initial image to a transformed second location defined relative to the bone in the target image; and
storing the transformed second location in the transformed location data structure with an association to the tail location on the surgical screw.
10. The method of claim 1 , wherein:
the surgical implant device comprises a surgical screw having a tip location and a tail location defined by the initial location data structure relative to the bone in the initial image; and
the generation of the transformed location data structure based on applying the transformation matrix to the initial location data structure, comprises scaling a distance between the tip and tail locations of the surgical screw defined relative to the bone in the target image based on the transformation matrix.
11. The method of claim 10 , wherein the generation of the transformed location data structure based on applying the transformation matrix to the initial location data structure, further comprises:
scaling a diameter of the surgical screw based on the scaling of the distance between the tip and tail locations of the surgical screw.
12. The method of claim 1 , further comprising:
providing the transformed location data structure to a surgical robotic system to control positioning of a surgical end-effector of the surgical robotic system relative to a location on the bone of the patient based on data of the transformed location data structure.
13. The method of claim 12 , further comprising:
transforming locations that are defined by the transformed location data structure in a reference coordinate system of the target image of the bone to another reference coordinate system of the surgical end-effector;
controlling movement by the surgical robotic system of the surgical end-effector to position the surgical end-effector relative to the location on the bone of the patient based on the transformed locations to facilitate implantation of the surgical implant device in the bone of the patient.
14. The method of claim 1 , further comprising:
determining distances between locations on the surgical implant device defined by the transformed location data structure and adjacent surfaces of the bone in the target image; and
responsive to the determined distances, adjusting where the graphical representation of the surgical implant device is displayed as an overlay on the target image of the bone.
15. The method of claim 1 , further comprising:
obtaining a set of rules defining depth of penetration of the surgical implant device and angle of the penetration relative to a surface of the bone in the target image; and
responsive to the set of rules, adjusting where the graphical representation of the surgical implant device is displayed as an overlay on the target image of the bone.
16. A surgical implant planning computer comprising:
at least one network interface connected to at least one networked server;
a display device;
at least one processor connected to the at least one network interface and the display device; and
at least one memory storing program instructions executed by the at least one processor to perform operations comprising:
generating a transformation matrix that transforms a portion of the bone in an initial image to satisfy a defined rule for conforming to a corresponding portion of the bone in a target image;
generating a transformed location data structure based on applying the transformation matrix to an initial location data structure, wherein the initial data structure includes data defining mapping between a set of locations on the surgical implant device and a corresponding set of locations relative to the bone in the initial image; and
displaying a graphical representation of the surgical implant device overlaid at locations on the target image of the bone determined based on the transformed location data structure.
17. The surgical implant planning computer of claim 16 , wherein:
the surgical implant device comprises a surgical screw having a tip location and a tail location defined by the initial location data structure relative to the bone in the initial image; and
the generation of the transformed location data structure based on applying the transformation matrix to the initial location data structure, comprises scaling a distance between the tip and tail locations of the surgical screw defined relative to the bone in the target image based on the transformation matrix.
18. The surgical implant planning computer of claim 16 , wherein the operations further comprise:
providing the transformed location data structure through the at least one network interface to a surgical robotic system to control positioning of a surgical end-effector of the surgical robotic system relative to a location on the bone of the patient based on data of the transformed location data structure.
19. A surgical system comprising:
a surgical implant planning computer comprising:
at least one network interface connected to at least one networked server;
a display device;
at least one processor connected to the at least one network interface and the display device; and
at least one memory storing program instructions executed by the at least one processor to perform operations comprising:
generating a transformation matrix that transforms a portion of the bone in an initial image to satisfy a defined rule for conforming to a corresponding portion of the bone in a target image;
generating a transformed location data structure based on applying the transformation matrix to an initial location data structure, wherein the initial data structure includes data defining mapping between a set of locations on the surgical implant device and a corresponding set of locations relative to the bone in the initial image; and
displaying a graphical representation of the surgical implant device overlaid at locations on the target image of the bone determined based on the transformed location data structure; and
a surgical robotic system comprising:
a robotic arm configured to position a surgical end-effector; and
a controller connected to the robotic arm, wherein the controller is configured to perform operations comprising:
transforming locations that are defined by the transformed location data structure in a reference coordinate system of the target image of the bone to another reference coordinate system of the surgical end-effector; and
controlling movement of the surgical end-effector to position the surgical end-effector relative to a location on the bone of the patient based on the transformed locations to facilitate implantation of the surgical implant device in the bone of the patient.
20. The surgical system of claim 19 , wherein:
the surgical implant device comprises a surgical screw having a tip location and a tail location defined by the initial location data structure relative to the bone in the initial image;
the operation of generating the transformed location data structure based on applying the transformation matrix to the initial location data structure, comprises scaling a distance between the tip and tail locations of the surgical screw defined relative to the bone in the target image based on the transformation matrix; and
the operation of controlling movement of the surgical end-effector to position the surgical end-effector relative to a location on the bone of the patient based on the transformed locations to facilitate implantation of the surgical implant device in the bone of the patient.