Robot surgical platform
A surgical implant planning computer is connectable to a fluoroscopy imager, a marker tracking camera, and a robot having a robot base coupled to a robot arm that is movable by motors relative to the robot base. Operations include performing a registration setup mode that determines occurrence of a first condition indicating the marker tracking camera can observe to track reflective markers that are on a fluoroscopy registration fixture of the fluoroscopy imager, and determines occurrence of a second condition indicating the marker tracking camera can observe to track dynamic reference base markers attached to the robot arm and/or an end-effector connected to the robot arm. While both of the first and second conditions occur, operations are allowed to be performed to obtain a first intra-operative fluoroscopic image of a patient along a first plane and to obtain a second intra-operative fluoroscopic image of the patient along a second plane that is orthogonal to the first plane.
1. A surgical implant planning computer comprising:
at least one network interface connectable to a fluoroscopy imager, a marker tracking camera, a robot having a robot base coupled to a robot arm that is movable by motors relative to the robot base, and an end effector attachable to the robot arm;
a display device;
at least one processor; and
at least one memory storing program code that is executed by the at least one processor to perform operations comprising:
performing a registration setup mode comprising determining occurrence of a first condition indicating that the marker tracking camera can track markers that are on a registration fixture of the fluoroscopy imager;
while the first condition is determined to continue to occur, receiving and storing in the memory a first intra-operative fluoroscopic image of a patient along a first plane and a second intra-operative fluoroscopic image of the patient along a second plane that is orthogonal to the first plane;
displaying the stored first and second intra-operative fluoroscopic images on the display device;
receiving a user's selection of a surgical implant from a set of defined surgical implants; and
displaying a graphical implant representing the selected surgical implant as an overlay on both of the displayed first and second intra-operative fluoroscopic images;
controlling angular orientation and location of the displayed graphical implant relative to anatomy shown in the first and second intra-operative fluoroscopic images responsive to receipt of user inputs; and
storing an indication of an angular orientation and a location of the displayed graphical implant in a surgical plan data structure responsive to receipt of a defined user input.
2. The surgical implant planning computer of claim 1 , wherein the operations to display the graphical implant representing the selected surgical implant as an overlay on both of the first and second intra-operative fluoroscopic images, comprise:
determining a trajectory along an axis of the graphical implant; and
displaying a trajectory line that extends from adjacent to a first end of the graphical implant and along the trajectory to facilitate a user visually orienting and positioning the graphical implant relative to a desired insertion location on the bone.
3. The surgical implant planning computer of claim 2 , wherein the operations to control angular orientation and location of the displayed graphical implant relative to the bone shown in the first and second intra-operative fluoroscopic images responsive to receipt of user inputs, comprise:
translating a location of the displayed graphical implant responsive to determining that the user has pressed on a touch-sensitive screen of the display device over a graphical implant while moving location of the user's continued pressing along the touch-sensitive screen; and
angularly pivoting the displayed graphical implant responsive to determining that the user has pressed on the touch-sensitive screen over a portion of the graphical implant while moving location of the user's continued pressing along the touch-sensitive screen.
4. The surgical implant planning computer of claim 2 , wherein the operations to control angular orientation and location of the displayed graphical implant relative to the bone shown in the first and second intra-operative fluoroscopic images responsive to receipt of user inputs, comprise:
selecting a length of the displayed graphical implant from among a set of defined lengths for surgical screws responsive to determining that the user has pressed on a touch-sensitive screen of the display device over a screw tip or a screw head of the graphical screw while moving location of the user's continued pressing along the touch-sensitive screen a measured distance, wherein the selected length is stored in the surgical plan data structure.
5. The surgical implant planning computer of claim 1 , wherein the operations further comprise:
controlling the motors to move the end-effector in a direction along a trajectory defined by the content of the surgical plan data structure; and
controlling location of the displayed graphical implant responsive to the movement of the end-effector along the trajectory.
6. The surgical implant planning computer of claim 1 , wherein the operations further comprise:
while moving the end-effector along the trajectory, further controlling the motors to resist movement of the end-effector in a direction perpendicular to the trajectory until another operation is perform that cancels an end-effector trajectory constraint mode.
7. The surgical implant planning computer of claim 6 , wherein the operations further comprise:
prior to initiating the end-effector trajectory constraint mode, controlling the motors to move the end-effector in a direction upward away from the patient and then toward a location along the trajectory;
preventing initiation of the end-effector trajectory constraint mode before reaching the location along the trajectory; and
controlling angular orientation and location of the displayed graphical screw implant responsive to the movement of the robot arm away from the patient and then toward the location along the trajectory.
8. A method by a surgical implant planning computer, the method comprising:
performing a registration setup mode comprising determining occurrence of a first condition indicating that a marker tracking camera can track markers that are on a fluoroscopy registration fixture of the fluoroscopy imager;
while the first condition is determined to continue to occur, receiving from a fluoroscopic imager and storing in a memory a first intra-operative fluoroscopic image of a patient along a first plane and a second intra-operative fluoroscopic image of the patient along a second plane that is orthogonal to the first plane;
displaying the stored first and second intra-operative fluoroscopic images on a display device;
receiving a user's selection of a surgical implant from a set of defined surgical implants; and
displaying a graphical implant representing the selected surgical implant as an overlay on both of the displayed first and second intra-operative fluoroscopic images; and
controlling angular orientation and location of the displayed graphical implant relative to anatomy shown in the first and second intra-operative fluoroscopic images responsive to receipt of user inputs.
9. The method of claim 8 , wherein the method further includes the step of storing an indication of an angular orientation and a location of the displayed graphical implant in a surgical plan data structure responsive to receipt of a defined user input.
10. The method of claim 8 , wherein displaying the graphical implant representing the selected surgical implant as an overlay on both of the first and second intra-operative fluoroscopic images, comprises:
determining a trajectory along an axis of the graphical implant; and
displaying a trajectory line that extends from adjacent to a tip of the graphical implant and along the trajectory to facilitate a user visually orienting and positioning the graphical implant relative to a desired insertion location.
11. The method of claim 10 , wherein controlling angular orientation and location of the displayed graphical implant relative to an anatomy shown in the first and second intra-operative fluoroscopic images responsive to receipt of user inputs, comprises:
translating a location of the displayed graphical implant responsive to determining that the user has pressed on a touch-sensitive screen of the display device over an implant body of the graphical implant while moving location of the user's continued pressing along the touch-sensitive screen; and
angularly pivoting the displayed graphical implant responsive to determining that the user has pressed on the touch-sensitive screen over the graphical implant while moving location of the user's continued pressing along the touch-sensitive screen.
12. The method of claim 11 , wherein controlling angular orientation and location of the displayed graphical implant relative to the bone shown in the first and second intra-operative fluoroscopic images responsive to receipt of user inputs, comprises:
selecting a length of the displayed graphical implant from among a set of defined lengths for surgical implant responsive to determining that the user has pressed on a touch-sensitive screen of the display device over graphical implant while moving location of the user's continued pressing along the touch-sensitive screen a measured distance,
wherein the selected length is stored in the surgical plan data structure.
13. The method of claim 8 , further comprising:
controlling the motors to move the end-effector in a direction along a trajectory defined by the content of the surgical plan data structure; and
controlling location of the displayed graphical implant responsive to the movement of the end-effector along the trajectory.
14. The method of claim 8 , further comprising:
while moving the end-effector along the trajectory, further controlling the motors to resist movement of the end-effector in a direction perpendicular to the trajectory until another operation is perform that cancels an end-effector trajectory constraint mode.
15. The method of claim 14 , further comprising:
prior to initiating the end-effector trajectory constraint mode, controlling the motors to move the end-effector in a direction upward away from the patient and then toward a location along the trajectory;
preventing initiation of the end-effector trajectory constraint mode before reaching the location along the trajectory; and
controlling angular orientation and location of the displayed graphical implant responsive to the movement of the robot arm away from the patient and then toward the location along the trajectory.
16. A computer program product for a surgical implant planning computer, the computer program product comprising:
a non-transitory computer readable medium storing program code that is executable by at least one processor of the surgical implant planning computer to perform operations comprising:
performing a registration setup mode comprising determining occurrence of a first condition indicating that a marker tracking camera can track reflective markers that are on a fluoroscopy registration fixture of the fluoroscopy imager, and determining occurrence of a second condition indicating that the marker tracking camera can observe to track dynamic reference base markers attached to a robot arm or an end-effector attached to the robot arm;
while both of the first and second conditions are determined to continue to occur, allowing operations to be performed to obtain a first intra-operative fluoroscopic image of a patient along a first plane and to obtain a second intra-operative fluoroscopic image of the patient along a second plane that is orthogonal to the first plane;
displaying the first and second intra-operative fluoroscopic images on a display device;
receiving a user's selection of a surgical implant from a set of defined surgical implants;
displaying a graphical implant representing the selected surgical implant as an overlay on both of the displayed first and second intra-operative fluoroscopic images;
determining a trajectory along an axis of the graphical implant; and
displaying a trajectory line that extends from adjacent to a first end of the graphical implant and along the trajectory to facilitate a user visually orienting and positioning the graphical implant relative to a desired insertion location on the bone;
controlling angular orientation and location of the displayed graphical implant relative to an anatomical part of a patient shown in the first and second intra-operative fluoroscopic images responsive to receipt of user inputs; and
storing an indication of an angular orientation and a location of the displayed graphical implant in a surgical plan data structure responsive to receipt of a defined user input.