Surgical guidance for surgical tools
An example physical tracking tool includes a main body defining a channel configured to receive a tool, the channel having a longitudinal axis; and one or more physical tracking features attached to the main body, each physical tracking feature comprising a plurality of planar faces, each planar face of the plurality of planar faces including different a graphical pattern of a plurality of graphical patterns.
1 . A method comprising:
obtaining, by one or more processors, image data generated by one or more cameras of a mixed reality (MR) visualization device worn on a head of a surgeon, wherein the image data depicts a scene including a physical tracking tool, the physical tracking tool comprising a main body that is cylindrical and that defines a channel configured to receive an insertable object, the insertable object is rotatable within the channel, the physical tracking tool further comprises one or more physical tracking features that are fixedly attached to the main body, each of the one or more physical tracking features being a polyhedron that comprises a plurality of planar faces, each planar face of the plurality of planar faces including a different graphical pattern of a plurality of pre-determined graphical patterns;
determining, by the one or more processors, based on the image data, coordinates of a plurality of points on two or more of the pre-determined graphical patterns;
determining, by the one or more processors, based on the coordinates and one or more properties of the physical tracking tool, a position and an orientation of the insertable object;
registering, by the one or more processors, a virtual model of a portion of a bone of a patient to a corresponding portion of the bone viewable via the visualization device, the virtual model obtained from a virtual surgical plan for an orthopedic procedure to attach a prosthetic to the bone;
displaying, via the MR visualization device and based on the position and/or the orientation of the insertable object, a first virtual guide and a second virtual guide, wherein the first virtual guide corresponds to a retroversion of the insertable object and is visible superior to the physical tracking tool, the second virtual guide corresponds to an inclination of the insertable object and is visible anterior to the physical tracking tool, the first virtual guide includes a first target angle marker and a first current angle marker, the second virtual guide includes a second target angle marker and a second current angle marker, the first target angle marker is located on the first virtual guide at an anterior/posterior angle of a planned insertion axis, the second target angle marker is located on the second virtual guide at a position corresponding to a superior/inferior angle of the planned insertion axis, the first current angle marker is located in the first virtual guide at a position corresponding to an anterior/posterior angle of a real-world current insertion axis of the insertable object, the second current angle marker is located on the second virtual guide corresponding to a superior/inferior angle of the real-world current insertion axis of the insertable object; and
updating, via the MR visualization device, positions of the first current angle marker and the second current angle marker in response to changes in the position and the orientation of the insertable object.
2 . The method of claim 1 , wherein each graphical pattern of the plurality of pre-determined graphical patterns includes a rectangular perimeter, and wherein determining the coordinates comprises:
determining the coordinates of one or more corners of a rectangular perimeter of a particular graphical pattern.
3 . A computing system comprising:
a mixed reality (MR) visualization device configured to be worn on a head of a surgeon; and
one or more processors implemented in circuitry, the one or more processors configured to:
obtain image data generated by one or more cameras of the MR visualization device, wherein the image data depicts a scene including a physical tracking tool, the physical tracking tool comprising a main body that is cylindrical and that defines a channel configured to receive an insertable object, the insertable object is rotatable within the channel, the physical tracking tool further comprises one or more physical tracking features that are fixedly attached to the main body, each of the one or more physical tracking features being a polyhedron that comprises a plurality of planar faces, each planar face of the plurality of planar faces including a different graphical pattern of a plurality of pre-determined graphical patterns;
determine, based on the image data, coordinates of a plurality of points on two or more of the pre-determined graphical patterns;
determine, based on the coordinates and one or more properties of the physical tracking tool, a position and an orientation of the insertable object;
register a virtual model of a portion of a bone of a patient to a corresponding portion of the bone viewable via the visualization device, the virtual model obtained from a virtual surgical plan for an orthopedic procedure to attach a prosthetic to the bone;
display, via the MR visualization device and based on the position and/or the orientation of the insertable object, a first virtual guide and a second virtual guide, wherein the first virtual guide corresponds to a retroversion of the insertable object and is visible superior to the physical tracking tool, the second virtual guide corresponds to an inclination of the insertable object and is visible anterior to the physical tracking tool, the first virtual guide includes a first target angle marker and a first current angle marker, the second virtual guide includes a second target angle marker and a second current angle marker, the first target angle marker is located on the first virtual guide at an anterior/posterior angle of a planned insertion axis, the second target angle marker is located on the second virtual guide at a position corresponding to a superior/inferior angle of the planned insertion axis, the first current angle marker is located in the first virtual guide at a position corresponding to an anterior/posterior angle of a real-world current insertion axis of the insertable object, the second current angle marker is located on the second virtual guide corresponding to a superior/inferior angle of the real-world current insertion axis of the insertable object; and
update, via the MR visualization device, positions of the first current angle marker and the second current angle marker in response to changes in the position and the orientation of the insertable object.