Anatomical tracking using optical and non-optical sensors
Surgical systems and methods involve an anatomy tracker to be coupled to a patient anatomy. The anatomy tracker includes optical markers and a non-optical sensor. A navigation system includes a camera unit that can track a pose of the anatomy tracker based on optical detection of the optical markers. The navigation system detects a condition wherein at least one of the optical markers is blocked from optical detection by the camera unit. In response to detection of the condition, the navigation system utilizes readings from the non-optical sensor to track the pose of the anatomy tracker.
1 . A surgical system, comprising:
an anatomy tracker configured to be coupled to a patient anatomy, the anatomy tracker comprising optical markers and a non-optical sensor; and
a navigation system comprising a camera unit, wherein the navigation system is configured to:
track a pose of the anatomy tracker based on optical detection of the optical markers by the camera unit;
detect a condition wherein at least one of the optical markers is blocked from optical detection by the camera unit; and
in response to detection of the condition, utilize readings from the non-optical sensor to track the pose of the anatomy tracker.
2 . The surgical system of claim 1 , wherein the navigation system is configured to utilize readings from the non-optical sensor to estimate a pose of the at least one of the optical markers that is blocked from optical detection by the camera unit.
3 . The surgical system of claim 1 , wherein the navigation system is configured to:
detect that the at least one of the optical markers is no longer blocked from optical detection by the camera unit; and
in response, track the pose of the anatomy tracker based on optical detection of the optical markers by the camera unit.
4 . The surgical system of claim 1 , wherein, in response to detection of the condition, the navigation system tracks the pose of the anatomy tracker by further being configured to:
obtain a previous pose of the anatomy tracker that was measured based on optical detection of the optical markers by the camera unit prior to detection of the condition; and
utilize readings from the non-optical sensor to calculate a current pose of the anatomy tracker relative to the previous pose.
5 . The surgical system of claim 1 , wherein the navigation system is configured to:
determine a position error associated with the at least one of the optical markers that is blocked from optical detection by the camera unit; and
trigger an error in response to the position error exceeding a position error tolerance.
6 . The surgical system of claim 5 , wherein the navigation system is configured to:
start a clock in response to detection of the condition; and
adjust the position error tolerance as a function of a time that has elapsed since starting of the clock.
7 . The surgical system of claim 1 , wherein the navigation system is configured to:
utilize readings from the non-optical sensor to determine a velocity error associated with the at least one of the optical markers that is blocked from optical detection by the camera unit, wherein the velocity error varies with distance the at least one of the optical markers from the camera unit.
8 . The surgical system of claim 1 , wherein the navigation system is configured to:
utilize readings from the non-optical sensor to determine an acceleration of the anatomy tracker; and
trigger an error in response to acceleration exceeding a predefined acceleration tolerance.
9 . The surgical system of claim 1 , further comprising a robotic manipulator is configured to control movement of an instrument to manipulate the patient anatomy, and wherein the navigation system is configured to communicate the tracked pose of the anatomy tracker to a control system coupled to the robotic manipulator to enable the robotic manipulator to control or constrain movement of the instrument relative to the patient anatomy.
10 . The surgical system of claim 1 , wherein the anatomy tracker comprises a tracker controller and wherein the optical markers comprise three optical markers, and wherein the navigation system is configured to:
sequentially fire, with the tracker controller, the three optical markers in a cycle; and
detect the condition by determining that less than the three optical markers were detected in the cycle.
11 . The surgical system of claim 1 , wherein the non-optical sensor comprises an accelerometer or a gyroscope.
12 . A method of operating a surgical system, the surgical system including an anatomy tracker configured to be coupled to a patient anatomy, the anatomy tracker comprising optical markers and a non-optical sensor and a navigation system comprising a camera unit, the method comprising:
tracking, with the navigation system, a pose of the anatomy tracker by optically detecting the optical markers by the camera unit;
detecting, with the navigation system, a condition wherein at least one of the optical markers is blocked from optical detection by the camera unit; and
in response to detecting the condition, utilizing, with the navigation system, readings from the non-optical sensor for tracking the pose of the anatomy tracker.
13 . The method of claim 12 , comprising the navigation system utilizing readings from the non-optical sensor for estimating a pose of the at least one of the optical markers that is blocked from optical detection by the camera unit.
14 . The method of claim 12 , comprising the navigation system:
detecting that the at least one of the optical markers is no longer blocked from optical detection by the camera unit; and
in response, tracking the pose of the anatomy tracker by optically detecting the optical markers by the camera unit.
15 . The method of claim 12 , wherein, in response to detection of the condition, the navigation system tracks the pose of the anatomy tracker by:
obtaining a previous pose of the anatomy tracker that was measured based on optical detection of the optical markers by the camera unit prior to detection of the condition; and
utilizing readings from the non-optical sensor for calculating a current pose of the anatomy tracker relative to the previous pose.
16 . The method of claim 12 , comprising the navigation system:
determining a position error associated with the at least one of the optical markers that is blocked from optical detection by the camera unit; and
triggering an error in response to the position error exceeding a position error tolerance.
17 . The method of claim 12 , comprising the navigation system:
utilizing readings from the non-optical sensor for determining a velocity error associated with the at least one of the optical markers that is blocked from optical detection by the camera unit, wherein the velocity error varies with distance the at least one of the optical markers from the camera unit.
18 . The method of claim 12 , comprising the navigation system:
utilizing readings from the non-optical sensor for determining an acceleration of the anatomy tracker; and
triggering an error in response to acceleration exceeding a predefined acceleration tolerance.
19 . The method of claim 12 , wherein the surgical system further includes a robotic manipulator is configured to control movement of an instrument to manipulate the patient anatomy, the method comprising:
communicating, with the navigation system, the tracked pose of the anatomy tracker to a control system of the robotic manipulator; and
based on the tracked pose of the anatomy tracker, controlling the robotic manipulator to control or constrain movement of the instrument relative to the patient anatomy.
20 . The method of claim 12 , wherein the anatomy tracker comprises a tracker controller and wherein the optical markers comprise three optical markers, and comprising:
sequentially firing, with the tracker controller, the three optical markers in a cycle; and
wherein detecting the condition with the navigation system comprises determining that less than the three optical markers were detected in the cycle.