Surgical robotic system having grip-dependent control
Surgical robotic systems, and methods of controlling such systems based on a user's grip on a user interface device, are described. During a surgical procedure, a surgical robotic system generates control commands to actuate a component of the surgical robotic system. The component can be a surgical tool that is actuated to move based on tracking data from the user interface device. The component can be the user interface device, which is actuated to render haptic feedback to the user's hand based on load data from a surgical robotic arm holding the surgical tool. In either case, the actuation is based on a center of rotation of the user interface device that corresponds to the user's grip on the user interface device. Other embodiments are described and claimed.
1. A method of controlling a surgical robotic system based on a user's grip on a user interface device, the method comprising:
determining a grip configuration of a user's hand on a user interface device of a surgical robotic system;
determining, based on the grip configuration, a virtual center of rotation of the user interface device; and
generating, based on the virtual center of rotation of the user interface device, control commands to actuate a component of the surgical robotic system.
2. The method of claim 1 , wherein determining the grip configuration includes detecting, by one or more proximity sensors, positions of one or more fingers of the user's hand on the user interface device.
3. The method of claim 2 , wherein the user interface device includes a tracking sensor having a sensor center of rotation, and wherein the virtual center of rotation does not coincide with the sensor center of rotation.
4. The method of claim 3 , wherein determining the grip configuration includes determining whether the positions of the one or more fingers of the user's hand is anterior to or posterior to the sensor center of rotation of the tracking sensor.
5. The method of claim 2 , wherein the virtual center of rotation is determined to be at a location between the positions of the one or more fingers of the user's hand on the user interface device.
6. The method of claim 2 , wherein the one or more proximity sensors are time-of-flight sensors.
7. The method of claim 1 further comprising:
receiving tracking data from a tracking sensor of the user interface device, wherein the tracking data corresponds to movement of the tracking sensor in six degrees of freedom; and
wherein the component is a surgical tool of the surgical robotic system such that generating the control commands is to actuate the surgical tool based on the virtual center of rotation and the tracking data to move the surgical tool in six degrees of freedom.
8. The method of claim 1 further comprising:
receiving load data from a load sensor of the surgical robotic system, wherein the load data corresponds to a force applied to a surgical tool of the surgical robotic system; and
wherein the component is the user interface device such that generating the control commands is to actuate the user interface device based on the virtual center of rotation and the load data to render haptic feedback corresponding to the force to the user's hand.
9. A surgical robotic system, comprising:
a surgical tool mounted on a surgical robotic arm;
a user interface device; and
one or more processors configured to:
determine a grip configuration of a user's hand on the user interface device,
determine, based on the grip configuration, a virtual center of rotation of the user interface device, and
generate, based on the virtual center of rotation of the user interface device, control commands to actuate one or more of the surgical tool or the user interface device.
10. The surgical robotic system of claim 9 , wherein determining the grip configuration includes detecting, by one or more proximity sensors, positions of one or more fingers of the user's hand on the user interface device.
11. The surgical robotic system of claim 10 , wherein the user interface device includes a tracking sensor having a sensor center of rotation, and wherein the virtual center of rotation does not coincide with the sensor center of rotation.
12. The surgical robotic system of claim 10 , wherein the virtual center of rotation is determined to be at a location between the positions of the one or more fingers of the user's hand on the user interface device.
13. The surgical robotic system of claim 9 further comprising:
receiving tracking data from a tracking sensor of the user interface device, wherein the tracking data corresponds to movement of the tracking sensor in six degrees of freedom; and
wherein generating the control commands is to actuate the surgical tool based on the virtual center of rotation and the tracking data to move the surgical tool in six degrees of freedom.
14. The surgical robotic system of claim 9 further comprising:
receiving load data from a load sensor of the surgical robotic system, wherein the load data corresponds to a force applied to the surgical tool of the surgical robotic system; and
wherein generating the control commands is to actuate the user interface device based on the virtual center of rotation and the load data to render haptic feedback corresponding to the force to the user's hand.
15. A non-transitory computer-readable medium storing instructions, which when executed by one or more processors of a surgical robotic system, cause the surgical robotic system to perform a method comprising:
detecting, by one or more proximity sensors, positions of one or more fingers of a user's hand on a user interface device;
determining, based on the positions of the one or more fingers, a virtual center of rotation of the user interface device; and
generating, based on the virtual center of rotation of the user interface device, control commands to actuate a component of the surgical robotic system.
16. The non-transitory computer-readable medium of claim 15 , wherein the user interface device includes a tracking sensor having a sensor center of rotation, and wherein the virtual center of rotation does not coincide with the sensor center of rotation.
17. The non-transitory computer-readable medium of claim 15 , wherein the virtual center of rotation is determined to be at a location between the positions of the one or more fingers of the user's hand on the user interface device.
18. The non-transitory computer-readable medium of claim 15 storing instructions to cause the surgical robotic system to perform the method further comprising:
receiving tracking data from a tracking sensor of the user interface device, wherein the tracking data corresponds to movement of the tracking sensor in six degrees of freedom; and
wherein the component is a surgical tool of the surgical robotic system such that generating the control commands is to actuate the surgical tool based on the virtual center of rotation and the tracking data to move the surgical tool in six degrees of freedom.
19. The non-transitory computer-readable medium of claim 15 storing instructions to cause the surgical robotic system to perform the method further comprising:
receiving load data from a load sensor of the surgical robotic system, wherein the load data corresponds to a force applied to a surgical tool of the surgical robotic system; and
wherein the component is the user interface device such that generating the control commands is to actuate the user interface device based on the virtual center of rotation and the load data to render haptic feedback corresponding to the force to the user's hand.
20. The non-transitory computer-readable medium of claim 15 , wherein the one or more proximity sensors are time-of-flight sensors.