Co-manipulation surgical system for use with surgical instruments having a virtual map display to facilitate setup
Co-manipulation robotic systems are described herein that may be used for assisting with laparoscopic surgical procedures. The co-manipulation robotic systems allow a surgeon to use commercially-available surgical tools while providing benefits associated with surgical robotics. Advantageously, the surgical tools may be seamlessly coupled to the robot arms using a disposable coupler while the reusable portions of the robot arm remain in a sterile drape. Further, the co-manipulation robotic system may operate in multiple modes to enhance usability and safety, while allowing the surgeon to position the instrument directly with the instrument handle and further maintain the desired position of the instrument using the robot arm.
1. A co-manipulation surgical system comprising:
a robot arm comprising a proximal end, a distal end configured to be removably coupled to a surgical instrument, a plurality of links, and a plurality of joints;
a platform configured to support the robot arm, the platform comprising a plurality of wheels configured to permit mobility of the platform;
an optical sensor mounted on the platform and configured to collect depth data; and
a controller configured to permit the robot arm to move for performing surgery using the surgical instrument, the controller operatively coupled to the optical sensor and comprising instructions that, when executed by one or more processors of the controller, cause the controller to:
receive the depth data collected by the optical sensor;
generate a map of an area surrounding the platform based on the depth data, the map comprising graphical representations of the platform relative to a surgical bed within the area surrounding the platform and a graphical illustration of a proximity between the platform and the surgical bed in real-time; and
cause a display to display the map during movement of the platform to facilitate positioning of the platform a predetermined distance relative to the surgical bed.
2. The co-manipulation surgical system of claim 1 , wherein the optical sensor comprises one or more depth cameras including at least one of a stereo camera, a structured light camera, or a time-of-flight camera.
3. The co-manipulation surgical system of claim 1 , wherein the optical sensor comprises at least one of an electromagnetic, capacitive, or infrared proximity sensor.
4. The co-manipulation surgical system of claim 1 , wherein at least a portion of the optical sensor is at an upper portion of the platform.
5. The co-manipulation surgical system of claim 4 , wherein the optical sensor is configured to collect depth data indicative of at least one of surgical bed height and angular orientation, patient position, trocar port position and orientation, presence of the surgical instrument, surgical instrument position, movement, and orientation, motion of one or more handheld surgical instruments, surgeon movement, presence of a sterile drape, or attachment and detachment of the surgical instrument to the distal end of the robot arm.
6. The co-manipulation surgical system of claim 1 , wherein at least a portion of the optical sensor is at a lower portion of the platform.
7. The co-manipulation surgical system of claim 6 , wherein the optical sensor is configured to collect depth data indicative of at least one of relative position between the platform and the surgical bed, or one or more objects within the area surrounding the platform.
8. The co-manipulation surgical system of claim 1 , wherein the optical sensor comprises a camera at an upper portion of the platform and a proximity sensor at a lower portion of the platform.
9. The co-manipulation surgical system of claim 1 , wherein the optical sensor comprises multiple optical sensors spaced apart on the platform.
10. The co-manipulation surgical system of claim 1 , wherein the optical sensor comprises an adjustable field of view.
11. The co-manipulation surgical system of claim 1 , wherein the map generated by the controller comprises a top perspective of the area surrounding the platform.
12. The co-manipulation surgical system of claim 1 , wherein the map generated by the controller comprises graphical representations of the platform relative to at least one of one or more objects or one or more persons within the area surrounding the platform.
13. The co-manipulation surgical system of claim 12 , wherein the map generated by the controller comprises graphical representations of the platform and the robot arm relative to the at least one of one or more objects or one or more persons within the area surrounding the platform to facilitate avoidance of collision between at least one of the platform or the robot arm with the at least one of one or more objects or one or more persons during movement of the platform.
14. The co-manipulation surgical system of claim 12 , wherein the controller is configured to generate an alert if the map indicates that the platform is within a predetermined distance from the at least one of one or more objects or one or more persons within the area surrounding the platform.
15. The co-manipulation surgical system of claim 14 , wherein the alert comprises at least one of a visual or audible alert.
16. The co-manipulation surgical system of claim 1 , wherein the platform comprises the display coupled thereto.
17. The co-manipulation surgical system of claim 1 , wherein the controller is configured to permit the robot arm to be freely moveable responsive to movement at a handle of the surgical instrument for performing surgery using the surgical instrument.
18. The co-manipulation surgical system of claim 1 , further comprising:
a brake mechanism configured to be engaged to prevent mobility of the platform; and
an actuator operatively coupled to the brake mechanism, the actuator configured to be actuated to disengage the brake mechanism to permit mobility of the platform.
19. The co-manipulation surgical system of claim 18 , wherein the controller is configured to cause the display to display the map only while the braking mechanism is disengaged.
20. The co-manipulation surgical system of claim 1 , wherein the controller is configured to cause the robot arm to move in at least one degree of freedom relative to the platform.
21. The co-manipulation surgical system of claim 20 , wherein the controller is configured to cause the robot arm to move relative to the platform to avoid a collision with at least one of one or more objects or one or more persons based on the depth data collected by the optical sensor.
22. A method for assisting with surgery, the method comprising:
providing a robot arm comprising a plurality of links, a plurality of joints, a proximal end supported by a platform comprising a plurality of wheels configured to permit mobility of the platform, and a distal end configured to be removably coupled to a surgical instrument;
collecting, by a controller operatively coupled to the robot arm, depth data from an optical sensor mounted on the platform;
generating, by the controller, a map of an area surrounding the platform based on the depth data, the map comprising graphical representations of the platform relative to surgical bed within the area surrounding the platform and a graphical illustration of a proximity between the platform and the surgical bed in real-time; and
causing, by the controller, a display to display the map during movement of the platform to facilitate positioning of the platform a predetermined distance relative to the surgical bed.
23. The method of claim 22 , wherein the optical sensor comprises one or more depth cameras including at least one of a stereo camera, a structured light camera, or a time-of-flight camera.
24. The method of claim 22 , wherein the optical sensor comprises at least one of an electromagnetic, capacitive, or infrared proximity sensor.
25. The method of claim 22 , wherein causing the display to display the map comprises causing, by the controller, the display to display the map only while the platform is moving to guide movement of the platform within an operating room.
26. The method of claim 22 , wherein the map comprises graphical representations of the platform relative to an object or person, or both, within the area surrounding the platform.
27. The method of claim 26 , wherein the map further comprises graphical representations of the robot arm relative to the object or person, or both, within the area surrounding the platform to facilitate avoidance of collision between at least one of the platform or the robot arm with the object or person, or both, during movement of the platform.
28. The method of claim 26 , further comprising generating, by the controller, an alert if the map indicates that the platform is within a predetermined distance from the object or person, or both, within the area surrounding the platform.
29. The method of claim 22 , wherein the plurality of wheels comprise a brake mechanism configured to be engaged to prevent mobility of the platform, the method further comprising actuating an actuator operatively coupled to the brake mechanism to disengage the brake mechanism to permit mobility of the platform.
30. The method of claim 22 , further comprising permitting, by the controller, the robot arm to be freely moveable responsive to movement at a handle of the surgical instrument for performing surgery using the surgical instrument.