IP Library Granted Patent US 10,383,765
Granted Patent B2
US 10,383,765 · App. 14/578,082 · Granted Aug 20, 2019

Apparatus and method for a global coordinate system for use in robotic surgery

Inventors: Jeffery B. Alvarez (Redwood City, CA); Jian Zhang (Sunnyvale, CA); Gregory Kintz (Asheville, NC)
Assignee: Auris Health, Inc.
A61F9/00736A61B3/102A61B3/13A61B5/0059A61B34/30A61B5/0066A61B90/03A61B2090/3735
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,383,765
App. No.
14/578,082
Granted
Aug 20, 2019
Kind
B2
Abstract

An apparatus and method for establishing a global coordinate system to facilitate robotic assisted surgery. The coordinate system may be established using a combination of the robotic data, i.e., kinematics, and optical coherence tomographic images generated by an overhead optical assembly and a tool-based sensor. Using these components, the system may generate a computer-registered three-dimensional model of the patient's eye. In some embodiments, the system may also generate a virtual boundary within the coordinate system to prevent inadvertent injury to the patient.

Claims (45)

1. A system for facilitating robotic surgery, comprising:

a first mechanical arm configured to facilitate operation of an optical assembly that comprises optical components and an optical detector coupled to the first mechanical arm, the first mechanical arm comprising a first joint sensor configured to generate a first location reading for the first mechanical arm;

a second mechanical arm coupled to a surgical tool, the second mechanical arm comprising a second joint sensor configured to generate a second location reading for the second mechanical arm, the surgical tool comprising an optical fiber configured to emit a scanning signal from a distal end of the surgical tool and receive a signal resulting from scattering of the scanning signal;

a visual light microscope configured to provide a view of a target anatomy, the visual light microscope sharing at least one of the optical components of the optical assembly, the at least one shared optical component configured to provide light in a first frequency range to the visual light microscope and provide light in a second frequency range to the optical detector; and

a processor,

wherein the processor is configured to determine locations of the first and second mechanical arms and the tool based on the first and second location readings,

wherein the processor is configured to generate kinematic registration data for the first and second mechanical arms and the tool based on the determined locations,

wherein the processor is configured to obtain a plurality of image slices of the target anatomy based on a signal output from the optical detector,

wherein the processor is configured to generate imaging data including a three-dimensional data model of the target anatomy based on the image slices and the signal resulting from scattering of the scanning signal received from the optical fiber, the three-dimensional data model comprising anatomical contours defining surface data of the target anatomy,

wherein the processor is configured to generate a global coordinate system using the imaging data and the kinematic registration data,

wherein the first and second mechanical arms are robotically-driven, and

wherein the processor is configured to automatically limit movement of the first and second mechanical arms to robotically enforce a virtual boundary comprising a specified distance between the tool and a surface of the target anatomy utilizing the generated global coordinate system, a position of the target anatomy therewithin, and the surface data for avoiding inadvertent injury to the target anatomy.

2. The system of claim 1 , wherein the movement of the first or second mechanical arm into the virtual boundary triggers auditory feedback.

3. The system of claim 1 , wherein the optical assembly is configured to generate stereoscopic images of tissue topology.

4. The system of claim 1 , wherein the first and second joint sensors comprise torque sensors.

5. The system of claim 4 , wherein the first and the second mechanical arms are coupled to one or more movable carts.

6. The system of claim 1 , wherein the first joint sensor comprises a first torque sensor coupled to a first linkage of the first mechanical arm.

7. The system of claim 6 , wherein the second joint sensor comprises a second torque sensor coupled to a second linkage of the second mechanical arm.

8. The system of claim 1 , wherein the first joint sensor comprises a first plurality of joint sensors coupled to a plurality of linkages of the first mechanical arm.

9. The system of claim 1 , wherein the second joint sensor comprises a plurality of joint sensors coupled to a plurality of linkages of the second mechanical arm.

10. The system of claim 1 , wherein:

the tool comprises reflective markers,

the optical assembly is configured to generate the imaging data based on light reflected from the reflective markers, and

the processor is configured to determine a position of the tool based on the imaging data.

11. The system of claim 10 , wherein the reflective markers comprise reflective strips.

12. The system of claim 1 , wherein the processor is configured to: determine that an anatomical change has occurred that would put the surgical tool at risk of colliding with the virtual boundary based on the signal resulting from scattering of the scanning signal received from the optical fiber; and withdraw the surgical tool in response to determining that the anatomical change has occurred.

13. A method for facilitating robotic surgery using a global coordinate system, the method comprising:

determining the location of a first robotically-operated mechanical arm with a first joint sensor on the first robotically-operated mechanical arm;

registering the determined location of the first robotically-operated mechanical arm to a global coordinate system with a processor;

registering the location of an optical assembly with a predetermined focal length to the global coordinate system with the processor, the optical assembly comprising optical components and an optical detector and being operatively coupled to the first robotically-operated mechanical arm;

determining the location of a second robotically-operated mechanical arm with a second joint sensor on the second robotically-operated mechanical arm, the second mechanical arm coupled to a surgical tool comprising an optical fiber;

registering the determined location of the second robotically-operated mechanical arm to the global coordinate system with the processor;

utilizing a visual light microscope configured to view a target anatomy, the visual light microscope sharing at least one of the optical components of the optical assembly, the at least one shared optical component configured to provide light in a first frequency range to the visual light microscope and provide light in a second frequency range to the optical detector;

orienting the optical assembly relative to an operative site in which the target anatomy is located;

registering the location of the operative site in the global coordinate system with the processor using the predetermined focal length of the optical assembly;

scanning the operative site using an optical system integrated into the optical assembly;

retrieving optical data with the processor, the optical data comprising a plurality of image slices of the operative site including the target anatomy based on a signal output from the optical assembly;

emitting a scanning signal from the optical fiber at a distal end of the surgical tool;

receiving a signal at the optical fiber resulting from scattering of the scanning signal;

processing the image slices and the signal resulting from scattering of the scanning signal received from the optical fiber with the processor to generate a three-dimensional model of the operative site and the target anatomy, the three-dimensional data model comprising anatomical contours defining surface data of the target anatomy;

registering the three-dimensional model to the global coordinate system with the processor; and

automatically limiting movement of the second robotically-operated mechanical arms to robotically enforce a virtual boundary in the global coordinate system with the processor, the virtual boundary comprising a specified distance between the surgical tool and a surface of the target anatomy utilizing the registered three-dimensional model of the operative site in the global coordinate system and the surface data.

14. The method of claim 13 , further comprising:

determining that an anatomical change has occurred that would put the surgical tool at risk of colliding with the virtual boundary based on the signal resulting from scattering of the scanning signal received from the optical fiber; and

withdrawing the surgical tool in response to determining that the anatomical change has occurred.

Assignments (2)
CHANGE OF NAME Recorded Nov 20, 2018
From: AURIS SURGICAL ROBOTICS, INC.
To: AURIS HEALTH, INC.
Reel/Frame 048154/0343 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2015
From: ALVAREZ, JEFFERY B.; ZHANG, JIAN; KINTZ, GREGORY
To: AURIS SURGICAL ROBOTICS, INC.
Reel/Frame 035941/0828 →
Continuity (3)
Continuation In Part 13868769 · Apr 23, 2013
Provisional Application 61637426 · Apr 24, 2012
Related Publication 20150335480A1 · Nov 26, 2015
Cited By (63)
US 1,064,266 US 1,095,845 US 1,121,033 US 12,193,750 US 12,193,769 US 12,220,150 US 12,220,189 US 12,226,168 US 12,226,174 US 12,226,175 US 12,232,711 US 12,251,176 US 12,251,178 US 12,268,457 US 12,268,460 US 12,274,525 US 12,285,229 US 12,290,239 US 12,295,672 US 12,295,692 US 12,310,669 US 12,310,804 US 12,311,530 US 12,318,102 US 12,324,645 US 12,329,485 US 12,343,483 US 12,350,449 US 12,357,405 US 12,357,409 US 12,364,557 US 12,370,002 US 12,376,910 US 12,376,918 US 12,376,926 US 12,390,286 US 12,414,686 US 12,414,823 US 12,420,063 US 12,433,696 US 12,447,308 US 12,453,612 US 12,465,431 US 12,465,441 US 12,472,020 US 12,478,444 US 12,491,042 US 12,502,229 US 12,508,085 US 12,521,277 US 12,544,167 US 12,564,459 US 12,569,307 US 12,575,899 US 12,575,901 US 12,582,485 US 12,588,964 US 12,611,266 US 12,616,534 US 12,616,539 US 12,653,374 US 12,672,793 US 12,702,515