IP Library Granted Patent US 11,676,511
Granted Patent B2
US 11,676,511 · App. 17/346,113 · Granted Jun 13, 2023

System with emulator movement tracking for controlling medical devices

Inventors: Michael Shyh-Yen Ho (San Francisco, CA); David Stephen Mintz (Los Altos Hills, CA); Edward Joseph Menard (San Carlos, CA); Mark A. Lown (Union City, CA); Jason Thomas Wilson (Redwood City, CA); Yanan Huang (Sunnyvale, CA)
Assignee: Auris Health, Inc.
G09B23/28A61B34/35G09B5/02G09B9/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,676,511
App. No.
17/346,113
Granted
Jun 13, 2023
Kind
B2
Abstract

The systems and methods disclosed herein are directed to robotically controlling a medical device to utilize manual skills and techniques developed by surgeons. The system can include an emulator representing a medical device. The system can include at least one detector configured to track the emulator. The system can also include an imaging device configured to track the medical device. The system may be configured to move the medical device to reduce an alignment offset between the location of the emulator and the location of the medical device, to move the imaging device based on the translational movement of the emulator, and/or to move the medical device based on data indicative of an orientation of the emulator.

Claims (49)

1. A system, comprising:

an emulator configured to be held and operated in a free working space (FWS), the emulator representing a medical device at a target site;

at least one detector configured to track the emulator within the FWS;

at least one computer-readable memory having stored thereon executable instructions; and

at least one processor in communication with the at least one computer-readable memory and configured to execute the instructions to cause the system to:

determine an alignment offset between a location of the emulator and a location of the medical device;

during a medical procedure, determine a first movement amount based on a signal from the at least one detector indicative of a first movement of the emulator within the FWS;

adjust the first movement amount by a first adjustment value; and

generate instructions to move the medical device based on the adjusted first movement amount, wherein the movement of the medical device by the adjusted first movement amount reduces the alignment offset between the location of the emulator and the location of the medical device.

2. The system of claim 1 , wherein the alignment offset comprises a plurality of adjustment values configured to iteratively reduce the alignment offset, the plurality of adjustment values including at least the first adjustment value and a second adjustment value.

3. The system of claim 1 , wherein the first adjustment value is a function of at least the first movement of the emulator, the alignment offset between the location of the emulator and the location of the medical device, and the first movement amount.

4. The system of claim 1 , wherein the alignment offset between a location of the emulator and a location of the medical device is expressed as θ′ n =Σ i j φ i , wherein θ′ n is equal to the alignment offset, j is a number of iterations to reduce the alignment offset between a location of the emulator and a location of the medical device to zero, and φ i is the first adjustment value.

5. The system of claim 1 , wherein the at least one processor is configured to execute the instructions to cause the system to:

during the medical procedure, determine a second movement amount based on a signal from the at least one detector indicative of a second movement of the emulator within the FWS;

adjust the second movement amount by a second adjustment value; and

generate instructions to move the medical device based on the adjusted second movement amount, wherein the movement of the medical device by the adjusted second movement amount reduces the alignment offset between the location of the emulator and the location of the medical device.

6. The system of claim 5 , wherein the movement of the medical device by the adjusted first movement amount and the adjusted second movement amount eliminates the alignment offset between the location of the emulator and the location of the medical device.

7. The system of claim 1 , wherein the at least one processor is configured to execute the instructions to cause the system to:

receive, from the at least one detector, first data indicative of at least an orientation of the emulator, the first data comprising roll data, pitch data, and yaw data of the emulator.

8. A method, comprising:

at a system having an emulator and at least one detector, wherein the emulator is configured to be held and operated in a free working space (FWS), the emulator representing a medical device at a target site, and the at least one detector is configured to track the emulator within the FWS:

determining an alignment offset between a location of the emulator and a location of the medical device;

during a medical procedure, determining a first movement amount based on a signal from the at least one detector indicative of a first movement of the emulator within the FWS;

adjusting the first movement amount by a first adjustment value; and

generating instructions to move the medical device based on the adjusted first movement amount, wherein the movement of the medical device by the adjusted first movement amount reduces the alignment offset between the location of the emulator and the location of the medical device.

9. The method of claim 8 , wherein the alignment offset comprises a plurality of adjustment values configured to iteratively reduce the alignment offset, the plurality of adjustment values including at least the first adjustment value and a second adjustment value.

10. The method of claim 8 , wherein the first adjustment value is a function of at least the first movement of the emulator, the alignment offset between the location of the emulator and the location of the medical device, and the first movement amount.

11. The method of claim 8 , wherein the alignment offset between a location of the emulator and a location of the medical device is expressed as θ′ n =Σ i j φ i , wherein θ′ n is equal to the alignment offset, j is a number of iterations to reduce the alignment offset between a location of the emulator and a location of the medical device to zero, and φ i is the first adjustment value.

12. The method of claim 8 , further comprising:

during the medical procedure, determining a second movement amount based on a signal from the at least one detector indicative of a second movement of the emulator within the FWS;

adjusting the second movement amount by a second adjustment value; and

generating instructions to move the medical device based on the adjusted second movement amount, wherein the movement of the medical device by the adjusted second movement amount reduces the alignment offset between the location of the emulator and the location of the medical device.

13. The method of claim 12 , wherein the movement of the medical device by the adjusted first movement amount and the adjusted second movement amount eliminates the alignment offset between the location of the emulator and the location of the medical device.

14. The method of claim 8 , further comprising:

receiving, from the at least one detector, first data indicative of at least an orientation of the emulator, the first data comprising roll data, pitch data, and yaw data of the emulator.

15. A non-transitory computer readable storage medium comprising one or more programs, the one or more programs comprising computer-executable instructions, which when executed by a system having an emulator and at least one detector, wherein the emulator is configured to be held and operated in a free working space (FWS), the emulator representing a medical device at a target site, and the at least one detector is configured to track the emulator within the FWS, cause the system to perform operations comprising:

determining an alignment offset between a location of the emulator and a location of the medical device;

during a medical procedure, determining a first movement amount based on a signal from the at least one detector indicative of a first movement of the emulator within the FWS;

adjusting the first movement amount by a first adjustment value; and

generating instructions to move the medical device based on the adjusted first movement amount, wherein the movement of the medical device by the adjusted first movement amount reduces the alignment offset between the location of the emulator and the location of the medical device.

16. The non-transitory computer readable storage medium of claim 15 , wherein the alignment offset comprises a plurality of adjustment values configured to iteratively reduce the alignment offset, the plurality of adjustment values including at least the first adjustment value and a second adjustment value.

17. The non-transitory computer readable storage medium of claim 15 , wherein the first adjustment value is a function of at least the first movement of the emulator, the alignment offset between the location of the emulator and the location of the medical device, and the first movement amount.

18. The non-transitory computer readable storage medium of claim 15 , the operations further comprising:

during the medical procedure, determining a second movement amount based on a signal from the at least one detector indicative of a second movement of the emulator within the FWS;

adjusting the second movement amount by a second adjustment value; and

generating instructions to move the medical device based on the adjusted second movement amount, wherein the movement of the medical device by the adjusted second movement amount reduces the alignment offset between the location of the emulator and the location of the medical device.

19. The non-transitory computer readable storage medium of claim 18 , wherein the movement of the medical device by the adjusted first movement amount and the adjusted second movement amount eliminates the alignment offset between the location of the emulator and the location of the medical device.

20. The non-transitory computer readable storage medium of claim 15 , the operations further comprising:

receiving, from the at least one detector, first data indicative of at least an orientation of the emulator, the first data comprising roll data, pitch data, and yaw data of the emulator.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2021
From: HO, MICHAEL SHYH-YEN
To: MINDTRIBE PRODUCT ENGINEERING, INC.
Reel/Frame 057949/0436 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2021
From: MINTZ, DAVID S.; MENARD, EDWARD JOSEPH; LOWN, MARK A.; WILSON, JASON TOMAS; HUANG, YANAN
To: AURIS HEALTH, INC.
Reel/Frame 057949/0527 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2021
From: MINDTRIBE PRODUCT ENGINEERING, INC.
To: AURIS HEALTH, INC.
Reel/Frame 057949/0639 →
Continuity (3)
Continuation 15657051 · Jul 21, 2017
Provisional Application 62365308 · Jul 21, 2016
Related Publication 20210304639A1 · Sep 30, 2021