IP Library Granted Patent US 11,337,602
Granted Patent B2
US 11,337,602 · App. 16/179,568 · Granted May 24, 2022

Endolumenal object sizing

Inventors: David S. Mintz (Mountain View, CA); David M. Schummers (Oakland, CA); Prasanth Jeevan (San Mateo, CA); Hedyeh Rafii-Tari (Mountain View, CA); Ritwik Ummalaneni (San Mateo, CA)
A61B1/307A61B1/00009A61B1/04A61B1/06A61B5/062A61B5/107A61B34/30A61B34/32A61B90/37A61B2034/2051A61B2034/303A61B2090/061A61B2090/364
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,337,602
App. No.
16/179,568
Filed
Nov 2, 2018
Granted
May 24, 2022
Kind
B2
Examiner
LUONG, PETER
Art Unit
3793
USPC
600/476
Abstract

An object sizing system sizes an object positioned within a patient. The object sizing system identifies a presence of the object. The object sizing system navigates an elongate body of an instrument to a position proximal to the object within the patient. An imaging sensor coupled to the elongate body captures one or more sequential images of the object. The instrument may be further moved around within the patient to capture additional images at different positions/orientations relative to the object. The object sizing system also acquires robot data and/or EM data associated with the positions and orientations of the elongate body. The object sizing system analyzes the captured images based on the acquired robot data to estimate a size of the object.

Claims (47)

1. A method for sizing an object within a patient, the method comprising:

navigating an elongate body to a location within the patient and proximate to the object, the elongate body comprising an imaging sensor for capturing images of the object and a basket for capturing the object;

capturing sequential images of the object and the basket with the imaging sensor while navigating the elongate body into at least one of a different orientation and a different position;

accessing, with a processor, a set of robot data indicative of the orientation and position of the elongate body during the capture of the sequential images, wherein the accessed set of robot data comprises data from which a position and size of the basket can be determined; and

analyzing, with the processor, the sequential images to estimate a size of the object based on:

identifying those images depicting at least a portion of the object and at least a portion of the basket; and

determining the estimated size of the object based on the position and the size of the basket relative to the object in the identified images.

2. The method of claim 1 , wherein analyzing the sequential images comprises segmenting the sequential images to remove the basket from the analyzed images.

3. The method of claim 2 , wherein analyzing the sequential images comprises determining a structure of the object based on the segmented images.

4. The method of claim 1 , further comprising capturing the object with the basket.

5. The method of claim 4 , wherein capturing the sequential images occurs before capturing the object with the basket.

6. The method of claim 4 , wherein capturing the sequential images occurs after capturing the object with the basket.

7. The method of claim 4 , wherein analyzing the sequential images comprises:

detecting a basket marker in the sequential images; and

determining a distance to the object based on the detected basket marker,

wherein determining the estimated size of the object is further based on the distance to the object.

8. The method of claim 1 , wherein the set of robot data comprises at least one of data collected from a robotic manipulator and data collected from an electromagnetic sensor coupled to the elongate body.

9. The method of claim 1 , further comprising inserting a guide wire into the patient to measure a distance from the imaging sensor to the object.

10. The method of claim 1 , wherein analyzing the sequential images comprises:

combining the sequential images via image stitching techniques;

identifying a structure of the object;

determining an estimated size of the identified structure of the object; and

determining the estimated size of the object further based on the estimated size of the structure of the object.

11. The method of claim 10 , wherein the structure of the object comprises at least one of an outer axial diameter and a radius of the object.

12. A system for sizing an object within a patient, the system comprising:

an elongate body comprising an imaging sensor for capturing images of the object and a basket for capturing the object; and

a computer comprising instructions that, when executed by a processor of the computer, cause the computer to:

navigate the elongate body into the patient and to a location proximate to the object, the navigating enabled by a robotic manipulator;

capture sequential images of the object and the basket with the imaging sensor while navigating the elongate body into at least one of a different orientation and a different position;

access a set of robotic data describing the changing orientation and position of the elongate body during the capture of the sequential images; and

analyze the sequential images to estimate a size of the object based on:

identifying those images depicting at least a portion of the object and at least a portion of the basket; and

determining the estimated size of the object based on the position and the size of the basket relative to the object in the identified images.

13. The system of claim 12 , wherein the instructions, when executed by the processor, cause the computer to analyze the sequential images based on segmenting the sequential images to remove the basket from the analyzed images.

14. The system of claim 12 , wherein the instructions, when executed by the processor, cause the computer to instruct the system to capture the object with the basket.

15. The system of claim 14 , wherein the capturing of the sequential images occurs before the capturing of the object with the basket.

16. The system of claim 14 , wherein the capturing of the sequential images occurs after the capturing of the object with the basket.

17. The system of claim 14 , wherein instructions, when executed by theprocessor, cause the computer to analyze the sequential images based on:

detecting a basket marker in the sequential images; and

determining a distance to the object based on the detected basket marker, wherein determining the estimated size of the object is further based on the distance to the object.

18. The system of claim 12 , wherein the set of robot data comprises at least one of data collected from a robotic manipulator and data collected from an electromagnetic sensor coupled to the elongate body.

19. The system of claim 12 , further comprising:

a guide wire, wherein the instructions, when executed by the processor, cause the computer to:

insert the guide wire into the patient to measure a distance from the imaging sensor to the object.

20. The system of claim 12 , wherein the instructions, when executed by theprocessor, cause the computer to analyze the sequential images based on:

combining the sequential images via image stitching techniques; identifying a structure of the object; and

determining the estimated size of the object further based on the identified structure.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 27, 2018
From: MINTZ, DAVID S.; SCHUMMERS, DAVID M.; JEEVAN, PRASANTH; RAFII-TARI, HEDYEH; UMMALANENI, RITWIK
To: AURIS SURGICAL ROBOTICS, INC.
Reel/Frame 047594/0494 →
CHANGE OF NAME Recorded Nov 27, 2018
From: AURIS SURGICAL ROBOTICS, INC.
To: AURIS HEALTH, INC.
Reel/Frame 048175/0651 →
Continuity (2)
Continuation 15392674 · Dec 28, 2016
Related Publication 20190175009A1 · Jun 13, 2019