IP Library › Granted Patent US 10,674,936
Granted Patent B2
US 10,674,936 · App. 16/560,863 · Granted Jun 9, 2020

Hybrid registration method

Inventors: Dorian Averbuch (Ramat Hasharon, IL); Oded Zur (Kochav-Ya'ir Zur Yigal, IL); Oren P. Weingarten (Herzliya, IL)
Assignee: Covidien LP
A61B5/066A61B1/2676A61B5/06A61B5/064A61B5/7246A61B34/20G06T7/0016G06T7/33A61B90/361A61B2017/00699A61B2034/2072A61B2090/365A61B2090/3762A61B2576/00G06T2207/10068G06T2207/10081G06T2207/30061
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,674,936
App. No.
16/560,863
Granted
Jun 9, 2020
Kind
B2
Abstract

A registration method whereby a sensor-based approach is used to establish initial registration and whereby upon the commencement of navigating an endoscope, image-based registration methods are used in order to more accurately maintain the registration between the endoscope location and previously-acquired images. A six-degree-of-freedom location sensor is placed on the probe in order to reduce the number of previously-acquired images that must be compared to a real-time image obtained from the endoscope.

Claims (38)

1. A method of registering an airway to a three-dimensional 3D model of the airway:

acquiring a plurality of computed tomography (CT) images of the airways of a patient;

generating a 3D model of the airways derived from the plurality of CT images;

generating a plurality of virtual endoscopic images derived from the 3D model;

acquiring an endoscopic image;

comparing the endoscopic image to the plurality of virtual endoscopic images to identify a match between the endoscopic image and a virtual endoscopic image of the plurality of virtual endoscopic images, wherein a viewpoint of the matching virtual endoscopic image substantially corresponds to a viewpoint of the endoscopic image;

determining a position associated with an endoscope in an airway of a patient to form a determined position;

comparing the determined position with a location in the 3D model corresponding to the matching virtual endoscopic image; and

when the determined position and the location in the 3D model substantially correspond, depicting a location of the endoscope in the 3D model.

2. The method of claim 1 , wherein the determining the position includes recording a shape of a segment of the airway and identifying a segment in the 3D model that corresponds to the shape of the recorded segment.

3. The method of claim 1 , wherein the determining the position includes determining a position of a sensor, and

wherein the sensor is an electromagnetic sensor, and the determining the position of the sensor includes detecting electromagnetic fields.

4. The method of claim 3 , wherein the matching virtual endoscopic image defines a subgroup of the plurality of virtual endoscopic images corresponding to a vicinity of the sensor, and

wherein the plurality of virtual endoscopic images and the subgroup are stored in a database.

5. The method of claim 4 , further comprising selecting an image from the subgroup that most accurately corresponds to an approximate location to update an initial registration using an image-based registration technique when the endoscope and the associated sensor are moved.

6. A method of registering sensor location data to images of a patient's at least one body part, comprising:

generating location data corresponding to a location of a sensor within a patient's body by recording a shape of a segment of the patient's at least one body part and identifying a segment in a 3D model, which is derived from computed tomography (CT) images, that corresponds to the shape of the recorded segment;

comparing a plurality of previously acquired images of the patient's at least one body part to a plurality of virtual images derived from the CT images to identify a subgroup of the plurality of previously acquired images of the patient's at least one body part;

registering the location of the sensor relative to the subgroup of the plurality of previously acquired images of the patient's at least one body part based on the location data; and

updating the registered location of the sensor based on one or more images selected from the subgroup.

7. The method of claim 6 , wherein recording the shape of the segment of the patient's at least one body part includes recording a plurality of locations of the sensor.

8. The method of claim 6 , wherein recording the shape of the segment of the patient's at least one body part includes recording a plurality of locations of a respective plurality of sensors disposed along the patient's at least one body part.

9. The method of claim 6 , wherein the sensor is an electromagnetic sensor and generating location data includes sensing electromagnetic fields.

10. The method of claim 6 , wherein the plurality of previously acquired images are a plurality of virtual endoscopic images derived from computer tomography (CT) images stored in a memory, and a matching virtual endoscopic image defines a subset of the plurality of virtual endoscopic images corresponding to a vicinity of the sensor.

11. The method of claim 10 , wherein the subset is a single virtual endoscopic image.

12. The method of claim 10 , wherein the subset includes two or more virtual endoscopic images.

13. The method of claim 6 , wherein the patient's at least one body part is an airway of a lung.

14. A method of registering sensor location data to images of at least one body part, comprising:

generating location data corresponding to a location of a sensor within a patient's body;

comparing a plurality of previously acquired images of the patient's at least one body part to a plurality of virtual images derived from computed tomography (CT) images to identify a subgroup of the plurality of previously acquired images of the patient's at least one body part;

registering the location of the sensor relative to the subgroup of the plurality of previously acquired images of the patient's at least one body part based on the location data;

updating the registered location of the sensor based on one or more images selected from the subgroup; and

displaying the one or more images selected from the subgroup.

15. The method of claim 14 , wherein the registered location is updated based on a single image and the single image is displayed.

16. The method of claim 14 , wherein generating location data includes recording a shape of a segment of an airway and identifying a segment in a 3D model of lungs that corresponds to the shape of the recorded segment.

17. The method of claim 16 , further comprising converting a plurality of computed tomography (CT) images of the lungs into a series of digitally-identified branches to develop the 3D model of the lungs.

18. The method of claim 14 , wherein the sensor is an electromagnetic sensor and generating location data includes sensing electromagnetic fields.

19. The method of claim 14 , wherein the plurality of previously acquired images are a plurality of virtual images derived from computer tomography (CT) images stored in a memory, and a virtual image matching an image acquired by an endoscope associated with the sensor defines a subset of the plurality of virtual images corresponding to a vicinity of the sensor.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2019
From: AVERBUCH, DORIAN; ZUR, ODED; WEINGARTEN, OREN
To: SUPERDIMENSION, LTD.
Reel/Frame 050284/0012 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2019
From: SUPERDIMENSION, LTD.
To: COVIDIEN GROUP S.A.R.L.
Reel/Frame 050292/0544 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2019
From: COVIDIEN GROUP S.A.R.L.
To: COVIDIEN LP
Reel/Frame 050292/0642 →
Continuity (7)
Continuation 16372776 · Apr 2, 2019
Continuation 15055698 · Feb 29, 2016
Continuation 13875685 · May 2, 2013
Continuation 13287883 · Nov 2, 2011
Division 12478573 · Jun 4, 2009
Provisional Application 61059669 · Jun 6, 2008
Related Publication 20190388005A1 · Dec 26, 2019
Cited By (2)
US 12,251,174 US 12,310,677