IP Library › Granted Patent US 12,295,719
Granted Patent B2
US 12,295,719 · App. 17/719,007 · Granted May 13, 2025

Endoscope navigation system with updating anatomy model

Inventors: Derek Scot Tata (Loveland, CO); Peter Douglas Colin Inglis (Boulder, CO); Alexandra R. Hause (Denver, CO)
Assignee: Covidien LP
A61B5/066A61B1/00009A61B1/00016A61B1/0005A61B1/0051A61B1/05A61B1/2676G06T7/33G06T7/75G06T19/003G06T19/20G16H30/40G16H50/50G06T2207/10068G06T2207/10081G06T2207/10088G06T2219/2004G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,295,719
App. No.
17/719,007
Filed
Apr 12, 2022
Granted
May 13, 2025
Kind
B2
Examiner
CHU, DAVID H
Art Unit
2616
USPC
345/420
Abstract

An endoscope navigation system is provided that updates an anatomy model based on a live camera signal. As the endoscope advances within the patient, a camera signal, and corresponding position signal, of the endoscope, is provided and used to update the anatomy model based on identified divergences between the camera signal at a particular position and anatomy model.

Claims (35)

1. An endoscope navigation system, comprising:

an endoscope comprising a steerable distal tip with a camera producing an image signal and with a position sensor producing a position signal indicative of a position of the steerable distal tip;

a graphics controller programmed with instructions to:

render a modeled navigation path in an anatomy model of a patient;

receive the image signal and the position signal;

based on at least the position signal, determine an initial position of the distal tip of the endoscope within the anatomy model;

identify a divergence between the anatomy model and an anatomical feature detected based on at least one of the image signal or the position signal; and

update the initial position of the distal tip of the endoscope in the anatomy model based on the identified divergence to reflect a current physical position of the distal tip of the endoscope; and

a display screen displaying the updated position of the distal tip in the anatomy model.

2. The system of claim 1 , wherein the display screen displays the anatomy model and an image from the image signal.

3. The system of claim 1 , wherein the graphics controller is further programmed with instructions to update the anatomy model based on the divergence, wherein the updated anatomy model comprises an updated modeled navigation path.

4. The system of claim 1 , wherein the graphics controller is further programmed with instructions to update the anatomy model, based on the divergence, by stretching or scaling the anatomy model.

5. The system of claim 1 , wherein displaying the updated position of the distal tip in the anatomy model includes displaying a simulated endoscope rendered in the anatomy model according to the updated position of the steerable distal tip.

6. The system of claim 5 , wherein the graphics controller updates the initial position of the distal tip in the anatomy model by identifying the anatomical feature in the image signal and aligning the simulated endoscope to a portion of the anatomy model corresponding to the identified anatomical feature.

7. The system of claim 1 , wherein the graphics controller:

correlates the position of the steerable distal tip to a correlated location in the anatomy model;

extracts feature data from the image signal acquired at the position; and

identifies the divergence based on a difference between the extracted feature data and the anatomy model at the correlated location.

8. The system of claim 7 , wherein the difference is a dimension of an airway passage.

9. The system of claim 1 , wherein the graphics controller is further programmed with instructions to update only a portion of the anatomy model based on the divergence.

10. The system of claim 1 , wherein the anatomy model is based on previously acquired computer tomography images or magnetic resonance imaging.

11. An endoscope navigation method, comprising:

displaying an anatomy model of a patient on a display screen;

receiving an image signal and a position signal from an endoscope, the position signal indicative of a position of a distal tip of the endoscope during navigation;

based on at least the position signal, determine an initial position of the distal tip of the endoscope within the anatomy model;

rendering a graphical marker at a location in the displayed anatomy model that corresponds to the initial position of the distal tip;

identifying a divergence between an anatomical feature detected in the image signal and the location of the graphical marker in the anatomy model; and

updating the location of the graphical marker in the displayed anatomy model based on the identified divergence to reflect a current physical position of the distal tip of the endoscope.

12. The method of claim 11 , further comprising updating the anatomy model, based on the divergence, by adjusting a dimension of a passage or a position of a passage opening in the anatomy model.

13. The method of claim 11 , further comprising updating the anatomy model, based on the divergence, by adding a nodule or tissue irregularity to the anatomy model or changing a location of the nodule or tissue irregularity in the anatomy model.

14. The method of claim 13 , further comprising rerouting a navigation marker displayed on the anatomy model based on the changed location.

15. The method of claim 11 , wherein the position signal is received from a position sensor located in a distal tip of the endoscope, and the position sensor includes at least one of an accelerometer, a magnetometer, or a gyroscope.

16. The method of claim 11 , further comprising validating a portion of the anatomy model based on the updating and changing one or more display features of the validated portion in the displayed anatomy model.

17. The method of claim 11 , wherein the updating is in substantially real-time.

18. The method of claim 11 , wherein the anatomy model comprises a three-dimensional model of airway passages.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2022
From: TATA, DEREK SCOT; INGLIS, PETER DOUGLAS COLIN; HAUSE, ALEXANDRA R.
To: COVIDIEN LP
Reel/Frame 059576/0514 →
Continuity (2)
Provisional Application 63185186 · May 6, 2021
Related Publication 20220354380A1 · Nov 10, 2022
References Cited (67)
US 8116847B2 · Gattani · 2012 [cited by examiner]
US 8194122B2 · Amling et al. · 2012 [cited by applicant]
US 8652033B2 · Berci et al. · 2014 [cited by applicant]
US 8715172B1 · Girgis · 2014 [cited by applicant]
US 8746239B2 · Yoshida · 2014 [cited by applicant]
US 8827899B2 · Farr et al. · 2014 [cited by applicant]
US 8982199B2 · Amling et al. · 2015 [cited by applicant]
US 9123155B2 · Cunningham et al. · 2015 [cited by applicant]
US 9498112B1 · Stewart et al. · 2016 [cited by applicant]
US 9538908B2 · Allyn et al. · 2017 [cited by applicant]
US 9687141B2 · McGrath · 2017 [cited by applicant]
US 9820641B2 · McGrath · 2017 [cited by applicant]
US 10010379B1 · Gibby et al. · 2018 [cited by applicant]
US 10149957B2 · Runnels · 2018 [cited by applicant]
US 20070197896A1 · Moll et al. · 2007 [cited by applicant]
US 20070236514A1 · Agusanto et al. · 2007 [cited by applicant]
US 20080177146A1 · Chen · 2008 [cited by applicant]
US 20080177148A1 · Chen et al. · 2008 [cited by applicant]
US 20080312507A1 · Kim · 2008 [cited by applicant]
US 20110130632A1 · McGrail et al. · 2011 [cited by applicant]
US 20110137127A1 · Schwartz · 2011 [cited by applicant]
US 20110245609A1 · Laser · 2011 [cited by applicant]
US 20120157834A1 · Lazebnik · 2012 [cited by examiner]
US 20120294498A1 · Popovic · 2012 [cited by examiner]
US 20130057667A1 · McGrath · 2013 [cited by applicant]
US 20130267838A1 · Fronk et al. · 2013 [cited by applicant]
US 20140031700A1 · Ferrantelli · 2014 [cited by applicant]
US 20140160261A1 · Miller et al. · 2014 [cited by applicant]
US 20140275760A1 · Lee et al. · 2014 [cited by applicant]
US 20140378763A1 · Atarot · 2014 [cited by applicant]
US 20150031990A1 · Boctor · 2015 [cited by examiner]
US 20160199009A1 · Gilboa · 2016 [cited by applicant]
US 20160242627A1 · Takahashi · 2016 [cited by examiner]
US 20160279365A1 · Esnouf · 2016 [cited by applicant]
US 20170055809A1 · Omoto · 2017 [cited by applicant]
US 20170209071A1 · Zhao · 2017 [cited by examiner]
US 20180132944A1 · Yan · 2018 [cited by examiner]
US 20180193102A1 · Inoue · 2018 [cited by applicant]
US 20180292199A1 · Tojo · 2018 [cited by applicant]
US 20180296281A1 · Yeung et al. · 2018 [cited by applicant]
US 20180324352A1 · Furuhata · 2018 [cited by applicant]
US 20190046417A1 · Flexman · 2019 [cited by examiner]
US 20190133430A1 · Inglis et al. · 2019 [cited by applicant]
US 20190328465A1 · Li · 2019 [cited by examiner]
US 20200138404A1 · Goodman · 2020 [cited by examiner]
US 20200195903A1 · Komp · 2020 [cited by examiner]
US 20200254204A1 · Moffat et al. · 2020 [cited by applicant]
US 20210196398A1 · Ye · 2021 [cited by examiner]
US 20210196425A1 · Shelton, IV · 2021 [cited by examiner]
US 20210353149A1 · Abbosh · 2021 [cited by examiner]
EP 2433553A1 · 2012 [cited by applicant]
JP 2014210085A · 2014 [cited by applicant]
WO 2020005890A1 · 2020 [cited by applicant]
WO 2022133248A1 · 2022 [cited by applicant]
WO 2022266500A1 · 2022 [cited by applicant]
SiMMS Imperial, “NOViSE—Augmented Reality Support”, Feb. 11, 2020, URL: https://www.youtube.com/watch?v=Mq2FFUXSXfY (Year: 2020). [cited by examiner]
International Written Opinion for the International Application No. PCT/IB2022/054037 mailed Jul. 27, 2022 (8 pages). [cited by applicant]
International Search Report for the International Application No. PCT/IB2022/054037 mailed Jul. 27, 2022 (6 pages). [cited by applicant]
Siena, Francesco Luke, et al.; “The development of a novel steerable bougie to assist in airway management,” Austrasian Medical Journal, 2016, vol. 9, No. 5, pp. 124-137. http://dx.doi.org/10.4066/AMJ.2016.2619. [cited by applicant]
Bowers, Nicholas, et al.; “Use of a flexible intubating scope in combination with a channeled video laryngoscope for managing a difficult airway in the emergency department,” The Journal of Emergency Medicine, 2016, vol… [cited by applicant]
Weissbrod, Philip A., et al.; “Reducing injury during video-assisted endotracheal intubation: The “smart stylet” concept,” The Laryngoscope, Nov. 2011, vol. 121, pp. 2391-2393. [cited by applicant]
Rothfield, Kenneth; “The video laryngoscopy market: Past, present, and future,” Anesthesiology News Guide to Airway Management, 2014, pp. 29-34. [cited by applicant]
Lee, Hyung-Chul, “Real-time endoscopic image orientation correction system using an accelerometer and gyrosensor,” PLOS One | https://doi.org/10.1371/journal.pone.0186691 (Nov. 3, 2017). [cited by applicant]
Ambu_aScope_3_Large_Brochure_4963605 (Oct. 2017). [cited by applicant]
International Search Report and Written Opinion for PCT Application PCT/GB2018/053300 dated Feb. 20, 2019; 15 pgs. [cited by applicant]
International Search Report and Written Opinion for PCT/US2020/051734 dated May 14, 2020; 11 pgs. [cited by applicant]
PCT Invitation to Pay Fees, PCT Application No. PCT/EP2020/073196, mailed Nov. 16, 2020. [cited by applicant]