IP Library › Granted Patent US 12,193,640
Granted Patent B2
US 12,193,640 · App. 17/838,857 · Granted Jan 14, 2025

Systems and methods for robotic bronchoscopy navigation

Inventors: Kyle Ross Danna (Scotts Valley, CA); Jian Zhang (San Mateo, CA); Carol Kayee Hung (Palo Alto, CA); Michael J. Shawver (Mill Valley, CA); Piotr Robert Slawinski (South San Francisco, CA); Hendrik Thompson (San Francisco, CA); Liya K. Abraha (San Francisco, CA)
Assignee: Noah Medical Corporation
A61B1/00147A61B1/00158A61B34/10A61B34/20A61B34/30G06F18/24147A61B2034/105A61B2034/107A61B2034/2051A61B2034/301A61B2034/303
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,193,640
App. No.
17/838,857
Granted
Jan 14, 2025
Kind
B2
Abstract

A method is provided for auto registration for a robotic endoscopic apparatus. The method comprises: (a) generate a first transformation between an orientation of the robotic endoscopic apparatus and an orientation of a location sensor based at least in part on a first set of sensor data collected using the location sensor; (b) generating a second transformation between a coordinate frame of the robotic endoscopic apparatus and a coordinate frame of a model representing an anatomical luminal network based at least in part on the first transformation and a second set of sensor data; and (c) updating, based at least in part on a third set of sensor data, the second transformation using an updating algorithm.

Claims (24)

1. A method for navigating a robotic endoscopic apparatus, the method comprising:

(a) generate a first transformation between an orientation of the robotic endoscopic apparatus and an orientation of a location sensor based at least in part on a first set of sensor data collected using the location sensor;

(b) generating a second transformation between a coordinate frame of the robotic endoscopic apparatus and a coordinate frame of a model representing an anatomical luminal network based at least in part on the first transformation and a second set of sensor data; and

(c) updating, based at least in part on a third set of sensor data, the second transformation using an updating algorithm, wherein the updating algorithm comprises a fast interval recalculation operation and a slow interval recalculation operation and wherein the fast interval recalculation operation comprises (i) calculating a first set of associations using a subset of data sampled from the third set of sensor data and (ii) combining the first set of associations with a second set of associations calculated for generating the second transformation in (b).

2. The method of claim 1 , further comprising calculating a point cloud using the combined first and second set of associations.

3. The method of claim 1 , wherein the slow interval recalculation operation comprises a nearest neighbor algorithm.

4. The method of claim 1 , wherein the slow interval recalculation operation comprises updating the second transformation using only the third set of sensor data.

5. The method of claim 1 , wherein the location sensor is an electromagnetic sensor.

6. The method of claim 1 , wherein the coordinate frame of the model representing an anatomical luminal network is generated using a pre-operative imaging system.

7. The method of claim 1 , wherein the robotic endoscopic apparatus comprises a disposable catheter assembly.

8. The method of claim 1 , wherein the location sensor is located at a distal tip of the robotic endoscopic apparatus.

9. A system for navigating a robotic endoscopic apparatus comprising:

a location sensor coupled to the robotic endoscopic apparatus; and

one or more processors in communication with the location sensor and the robotic endoscopic apparatus and configured to execute a set of instructions to cause the system to:

(a) generate a first transformation between an orientation of the robotic endoscopic apparatus and an orientation of the location sensor based at least in part on a first set of sensor data collected using the location sensor;

(b) generate a second transformation between a coordinate frame of the robotic endoscopic apparatus and a coordinate frame of a model representing an anatomical luminal network based at least in part on the first transformation and a second set of sensor data; and

(c) update, based at least in part on a third set of sensor data, the second transformation using an updating algorithm, wherein the updating algorithm comprises a fast interval recalculation operation and a slow interval recalculation operation and wherein the fast interval recalculation operation comprises (i) calculating a first set of associations using a subset of data sampled from the third set of sensor data and (ii) combining the first set of associations with a second set of associations calculated for generating the second transformation in (b).

10. The system of claim 9 , wherein the fast interval recalculation operation further comprises calculating a point cloud using the combined first and second set of associations.

11. The system of claim 9 , wherein the slow interval recalculation operation comprises a nearest neighbor algorithm.

12. The system of claim 9 , wherein the slow interval recalculation operation comprises updating the second transformation using only the third set of sensor data.

13. The system of claim 9 , wherein the location sensor is an electromagnetic sensor.

14. The system of claim 9 , wherein the coordinate frame of the model representing the anatomical luminal network is generated using a pre-operative imaging system.

15. The system of claim 9 , wherein the robotic endoscopic apparatus comprises a disposable catheter assembly.

16. The system of claim 9 , wherein the location sensor is located at a distal tip of the robotic endoscopic apparatus.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2022
From: DANNA, KYLE ROSS; ZHANG, JIAN; HUNG, CAROL KAYEE; SHAWVER, MICHAEL J.; SLAWINSKI, PIOTR ROBERT; THOMPSON, HENDRIK; ABRAHA, LIYA K.
To: NOAH MEDICAL CORPORATION
Reel/Frame 060521/0515 →
Continuity (4)
Continuation PCTUS2020066067 · Dec 18, 2020
Provisional Application 63091283 · Oct 13, 2020
Provisional Application 62950740 · Dec 19, 2019
Related Publication 20220361736A1 · Nov 17, 2022
References Cited (18)
US 20070167700A1 · Rahn · 2007 [cited by examiner]
US 20080049994A1 · Rognin · 2008 [cited by examiner]
US 20100002955A1 · George · 2010 [cited by examiner]
US 20150305612A1 · Hunter · 2015 [cited by examiner]
US 20170035380A1 · Barak et al. · 2017 [cited by applicant]
US 20170172457A1 · Govari · 2017 [cited by examiner]
US 20180279852A1 · Rafii-Tari et al. · 2018 [cited by applicant]
US 20190313910A1 · Vignon et al. · 2019 [cited by applicant]
US 20190320878A1 · Duindam et al. · 2019 [cited by applicant]
US 20190340800A1 · Merlet et al. · 2019 [cited by applicant]
US 20190340838A1 · Gluhovsky et al. · 2019 [cited by applicant]
US 20190365209A1 · Ye · 2019 [cited by examiner]
US 20220296302A1 · Bleunven · 2022 [cited by examiner]
WO WO2021127475A1 · 2021 [cited by applicant]
Elseberg et al. Comparison of nearest-neighbor-search strategies and implementations for efficient shape registration. Journal of Software Engineering for Robotics. Mar. 2023, 2-12. [cited by applicant]
PCT/US2020/066067 Search Report & Written Opinion dated Mar. 10, 2021. [cited by applicant]
Pomerleau et al. A Review of Point Cloud Registration Algorithms for Mobile Robotics. Foundations and Trends in Robotics, Now Publishers, 2015, 4(1), pp. 1-104. [cited by applicant]
EP20901611.2 Extended European Search Report dated Nov. 23, 2023. [cited by applicant]