IP Library Granted Patent US 10,674,891
Granted Patent B2
US 10,674,891 · App. 14/627,937 · Granted Jun 9, 2020

Method for assisting navigation of an endoscopic device

Inventors: Lutz Blohm (Möhrendorf, DE); Philip Mewes (Nürnberg, DE)
Assignee: Siemens Aktiengesellschaft
A61B1/00006A61B1/00147A61B5/06A61B5/6847A61B5/062A61B5/4244A61B2034/2051A61B2034/301A61B2090/066A61B2090/365
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,674,891
App. No.
14/627,937
Granted
Jun 9, 2020
Kind
B2
Abstract

A method for assisting navigation of an endoscopic device using a controller with the aid of a digital image data record of an imaging examination modality is provided. The digital image data record describes an image of an object to be examined with the aid of the endoscopic device in a cavity element. A digital two-dimensional or multi-dimensional model of the object to be examined is determined based on the image data record. An operating action that predetermines a relative location of a sensor of the endoscopic device in relation to the object based on the model is received. The model is registered with the endoscopic device and/or a digital endoscopic data record supplied by the endoscopic device. An initial location of the sensor is compared with the predetermined location, and a navigation signal for navigating the endoscopic device is generated taking into account the predetermined relative location.

Claims (63)

1. A method for assisting navigation of an endoscopic device using a controller with the aid of at least one digital image data record of an imaging examination modality, the at least one digital image data record describing an image of an object to be examined with the aid of the endoscopic device in a cavity element, the method comprising:

determining a digital two-dimensional or multi-dimensional model of the object to be examined based on the at least one image data record;

receiving an operating action that predetermines a relative location of a sensor of the endoscopic device in relation to the object based on the digital model;

registering the digital model with the endoscopic device, a digital endoscopic data record supplied by the endoscopic device, or the endoscopic device and the digital endoscopic data record;

comparing an initial location of the sensor with the predetermined relative location;

determining a navigation path from the initial location of the sensor to the predetermined relative location;

modifying the determined navigation path as a function of a technical embodiment of the sensor and a restricting condition that compromises a capacity for movement of the endoscopic device; and

generating a navigation signal for navigating the endoscopic device taking into account the predetermined relative location.

2. The method of claim 1 , wherein navigation of the endoscopic device within the cavity element of a patient is assisted.

3. The method of claim 1 , further comprising:

modifying the predetermined location to an alternative location.

4. The method of claim 3 , further comprising:

determining an entry position of the endoscopic device into the cavity element and determining the navigation path from the determined entry position to the predetermined relative location;

modifying the determined entry position as a function of the technical embodiment of the sensor, as a function of the restricting condition that compromises the capacity for movement of the endoscopic device, or as a function of the technical embodiment of the sensor and the restricting condition;

or a combination thereof.

5. The method of claim 1 , further comprising generating and outputting, by an output facility, a navigation instruction using the navigation signal.

6. The method of claim 1 , further comprising:

determining a position of the sensor of the endoscopic device based on an image data record of the at least one digital image data record supplied by the imaging examination modality, based on a position signal supplied by a magnetic sensor, an optical locator, a mechanical/kinematic, kinematic, or robotic locator, or a combination thereof, or supplied by the endoscopic device, or a combination thereof;

transferring, outputting, or transferring and outputting the determined position to the digital model;

or a combination thereof.

7. The method of claim 3 , further comprising automatically or semi-automatically controlling the endoscopic device along the navigation path, the controlling comprising automatically or semi-automatically controlling a control device connected to the endoscopic device using the navigation signal.

8. The method of claim 1 , wherein the registering takes place after receipt of the operating action.

9. A controller comprising:

a processor configured to assist navigation of an endoscopic device with the aid of at least one digital image data record of an imaging examination modality, the at least one digital image data record describing an image of an object to be examined with the aid of the endoscopic device in a cavity element, the processor further configured to:

determine a digital two-dimensional or multi-dimensional model of the object to be examined based on the at least one image data record;

receive an operating action that predetermines a relative location of a sensor of the endoscopic device in relation to the object based on the digital model;

register the digital model with the endoscopic device, a digital endoscopic data record supplied by the endoscopic device, or the endoscopic device and the digital endoscopic data record;

compare an initial location of the sensor with the predetermined relative location;

determine a navigation path from the initial location of the sensor to the predetermined relative location;

modify the determined navigation path as a function of a technical embodiment of the sensor and a restricting condition that compromises a capacity for movement of the endoscopic device; and

generate a navigation signal for navigating the endoscopic device taking into account the predetermined relative location.

10. An endoscopic device comprising:

a controller configured to assist navigation of an endoscopic device with the aid of at least one digital image data record of an imaging examination modality, the at least one digital image data record describing an image of an object to be examined with the aid of the endoscopic device in a cavity element, the controller further configured to:

determine a digital two-dimensional or multi-dimensional model of the object to be examined based on the at least one image data record;

receive an operating action that predetermines a relative location of a sensor of the endoscopic device in relation to the object based on the digital model;

register the digital model with the endoscopic device, a digital endoscopic data record supplied by the endoscopic device, or the endoscopic device and the digital endoscopic data record;

compare an initial location of the sensor with the predetermined relative location;

determine a navigation path from the initial location of the sensor to the predetermined relative location;

modify the determined navigation path as a function of a technical embodiment of the sensor and a restricting condition that compromises a capacity for movement of the endoscopic device; and

generate a navigation signal for navigating the endoscopic device taking into account the predetermined relative location.

11. A computer program product comprising at least one non-transitory computer readable storage medium that stores program code having instructions executable by a controller for assisting navigation of an endoscopic device with the aid of at least one digital image data record of an imaging examination modality, the at least one digital image data record describing an image of an object to be examined with the aid of the endoscopic device in a cavity element, the instructions comprising:

determining a digital two-dimensional or multi-dimensional model of the object to be examined based on the at least one image data record;

receiving an operating action that predetermines a relative location of a sensor of the endoscopic device in relation to the object based on the digital model;

registering the digital model with the endoscopic device, a digital endoscopic data record supplied by the endoscopic device, or the endoscopic device and the digital endoscopic data record;

comparing an initial location of the sensor with the predetermined relative location;

determining a navigation path from the initial location of the sensor to the predetermined relative location;

modifying the determined navigation path as a function of a technical embodiment of the sensor a restricting condition that compromises a capacity for movement of the endoscopic device; and

generating a navigation signal for navigating the endoscopic device taking into account the predetermined relative location.

12. The computer program product of claim 11 , wherein navigation of the endoscopic device within the cavity element of a patient is assisted.

13. The computer program product of claim 11 , wherein the instructions further comprise:

modifying the predetermined location to an alternative location.

14. The computer program product of claim 13 , wherein the instructions further comprise:

determining an entry position of the endoscopic device into the cavity element and determining the navigation path from the determined entry position to the predetermined relative location;

modifying the determined entry position as a function of the technical embodiment of the sensor, as a function of the restricting condition that compromises the capacity for movement of the endoscopic device, or as a function of the technical embodiment of the sensor and the restricting condition;

or a combination thereof.

15. The computer program product of claim 11 , wherein the instructions further comprise generating and outputting, by an output facility, a navigation instruction using the navigation signal.

16. The computer program product of claim 11 , wherein the instructions further comprise:

determining a position of the sensor of the endoscopic device based on an image data record of the at least one digital image data record supplied by the imaging examination modality, based on a position signal supplied by a magnetic sensor, an optical locator, a mechanical/kinematic, kinematic, or robotic locator, or a combination thereof, or supplied by the endoscopic device, or a combination thereof;

transferring, outputting, or transferring and outputting the determined position to the digital model;

or a combination thereof.

17. The computer program product of claim 13 , wherein the instructions further comprise automatically or semi-automatically controlling the endoscopic device along the navigation path, the controlling comprising automatically or semi-automatically controlling a control device connected to the endoscopic device using the navigation signal.

18. The computer program product of claim 11 , wherein the registering takes place after receipt of the operating action.

19. The method of claim 1 , wherein the technical embodiment of the sensor includes a symmetry of a tip of the endoscopic device, a geometry of the tip of the endoscopic device, a flexibility of the tip of the endoscopic device, a predetermined viewing angle of the sensor, an acquisition angle of the sensor, an angle of inclination, an angle of a surface of the sensor, or any combination thereof.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE PREVIOUSLY RECORDED AT REEL: 066088 FRAME: 0256. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2024
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 071178/0246 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066088/0256 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2020
From: SIEMENS AKTIENGESELLSCHAFT
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 054377/0299 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 17, 2015
From: BLOHM, LUTZ; MEWES, PHILIP
To: SIEMENS AKTIENGESELLSCHAFT
Reel/Frame 036122/0180 →
Priority Claims (1)
DE 10 2014 203 097 · Feb 20, 2014 · national
Continuity (1)
Related Publication 20150230689A1 · Aug 20, 2015