IP Library › Granted Patent US 10,390,780
Granted Patent B2
US 10,390,780 · App. 13/554,435 · Granted Aug 27, 2019

Method and X-ray device for temporal up-to-date representation of a moving section of a body, computer program product and data carrier

Inventors: Jing Feng Han (Shanghai, CN); Matthias John (Nürnberg, DE)
Assignee: Siemens Healthcare GmbH
A61B6/487A61B6/504A61B6/5235A61B6/5247A61B6/5264A61B8/4254A61B8/483A61B8/5261A61B6/4441A61B6/488A61B6/503A61B8/0883A61B8/0891A61B8/12A61B8/5276A61B2034/2051A61B2090/364A61B2090/376A61B2090/378
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,390,780
App. No.
13/554,435
Filed
Jul 20, 2012
Granted
Aug 27, 2019
Kind
B2
Art Unit
3793
USPC
600/427
Abstract

A computer-implemented method for temporal up-to-date representation of a moving section of a body is provided. A first x-ray image data record is provided containing the moving section in a specific movement phase and a first 2D x-ray image and a 3D x-ray image superimposed and registered with one another. 2D x-ray images are repeatedly recorded each containing the moving section. 3D ultrasound images are repeatedly recorded each containing the moving section. Extended 2D x-ray images are created from the 2D x-ray images using the first x-ray images data record. The 3D ultrasound images are used as intermediaries for movement correction. The extended 2D images are displayed.

Claims (33)

1. A method for temporally up-to-date displaying a moving section of a body, comprising:

providing an x-ray image data record comprising image data of the moving section in a movement phase, the image data record comprising a 2D x-ray image superimposed and registered with a 3D x-ray image, wherein the x-ray image data record is a patient-specific model of the moving section;

segmenting the patient-specific model of the moving section in the 3D x-ray image;

repeatedly recording 2D x-ray images comprising image data of the moving object in real time during a medical intervention using an x-ray device, wherein the x-ray device comprises an x-ray emitter, an assigned x-ray detector, and an x-ray image generation unit, or equivalents thereof, wherein the x-ray image generation unit comprises a computer, microprocessor, or equivalents thereof;

repeatedly recording 3D ultrasound images comprising image data of the moving object in real time during the medical intervention using an ultrasound sensor, the 3D ultrasound images recorded simultaneously when recording the 2D x-ray images;

determining and updating a position of the patient-specific model in real time using the recorded 3D ultrasound images and without assignment to a 3D x-ray image,

registering the 3D ultrasound images with the simultaneously recorded 2D x-ray images in real time;

creating real time 2D x-ray images from the recorded 2D x-ray images registered with the recorded 3D ultrasound images, the real time 2D x-ray images comprising the updated position of the moving section using the 3D ultrasound images, wherein the position of the moving section is projected onto the recorded 2D x-ray images in real time using the recorded 3D ultrasound images;

superimposing the segmented patient-specific model of the moving section in the 3D x-ray image with the real time 2D x-ray images to show the updated position of the moving section in real time; and

displaying the superimposed model of the moving section with a display device.

2. The method as claimed in claim 1 , wherein a position and an orientation of the ultrasound sensor for recording the 3D ultrasound image is determined by an electromagnetic tracking method.

3. The method as claimed in claim 2 , wherein an electromagnetic sensor is fastened on the ultrasound sensor or integrated therein and a tracking sensor is fastened to a patient couch of the x-ray device for recording the 2D x-ray image and/or the 3D x-ray image.

4. The method as claimed in claim 3 , wherein the 3D ultrasound images are registered with the recorded 2D x-ray images by a transformation comprising:

T (tee_vol:x_ray_image)= T (tee_vol:tee_sensor)* T (tee_sensor:em_table)* T (em_table:x_ray_vol)* T (x_ray_vol:x_ray_image),

wherein:

tee_vol are the ultrasound volume coordinates of 3D objects,

tee_sensor are the coordinates of the at least one ultrasound sensor,

em_table are the coordinates of the tracking sensor,

x_ray_vol are the volume coordinates of the 3D objects, and

x_ray_image are the coordinates of the 3D objects in the respective of the 2D x-ray image respectively.

5. The method as claimed in claim 1 , wherein a separate region is characterized from the moving section by a segmentation of the 3D ultrasound image, and wherein the separate region is assigned a special position p(tee_vol).

6. The method as claimed in claim 5 , wherein the special position p(tee_vol) is transferred into a segment position p(x_ray_vol) in x-ray volume coordinates of 3D objects by a transformation T(tee_vol:x_ray_vol), and wherein the segment position p(x_ray_vol) is transformed into the 2D x-ray images by a transformation T(x_ray_vol:x_ray_image) for correcting the position of the moving section.

7. The method as claimed in claim 1 , wherein the 3D ultrasound image is recorded by transesophageal echocardiography, and wherein an aorta root is used as a separate region.

8. A device for temporally up-to-date displaying a moving section of a body, the device comprising:

an x-ray device comprising an x-ray emitter, an assigned x-ray detector, and an x-ray image generation unit, or equivalents thereof, wherein the x-ray image generation unit comprises a computer, microprocessor, or equivalents thereof, wherein the x-ray device is configured to record an x-ray image data record comprising image data of the moving section in a movement phase and to repeatedly record 2D x-ray images during a medical intervention, the 2D x-ray images comprising image data of the moving section in real time, wherein the x-ray image data record comprises an 2D x-ray image superimposed and registered with a 3D x-ray image;

an ultrasound image sensor configured to repeatedly record 3D ultrasound images comprising image date of the moving section in real time during the medical intervention simultaneously when recording the 2D x-ray images;

a computer that is configured to:

segment a patient-specific model of the moving section from the 3D x-ray image,

determine and update a position of the patient-specific model in real time using the recorded 3D ultrasound images and without assignment to a 3D x-ray image;

register the 3D ultrasound images with the simultaneously recorded 2D x-ray images in real time;

create real time 2D x-ray images from the recorded 2D x-ray images being registered with the 3D ultrasound images for updating the position of the moving section using the 3D ultrasound images, wherein the position of the moving section is corrected in real time by using the 3D ultrasound images; and

superimpose the patient-specific model of the moving section with the real time 2D x-ray images showing the updated position of the moving section in real time; and

a display device for displaying the superimposed model of the moving section.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE PREVIOUSLY RECORDED AT REEL: 066088 FRAME: 0256. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2024
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 071178/0246 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066088/0256 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2018
From: SIEMENS AKTIENGESELLSCHAFT
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 044573/0584 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2012
From: HAN, JING FENG; JOHN, MATTHIAS
To: SIEMENS AKTIENGESELLSCHAFT
Reel/Frame 028898/0643 →
Priority Claims (1)
DE 10 2011 079 561 · Jul 21, 2011 · national
Continuity (1)
Related Publication 20130023766A1 · Jan 24, 2013
Cited By (10)
US 12,220,176 US 12,225,181 US 12,229,906 US 12,295,798 US 12,310,678 US 12,336,771 US 12,336,868 US 12,349,987 US 12,484,971 US 12,521,188