IP Library › Granted Patent US 11,379,994
Granted Patent B2
US 11,379,994 · App. 16/745,596 · Granted Jul 5, 2022

Method and imaging device for generating a motion-compensated image, computer program, and storage medium

Inventors: Günter Lauritsch (Nuremberg, DE); Christopher Rohkohl (Brixen Im Thale, AT)
Assignee: Siemens Healthcare GmbH
G06T7/246G06T7/277G06T2207/20201G06T2207/30048G06T2207/30101
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,379,994
App. No.
16/745,596
Granted
Jul 5, 2022
Kind
B2
Abstract

The disclosure relates to a method and an imaging device for generating a motion-compensated image of a target object. The disclosure further relates to a corresponding computer program and a computer-readable storage medium. In the method, a reference image is generated from projection images of a target object. Furthermore, a motion field which characterizes a motion of the target object shown is determined iteratively. In each case, after a predetermined number of iterative acts, the existing reference image is replaced by a provisional motion-compensated image, which is then used for the further iteration. The initial reference image is generated without using a synchronization or gating-signal that characterizes a motion of the target object.

Claims (49)

1. A method for generating a motion-compensated image of a target object, the method comprising:

acquiring a plurality of projection images of the target object, the plurality of projection images being recorded during a motion of at least one part of the target object, wherein the motion has a main point;

generating a reference image of the target object from the plurality of projection images without using a synchronization signal that characterizes the motion of the target object; and

iteratively determining, from the plurality of projection images, a motion field that characterizes the motion of the target object, wherein the motion field comprises motion vectors for individual projection images of the plurality of projection images, with respect to a current reference image,

wherein, in each case, after a predetermined number of iterative acts with motion compensation based on the motion field that is then current in each case, a provisional motion-compensated image of the target object is generated,

wherein the respective existing reference image is replaced by the provisional motion-compensated image as a new current reference image,

wherein the iterative determination of the motion field is continued using the new current reference image,

wherein a segmentation of the plurality of projection images and/or of the images generated therefrom is carried out, that by the segmentation, static and/or non-static regions are defined and as a function thereof, the determination of the motion field and/or the use of the motion field is spatially restricted when the motion-compensated image is being generated, and

wherein, when a predetermined termination condition for the iteration is reached, the motion-compensated image is generated from the plurality of projection images and from the last iteration of the motion field, or the last provisional motion-compensated image generated during the iteration as the motion-compensated image of the target object is issued.

2. The method of claim 1 , wherein a sparsification is used for the generating of the reference image, as a result whereof a sparsely populated image is generated as the reference image, which sparely populated image contains, out of all image element values that are available for the respective reference image only highest image element values that have been selected using a predetermined threshold value.

3. The method of claim 1 , wherein the iterative determination of the motion field is implemented as an optimization problem having a predetermined cost function, which as a metric for the optimization problem characterizes a correlation between the respective reference image and an image of the target object generated with the respective current motion field in a motion-compensated manner.

4. The method of claim 3 , wherein a term in the cost function that describes a respective motion-compensated iterative image of the target object has an exponent that is greater than 1.

5. The method of claim 3 , wherein, to solve the optimization problem, an Adam algorithm is used for stochastic optimization.

6. The method of claim 1 , wherein, in each iterative act in the determination of the motion field, only a subset less than all image elements available for this purpose is used, and

wherein the subset is a maximum of 20% of all of the image elements.

7. The method of claim 6 , wherein, from iterative act to iterative act in the determination of the motion field, the subset to be considered in each case is determined at random.

8. The method of claim 1 , wherein at least one static region for the determining of the motion field and/or for a use of the motion field is excluded when generating the motion-compensated image,

wherein the at least one static region is identified as a region that has not been defined as non-static.

9. The method of claim 1 , wherein the definition of the static or non-static regions is carried out in each case based on the current reference image and updated after every replacement of the reference image.

10. The method of claim 1 , wherein the spatial restriction is carried out according to a predetermined weighting function, by which, starting from a respective non-static region, regions that are more distant are considered to a lesser extent in the determination and/or application of the motion field.

11. A data processing facility for generating a motion-compensated image of a target object from a plurality of projection images of the target object, wherein the data processing facility is configured to automatically:

acquire the plurality of projection images of the target object, the plurality of projection images being recorded during a motion of at least one part of the target object, wherein the motion has a main point;

generate a reference image of the target object from the plurality of projection images without using a synchronization signal that characterizes the motion of the target object; and

iteratively determine, from the plurality of projection images, a motion field that characterizes the motion of the target object, wherein the motion field comprises motion vectors for individual projection images of the plurality of projection images, with respect to the current reference image,

wherein, in each case, after a predetermined number of iterative acts with motion compensation based on the motion field that is then current in each case, a provisional motion-compensated image of the target object is generated,

wherein the respective existing reference image is replaced by the provisional motion-compensated image as a new current reference image,

wherein the iterative determination of the motion field is continued using the new current reference image,

wherein a segmentation of the plurality of projection images and/or of the images generated therefrom is carried out, that by the segmentation, static and/or non-static regions are defined and as a function thereof, the determination of the motion field and/or the use of the motion field is spatially restricted when the motion-compensated image is being generated, and

wherein, when a predetermined termination condition for the iteration is reached, the motion-compensated image is generated from the plurality of projection images and from the last iteration of the motion field, or the last provisional motion-compensated image generated during the iteration as the motion-compensated image of the target object is issued.

12. An imaging device comprising:

an acquisition facility configured to record a plurality of projection images of a target object during a motion of at least one part of the target object, the motion having a main point; and

a data processing facility configured to:

receive the plurality of projection images of the target object;

generate a reference image of the target object from the plurality of projection images without using a synchronization signal that characterizes the motion of the target object; and

iteratively determine, from the plurality of projection images, a motion field that characterizes the motion of the target object, wherein the motion field comprises motion vectors for individual projection images of the plurality of projection images, with respect to a current reference image,

wherein, in each case, after a predetermined number of iterative acts with motion compensation based on the motion field that is then current in each case, a provisional motion-compensated image of the target object is generated,

wherein the respective existing reference image is replaced by the provisional motion-compensated image as a new current reference image,

wherein the iterative determination of the motion field is continued using the new current reference image,

wherein a segmentation of the plurality of projection images and/or of the images generated therefrom is carried out, that by the segmentation, static and/or non-static regions are defined and as a function thereof, the determination of the motion field and/or the use of the motion field is spatially restricted when the motion-compensated image is being generated, and

wherein, when a predetermined termination condition for the iteration is reached, a motion-compensated image is generated from the plurality of projection images and from the last iteration of the motion field, or the last provisional motion-compensated image generated during the iteration as the motion-compensated image of the target object is issued.

13. A non-transitory computer-readable storage medium on which a computer program is stored, wherein the computer program, when executed by a computer, causes a data processing device to:

acquire a plurality of projection images of a target object, the plurality of projection images being recorded during a motion of at least one part of the target object, wherein the motion has a main point;

generate a reference image of the target object from the plurality of projection images without using a synchronization signal that characterizes the motion of the target object; and

iteratively determine, from the plurality of projection images, a motion field that characterizes the motion of the target object, wherein the motion field comprises motion vectors for individual projection images of the plurality of projection images, with respect to a current reference image,

wherein, in each case, after a predetermined number of iterative acts with motion compensation based on the motion field that is then current in each case, a provisional motion-compensated image of the target object is generated,

wherein the respective existing reference image is replaced by the provisional motion-compensated image as a new current reference image,

wherein the iterative determination of the motion field is continued using the new current reference image,

wherein a segmentation of the plurality of projection images and/or of the images generated therefrom is carried out, that by the segmentation, static and/or non-static regions are defined and as a function thereof, the determination of the motion field and/or the use of the motion field is spatially restricted when the motion-compensated image is being generated, and

wherein, when a predetermined termination condition for the iteration is reached, a motion-compensated image is generated from the plurality of projection images and from the last iteration of the motion field, or the last provisional motion-compensated image generated during the iteration as the motion-compensated image of the target object is issued.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066267/0346 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2021
From: LAURITSCH, GÜNTER
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 056673/0299 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2021
From: ROHKOHL, CHRISTOPHER
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 056673/0352 →
Priority Claims (1)
DE 102019201079.2 · Jan 29, 2019 · national
Continuity (1)
Related Publication 20200242783A1 · Jul 30, 2020
Cited By (1)
US 12,647,596