IP Library Granted Patent US 9,734,630
Granted Patent B2
US 9,734,630 · App. 14/569,997 · Granted Aug 15, 2017

Real-time three-dimensional visualization of interventional medical devices

Inventors: Weng Lei (Mount Prospect, IL); Soroosh Kargar (Lake in the Hills, IL)
Assignee: Siemens Medical Solutions USA, Inc.
G06T19/00A61B6/022A61B6/12A61B6/4441A61B6/466A61B6/469A61B6/505G06T11/008A61B2576/00G06T2210/41G06T2211/428
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,734,630
App. No.
14/569,997
Granted
Aug 15, 2017
Kind
B2
Abstract

A system and method includes acquisition of a first at least two two-dimensional images of a body, generation of a first three-dimensional image based on the first at least two two-dimensional images, acquisition of a second at least two two-dimensional images of the body, generation of a second three-dimensional image based on the second at least two two-dimensional images, determination of a difference between the first three-dimensional image and the second three-dimensional image, determination of a region of interest based on the difference, replacement of first voxels of the region of interest of the first three-dimensional image with second voxels of the region of interest of the second three-dimensional image to generate a first updated three-dimensional image, and display of the first updated three-dimensional image.

Claims (107)

1. A system comprising:

an imaging system configured to:

acquire a first at least two two-dimensional images of a body; and

acquire a second at least two two-dimensional images of the body;

an image processor configured to:

generate a first three-dimensional image based on the first at least two two-dimensional images;

generate a second three-dimensional image based on the second at least two two-dimensional images;

determine a difference between the first three-dimensional image and the second three-dimensional image;

determine a region of interest based on the difference; and

replace first voxels of the region of interest of the first three-dimensional image with second voxels of the region of interest of the second three-dimensional image to generate a first updated three-dimensional image; and

a display configured to display the first updated three-dimensional image.

2. A system according to claim 1 ,

wherein the first voxels of the region of interest of the first three-dimensional image do not depict an interventional medical device and the second voxels of the region of interest of the second three-dimensional image depict the interventional medical device.

3. A system according to claim 1 ,

the imaging system further configured to:

acquire a third at least two two-dimensional images of the body;

the image processor further configured to:

generate a third three-dimensional image based on the third at least two two-dimensional images; and

replace voxels of the region of interest of the first updated three-dimensional image with third voxels of the region of interest of the third three-dimensional image to generate a second updated three-dimensional image; and

the display further configured to:

display the second updated three-dimensional image.

4. A system according to claim 3 ,

wherein the first voxels of the region of interest of the first three-dimensional image do not depict an interventional medical device, the second voxels of the region of interest of the second three-dimensional image depict the interventional medical device, and the third voxels of the region of interest of the third three-dimensional image depict the interventional medical device.

5. A system according to claim 3 ,

the imaging system further configured to:

acquire a fourth at least two two-dimensional images of the body;

the image processor further configured to:

generate a fourth three-dimensional image based on the fourth at least two two-dimensional images;

determine a second difference between the first three-dimensional image and the fourth three-dimensional image;

determine a second region of interest based on the second difference; and

replace voxels of the second region of interest of the first three-dimensional image with voxels of the second region of interest of the fourth three-dimensional image to generate a third updated three-dimensional image; and

the display further configured to:

display the third updated three-dimensional image.

6. A system according to claim 1 ,

the imaging system further configured to:

acquire a third at least two two-dimensional images of the body;

the image processor further configured to:

generate a third three-dimensional image based on the third at least two two-dimensional images;

determine a second difference between the first three-dimensional image and the third three-dimensional image;

determine a second region of interest based on the second difference; and

replace voxels of the second region of interest of the first updated three-dimensional image with voxels of the second region of interest of the third three-dimensional image to generate a second updated three-dimensional image; and

the display further configured to:

display the second updated three-dimensional image.

7. A method comprising:

acquiring a first at least two two-dimensional images of a body;

generating a first three-dimensional image based on the first at least two two-dimensional images;

acquiring a second at least two two-dimensional images of the body;

generating a second three-dimensional image based on the second at least two two-dimensional images;

determining a difference between the first three-dimensional image and the second three-dimensional image;

determining a region of interest based on the difference;

replacing first voxels of the region of interest of the first three-dimensional image with second voxels of the region of interest of the second three-dimensional image to generate a first updated three-dimensional image; and

displaying the first updated three-dimensional image.

8. A method according to claim 7 ,

wherein the first voxels of the region of interest of the first three-dimensional image do not depict an interventional medical device and the second voxels of the region of interest of the second three-dimensional image depict the interventional medical device.

9. A method according to claim 7 , further comprising:

acquiring a third at least two two-dimensional images of the body;

generating a third three-dimensional image based on the third at least two two-dimensional images;

replacing voxels of the region of interest of the first updated three-dimensional image with third voxels of the region of interest of the third three-dimensional image to generate a second updated three-dimensional image; and

displaying the second updated three-dimensional image.

10. A method according to claim 9 ,

wherein the first voxels of the region of interest of the first three-dimensional image do not depict an interventional medical device, the second voxels of the region of interest of the second three-dimensional image depict the interventional medical device, and the third voxels of the region of interest of the third three-dimensional image depict the interventional medical device.

11. A method according to claim 9 , further comprising:

acquiring a fourth at least two two-dimensional images of the body;

generating a fourth three-dimensional image based on the fourth at least two two-dimensional images;

determining a second difference between the first three-dimensional image and the fourth three-dimensional image;

determining a second region of interest based on the second difference;

replacing voxels of the second region of interest of the first three-dimensional image with voxels of the second region of interest of the fourth three-dimensional image to generate a third updated three-dimensional image; and

displaying the third updated three-dimensional image.

12. A method according to claim 7 , further comprising:

acquiring a third at least two two-dimensional images of the body;

generating a third three-dimensional image based on the third at least two two-dimensional images;

determining a second difference between the first three-dimensional image and the third three-dimensional image;

determining a second region of interest based on the second difference;

replacing voxels of the second region of interest of the first updated three-dimensional image with voxels of the second region of interest of the third three-dimensional image to generate a second updated three-dimensional image; and

displaying the second updated three-dimensional image.

13. A non-transitory computer-readable medium storing processor-executable program code, the program code executable to cause a processor to:

acquire a first at least two two-dimensional images of a body;

generate a first three-dimensional image based on the first at least two two-dimensional images;

acquire a second at least two two-dimensional images of the body;

generate a second three-dimensional image based on the second at least two two-dimensional images;

determine a difference between the first three-dimensional image and the second three-dimensional image;

determine a region of interest based on the difference;

replace first voxels of the region of interest of the first three-dimensional image with second voxels of the region of interest of the second three-dimensional image to generate a first updated three-dimensional image; and

display the first updated three-dimensional image.

14. A medium according to claim 13 ,

wherein the first voxels of the region of interest of the first three-dimensional image do not depict an interventional medical device and the second voxels of the region of interest of the second three-dimensional image depict the interventional medical device.

15. A medium according to claim 13 , the program code further executable to cause a processor to:

acquire a third at least two two-dimensional images of the body;

generate a third three-dimensional image based on the third at least two two-dimensional images;

replace voxels of the region of interest of the first updated three-dimensional image with third voxels of the region of interest of the third three-dimensional image to generate a second updated three-dimensional image; and

display the second updated three-dimensional image.

16. A medium according to claim 15 ,

wherein the first voxels of the region of interest of the first three-dimensional image do not depict an interventional medical device, the second voxels of the region of interest of the second three-dimensional image depict the interventional medical device, and the third voxels of the region of interest of the third three-dimensional image depict the interventional medical device.

17. A medium according to claim 15 , the program code further executable to cause a processor to:

acquire a fourth at least two two-dimensional images of the body;

generate a fourth three-dimensional image based on the fourth at least two two-dimensional images;

determine a second difference between the first three-dimensional image and the fourth three-dimensional image;

determine a second region of interest based on the second difference;

replace voxels of the second region of interest of the first three-dimensional image with voxels of the second region of interest of the fourth three-dimensional image to generate a third updated three-dimensional image; and

display the third updated three-dimensional image.

18. A medium according to claim 13 , the program code further executable to cause a processor to:

acquire a third at least two two-dimensional images of the body;

generate a third three-dimensional image based on the third at least two two-dimensional images;

determine a second difference between the first three-dimensional image and the third three-dimensional image;

determine a second region of interest based on the second difference;

replace voxels of the second region of interest of the first updated three-dimensional image with voxels of the second region of interest of the third three-dimensional image to generate a second updated three-dimensional image; and

display the second updated three-dimensional image.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066267/0346 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EXECUTION DATE OF ASSIGNMENT 3, ASSIGNOR SIEMENS MEDICAL SOLUTIONS USA, INC. TO SIEMENS HEALTHCARE GMBH PREVIOUSLY RECORDED ON REEL 043379 FRAME 0673. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF INVENTOR RIGHTS.. Recorded Dec 2, 2020
From: SIEMENS MEDICAL SOLUTIONS USA, INC.
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 056112/0540 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2017
From: SIEMENS MEDICAL SOLUTIONS USA, INC.
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 043379/0673 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2015
From: LEI, WENG; KARGAR, SOROOSH
To: SIEMENS MEDICAL SOLUTIONS USA, INC.
Reel/Frame 034670/0071 →
Continuity (1)
Related Publication 20160171747A1 · Jun 16, 2016