IP Library Granted Patent US 10,460,508
Granted Patent B2
US 10,460,508 · App. 14/735,243 · Granted Oct 29, 2019

Visualization with anatomical intelligence

Inventors: Yiqiang Zhan (Berwyn, PA); Gerardo Hermosillo-Valadez (West Chester, PA); Xiang Sean Zhou (Exton, PA); Matthias Fenchel (Erlangen, DE); Berthold Kiefer (Erlangen, DE)
Assignee: Siemens Healthcare GmbH
G06T15/08A61B5/0033A61B5/055G06K9/4671G06T7/11G06T7/149G06T19/20A61B5/4504G06T2207/10088G06T2207/20128G06T2210/41G06T2219/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,460,508
App. No.
14/735,243
Granted
Oct 29, 2019
Kind
B2
Abstract

A framework for facilitating visualization, including localizing at least one anatomical structure of interest in image data. The structure of interest is then highlighted by reformatting the image data by mapping landmarks associated with the structure of interest to corresponding points along a contour of a geometric shape and warping the image data based on the mapped landmarks. The resulting reformatted image data is rendered for display to a user.

Claims (26)

1. A computer-implemented method of visualization, comprising:

(i) receiving magnetic resonance image data;

(ii) automatically localizing at least one bone structure of interest in the image data that appears only in a first number of slices in the image data;

(iii) highlighting and flattening the localized bone structure of interest by reformatting the image data into reformatted image data by

estimating a cylindrical shape of the localized bone structure of interest based on landmarks associated with the localized bone structure of interest,

resampling voxels on a surface of the cylindrical shape from the image data, and

mapping the resampled voxels on the cylindrical shape to corresponding points on a visualization plane to flatten the localized bone structure of interest, and

wherein the bone structure of interest appears only in a second number of slices of the reformatted image data, wherein the second number of slices is less than the first number of slices; and

(iv) rendering the reformatted image data for display via a display device.

2. The method of claim 1 wherein automatically localizing the bone structure of interest comprises performing a segmentation technique and generating a segmentation mask that delineates the bone structure of interest.

3. The method of claim 2 wherein the segmentation technique comprises atlas-based segmentation, deformable model-based segmentation, classification-based tissue labeling, or a combination thereof.

4. The method of claim 2 wherein highlighting the localized bone structure of interest comprises applying the segmentation mask to the image data and removing structures outside the mask.

5. The method of claim 1 wherein automatically localizing the bone structure of interest comprises detecting the landmarks associated with the localized bone structure of interest.

6. The method of claim 5 wherein detecting the landmarks associated with the localized bone structure of interest comprises performing learning-based detection, salient point detection, or a combination thereof.

7. The method of claim 1 wherein highlighting and flattening the localized bone structure of interest comprises estimating multiple cylindrical shapes of the bone structure of interest based on the landmarks associated with the localized bone structure of interest and mapping voxels on the multiple cylindrical shapes to corresponding visualization planes.

8. The method of claim 1 wherein the cylindrical shape comprises an ellipse cylinder or a circle cylinder.

9. The method of claim 1 wherein rendering the reformatted image data for display via the display device comprises performing multi-planar reformatting (MPR), maximum/minimum intensity projection (MIP) and Volume Rendering Technique (VRT) based on the reformatted image data.

10. A non-transitory computer readable medium embodying a program of instructions executable by machine to perform steps for visualization, the steps comprising:

(i) receiving magnetic resonance image data;

(ii) automatically localizing at least one bone structure of interest in the image data that appears only in a first number of slices in the image data;

(iii) highlighting and flattening the localized bone structure of interest by reformatting the image data into reformatted image data by

estimating a cylindrical shape of the localized bone structure of interest based on landmarks associated with the localized bone structure of interest,

resampling voxels on a surface of the cylindrical shape from the image data,

mapping the resampled voxels on the cylindrical shape to corresponding points on a visualization plane to flatten the localized bone structure of interest, and

wherein the bone structure of interest appears only in a second number of slices of the reformatted image data, wherein the second number of slices is less than the first number of slices; and

(iv) rendering the reformatted image data for display via a display device.

Assignments (6)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE PREVIOUSLY RECORDED AT REEL: 066088 FRAME: 0256. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2024
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 071178/0246 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066088/0256 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2019
From: SIEMENS MEDICAL SOLUTIONS USA, INC.
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 049938/0447 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2019
From: SIEMENS AKTIENGESELLSCHAFT
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 049938/0469 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2015
From: FENCHEL, MATTHIAS; KIEFER, BERTHOLD
To: SIEMENS AKTIENGESELLSCHAFT
Reel/Frame 035880/0662 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 15, 2015
From: ZHAN, YIQIANG; HERMOSILLO VALADEZ, GERARDO; ZHOU, XIANG SEAN
To: SIEMENS MEDICAL SOLUTIONS USA, INC.
Reel/Frame 035838/0689 →
Continuity (2)
Provisional Application 62011273 · Jun 12, 2014
Related Publication 20150363963A1 · Dec 17, 2015
Cited By (1)
US 12,277,718