IP Library › Granted Patent US 11,120,564
Granted Patent B2
US 11,120,564 · App. 16/063,811 · Granted Sep 14, 2021

Medical imaging apparatus and medical imaging method for inspecting a volume of a subject

Inventors: Cecile Dufour (Suresnes, FR); Stephane Allaire (Suresnes, FR); Thomas Tang (Markham, CA); Gary Cheng-How Ng (Bothell, WA)
Assignee: KONINKLIJKE PHILIPS N.V.
G06T7/33A61B6/032A61B6/5247A61B8/4254A61B8/463A61B8/483A61B8/5261A61B8/5292G06T5/50G06T7/0012G06T7/12G06T7/20G06T7/70G06T7/13G06T2200/24G06T2207/10136G06T2207/20221G06T2207/30004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,120,564
App. No.
16/063,811
Granted
Sep 14, 2021
Kind
B2
Abstract

A medical imaging apparatus ( 10 ) for inspecting a volume of a subject ( 12 ) is disclosed. The medical imaging apparatus comprises an ultrasound acquisition unit ( 14 ) including an ultrasound probe for acquiring ultrasound image data of the subject, an image interface ( 20 ) for receiving medical image data of the subject, a position determining unit ( 30 ) for determining a position of the ultrasound probe. An alignment unit is provided for aligning the ultrasound image data and the medical image data based on anatomical features ( 32 ) of the subject and the detected position of the ultrasound probe and for adapting the alignment of the ultrasound image data and the medical image data based on a motion model. An image processing unit ( 18 ) is provided for processing the ultrasound image data and the medical image data to fuse the ultrasound image data and the medical image data based on the alignment to combined image data.

Claims (43)

1. A medical imaging apparatus or inspecting a volume of a subject, comprising:

an image interface for receiving a plurality of ultrasound image data acquired by an ultrasound probe, wherein the plurality of ultrasound image data is two dimensional data comprising a plurality of temporally discrete image planes, and medical image data of the subject, wherein the medical image data is three dimensional data comprising a plurality of image planes disposed parallel to one another and oriented in a cranio-caudal direction;

a position determining unit for receiving a position data of the ultrasound probe; and

an image processing unit configured to:

determine a motion model of the volume based on the position of the ultrasound probe and a variation of a repetitive temporal pattern of anatomical features throughout the plurality of temporally discrete image planes, wherein the motion model includes a cranio-caudal translation model having a respiration function B(t) and is determined based on the plurality of ultrasound image data acquired during at least one respiratory period of the respiration function B(t);

determine a motion state of the anatomical features in individual ones of the plurality of image planes of the medical image data based on the motion model;

detect a pattern of the anatomical features in the medical image data and the plurality of ultrasound imaging data;

select one of the plurality of image planes of the medical image data based on the pattern; and

align the ultrasound image data and the one of the plurality of image planes of the medical image data based on the motion model,

wherein the image processing unit comprises:

a fusion unit for processing the ultrasound image data and the medical image data to fuse the ultrasound image data and the medical image data based on the alignment to combined image data.

2. The medical imaging apparatus as claimed in claim 1 , wherein the image processing unit is adapted to determine corresponding anatomical features in the ultrasound data and the medical image data and to align the ultrasound data and the medical image data based on the corresponding anatomical features.

3. The medical imaging apparatus as claimed in claim 2 , wherein the image processing unit is adapted to align the ultrasound data and the medical image data based on a distance between the determined corresponding anatomical features.

4. The medical imaging apparatus as claimed in claim 2 , wherein the image processing unit is further configured to adapted the alignment of the ultrasound image data and the medical image data on the basis of the determined motion state.

5. The medical imaging apparatus as claimed in claim 1 , wherein the image processing unit comprises a segmentation unit for providing segmentation data of anatomical features of the subject, and an alignment unit adapted to align the ultrasound image data and the medical image data based on the segmentation data.

6. The image medical imaging apparatus as claimed in claim 1 , further comprising the ultrasound probe for acquiring the plurality of ultrasound image data, and wherein the position determining unit is arranged to determining a position of the ultrasound probe.

7. The medical imaging apparatus as claimed in claim 6 , wherein the image processing unit is further configured to determine a subset of the plurality of image planes in the medical image data, based on the determined position of the ultrasound probe.

8. The medical imaging apparatus as claimed in claim 7 , wherein the one of the plurality of image planes is selected from the subset of the plurality of image planes.

9. The medical imaging apparatus as claimed in claim 7 , wherein the image processing unit is adapted to select one image plane of the subset of the plurality of image planes of the medical image data on the basis of a probability algorithm.

10. The medical imaging apparatus as claimed in claim 9 , wherein the probability algorithm is a Viterbi algorithm.

11. The medical imaging apparatus as claimed in claim 1 , wherein the motion model is determined based on the position of the ultrasound probe received from the position determining unit.

12. A medical imaging method for inspecting a volume of a subject, comprising the steps of:

receiving a plurality of ultrasound image data acquired by an ultrasound probe, wherein the plurality of ultrasound image data is two dimensional data comprising a plurality of temporally discrete image planes;

receiving medical image data of the subject via an image interface, wherein the medical image data is three dimensional data comprising a plurality of image planes disposed parallel to one another and oriented in a cranio-caudal direction;

receiving a position of the ultrasound probe;

determining a motion model of the volume based on the position of the ultrasound probe and a variation of a repetitive temporal pattern of anatomical features throughout the plurality temporally discrete image planes wherein the motion model includes a cranio-caudal translation model having a respiration function B(t) and is determined based on the plurality of ultrasound image data acquired during at least one respiratory period of the respiration function B(t);

determining a motion state of the anatomical features in individual ones of the plurality of image planes of the medical image data based on the motion model;

detecting a pattern of the anatomical features in the medical image data and the plurality of ultrasound imaging data;

selecting one of the plurality of image planes of the medical image data based on the pattern;

aligning the plurality of ultrasound image data and one of the plurality of image planes of the medical image data;

adapting the alignment of the plurality of ultrasound image data and one of the plurality of image planes of the medical image data based on the motion model; and

processing the ultrasound image data and the medical image data to fuse the ultrasound image data and the medical image data based on the alignment to generate combined image data.

13. A non-transitory computer readable medium including instructions that when executed, cause an ultrasound imaging system to:

receive a plurality of ultrasound image data acquired by an ultrasound probe, wherein the plurality of ultrasound image data is two dimensional data comprising a plurality of temporally discrete image-planes;

receive medical image data of the subject via an image interface, wherein the medical image data is three dimensional data comprising a plurality of image planes disposed parallel to one another and oriented in a cranio-caudal direction;

receive a position of the ultrasound probe:

determine a motion model of the volume based on the position of the ultrasound probe and a variation of a repetitive temporal pattern of anatomical features throughout the plurality temporally discrete image planes wherein the motion model includes a cranio-caudal translation model having a respiration function B(t) and is determined based on the plurality of ultrasound image data acquired during at least one respiratory period of the respiration function B(t);

determine a motion state of the anatomical features in individual ones of the plurality of image planes of the medical image data based on the motion model;

detect a pattern of the anatomical features in the medical image data and the plurality of ultrasound imaging data;

select one of the plurality of image planes of the medical image data based on the pattern;

align the plurality of ultrasound image data and one of the plurality of image planes of the medical image data;

adapt the alignment of the plurality of ultrasound image data and one of the plurality of image planes of the medical image data based on the motion model; and

process the ultrasound image data and the medical image data to fuse the ultrasound image data and the medical image data based on the alignment to generate combined image data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 19, 2018
From: DUFOUR, CECILE; ALLAIRE, STEPHANE; TANG, THOMAS; NG, GARY CHENG-HOW
To: KONINKLIJKE PHILIPS N.V.
Reel/Frame 046128/0280 →
Continuity (2)
Provisional Application 62270868 · Dec 22, 2015
Related Publication 20200273184A1 · Aug 27, 2020